-- Logs begin at Thu 2022-09-15 11:44:57 UTC, end at Thu 2022-09-15 12:47:37 UTC. -- Sep 15 12:09:39.169221 dv-cinder-850836-7-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 15 12:09:39.180479 dv-cinder-850836-7-smb devstack@keystone.service[81362]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 15 12:09:39.180479 dv-cinder-850836-7-smb devstack@keystone.service[81362]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 15 12:09:39 2022] *** Sep 15 12:09:39.180479 dv-cinder-850836-7-smb devstack@keystone.service[81362]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 15 12:09:39.180479 dv-cinder-850836-7-smb devstack@keystone.service[81362]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 15 12:09:39.180479 dv-cinder-850836-7-smb devstack@keystone.service[81362]: nodename: dv-cinder-850836-7-smb Sep 15 12:09:39.180479 dv-cinder-850836-7-smb devstack@keystone.service[81362]: machine: x86_64 Sep 15 12:09:39.180479 dv-cinder-850836-7-smb devstack@keystone.service[81362]: clock source: unix Sep 15 12:09:39.180479 dv-cinder-850836-7-smb devstack@keystone.service[81362]: pcre jit disabled Sep 15 12:09:39.180479 dv-cinder-850836-7-smb devstack@keystone.service[81362]: detected number of CPU cores: 4 Sep 15 12:09:39.180479 dv-cinder-850836-7-smb devstack@keystone.service[81362]: current working directory: / Sep 15 12:09:39.180479 dv-cinder-850836-7-smb devstack@keystone.service[81362]: detected binary path: /usr/bin/uwsgi-core Sep 15 12:09:39.180479 dv-cinder-850836-7-smb devstack@keystone.service[81362]: your processes number limit is 47680 Sep 15 12:09:39.180479 dv-cinder-850836-7-smb devstack@keystone.service[81362]: your memory page size is 4096 bytes Sep 15 12:09:39.180479 dv-cinder-850836-7-smb devstack@keystone.service[81362]: detected max file descriptor number: 2048 Sep 15 12:09:39.180479 dv-cinder-850836-7-smb devstack@keystone.service[81362]: lock engine: pthread robust mutexes Sep 15 12:09:39.180479 dv-cinder-850836-7-smb devstack@keystone.service[81362]: thunder lock: enabled Sep 15 12:09:39.180479 dv-cinder-850836-7-smb devstack@keystone.service[81362]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 15 12:09:39.180479 dv-cinder-850836-7-smb devstack@keystone.service[81362]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 15 12:09:39.219848 dv-cinder-850836-7-smb devstack@keystone.service[81362]: Python main interpreter initialized at 0x559c281969c0 Sep 15 12:09:39.219848 dv-cinder-850836-7-smb devstack@keystone.service[81362]: python threads support enabled Sep 15 12:09:39.219848 dv-cinder-850836-7-smb devstack@keystone.service[81362]: your server socket listen backlog is limited to 100 connections Sep 15 12:09:39.219848 dv-cinder-850836-7-smb devstack@keystone.service[81362]: your mercy for graceful operations on workers is 90 seconds Sep 15 12:09:39.220150 dv-cinder-850836-7-smb devstack@keystone.service[81362]: mapped 403077 bytes (393 KB) for 2 cores Sep 15 12:09:39.220230 dv-cinder-850836-7-smb devstack@keystone.service[81362]: *** Operational MODE: preforking *** Sep 15 12:09:39.220485 dv-cinder-850836-7-smb devstack@keystone.service[81362]: *** uWSGI is running in multiple interpreter mode *** Sep 15 12:09:39.220485 dv-cinder-850836-7-smb devstack@keystone.service[81362]: spawned uWSGI master process (pid: 81362) Sep 15 12:09:39.220675 dv-cinder-850836-7-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 15 12:09:39.221237 dv-cinder-850836-7-smb devstack@keystone.service[81362]: spawned uWSGI worker 1 (pid: 81374, cores: 1) Sep 15 12:09:39.221570 dv-cinder-850836-7-smb devstack@keystone.service[81362]: spawned uWSGI worker 2 (pid: 81375, cores: 1) Sep 15 12:09:39.223167 dv-cinder-850836-7-smb devstack@keystone.service[81362]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 15 12:09:43.557993 dv-cinder-850836-7-smb devstack@keystone.service[81374]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 15 12:09:43.557993 dv-cinder-850836-7-smb devstack@keystone.service[81374]: from cryptography.utils import int_from_bytes Sep 15 12:09:43.558806 dv-cinder-850836-7-smb devstack@keystone.service[81374]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 15 12:09:43.558806 dv-cinder-850836-7-smb devstack@keystone.service[81374]: from cryptography.utils import int_from_bytes Sep 15 12:09:43.560933 dv-cinder-850836-7-smb devstack@keystone.service[81375]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 15 12:09:43.560933 dv-cinder-850836-7-smb devstack@keystone.service[81375]: from cryptography.utils import int_from_bytes Sep 15 12:09:43.561403 dv-cinder-850836-7-smb devstack@keystone.service[81375]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 15 12:09:43.561403 dv-cinder-850836-7-smb devstack@keystone.service[81375]: from cryptography.utils import int_from_bytes Sep 15 12:09:43.612111 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 15 12:09:43.612309 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 15 12:09:43.612507 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] command line args: [] {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 15 12:09:43.612781 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 15 12:09:43.612960 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ================================================================================ {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 15 12:09:43.613220 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] admin_token = **** {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:09:43.613471 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] config_dir = [] {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:09:43.613590 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 15 12:09:43.613668 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:09:43.613782 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 15 12:09:43.613866 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] config_source = [] {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:09:43.613973 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] command line args: [] {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 15 12:09:43.614063 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] debug = True {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:09:43.614192 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:09:43.614436 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 15 12:09:43.614436 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ================================================================================ {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 15 12:09:43.614555 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:09:43.614740 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] admin_token = **** {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:09:43.614823 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:09:43.614917 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] config_dir = [] {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:09:43.614987 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:09:43.615099 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:09:43.615236 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:09:43.615351 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] config_source = [] {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:09:43.615447 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] debug = True {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:09:43.615547 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] list_limit = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:09:43.615647 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:09:43.615765 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] log_config_append = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:09:43.615867 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:09:43.615967 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:09:43.616060 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] log_dir = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:09:43.616158 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:09:43.616251 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] log_file = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:09:43.616342 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:09:43.616452 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:09:43.616570 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:09:43.616651 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:09:43.616772 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] list_limit = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:09:43.616853 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:09:43.616967 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] log_config_append = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:09:43.617051 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:09:43.617127 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:09:43.617251 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] log_dir = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:09:43.617332 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:09:43.617453 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] log_file = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:09:43.617535 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:09:43.617613 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:09:43.617728 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:09:43.617849 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:09:43.617934 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:09:43.618034 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:09:43.618118 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:09:43.618280 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:09:43.618363 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:09:43.618485 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:09:43.618566 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:09:43.618719 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:09:43.618809 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:09:43.618880 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:09:43.619049 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:09:43.619128 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:09:43.619301 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:09:43.619380 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:09:43.619541 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:09:43.619665 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:09:43.619773 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:09:43.620003 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:09:43.620121 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:09:43.620237 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] publish_errors = False {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:09:43.620314 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:09:43.620479 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:09:43.620557 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:09:43.620715 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:09:43.620802 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:09:43.620900 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:09:43.621154 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:09:43.621229 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:09:43.621383 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] publish_errors = False {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:09:43.621468 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:09:43.621613 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:09:43.621690 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] standard_threads = False {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:09:43.621839 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:09:43.621927 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:09:43.622004 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:09:43.622074 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:09:43.622248 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:09:43.622330 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:09:43.622408 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] use_journal = False {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:09:43.622478 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:09:43.622590 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] use_json = False {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:09:43.622714 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] standard_threads = False {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:09:43.622805 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] use_stderr = False {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:09:43.622953 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:09:43.623100 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] use_syslog = False {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:09:43.623175 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:09:43.623244 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:09:43.623358 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:09:43.623441 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.623533 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] use_journal = False {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:09:43.623669 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.623746 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] use_json = False {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:09:43.623867 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] use_stderr = False {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:09:43.623949 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.624041 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] use_syslog = False {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:09:43.624162 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.624252 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 12:09:43.624418 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.624502 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.624661 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.624737 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.625166 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.625261 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.625408 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.625485 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.625659 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.625734 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.625916 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.626001 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.626164 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.626240 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.626400 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.626474 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.626645 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.626753 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.626935 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.627015 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.627180 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.627262 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.627415 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.627504 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.627659 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.627735 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.627898 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.628018 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.628147 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.628240 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.628394 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.628471 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.628630 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.628712 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.628884 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.629038 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.629139 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.629222 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.629385 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.629479 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.629622 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.629707 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.629861 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.629942 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.630097 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.630174 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.630334 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.630411 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.630574 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.630650 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.630834 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.630913 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.631066 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.631143 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.631296 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.631373 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.631531 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.631606 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.631776 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.631853 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.632023 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.632099 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.632253 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.632329 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.632482 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.632566 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.632725 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.632807 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.632964 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.633040 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.633197 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.633273 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.633429 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.633510 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.633662 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.633743 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.633892 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.633968 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.634123 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.634198 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.634352 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.634429 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.634576 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.634650 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.634823 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.634902 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.635052 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.635138 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.635286 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.635364 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.635524 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.635599 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.635757 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.635831 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.635990 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.636068 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.636219 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.636295 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.636455 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.636531 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.636688 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.636765 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.636924 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.637000 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.637148 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.637223 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.637383 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.637460 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.637613 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.637721 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.637836 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.637976 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.638081 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.638175 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.638267 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.638361 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.638498 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.638610 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.638767 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.638903 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.639004 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.639081 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.639236 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.639328 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.639468 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.639600 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.639726 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.639847 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.639960 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.640043 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.640191 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.640278 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.640427 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.640505 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.640662 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.640745 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.640929 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.641010 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.641164 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.641243 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.641403 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.641484 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.641641 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.641727 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.641876 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.641963 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.642110 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.642188 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.642345 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.642433 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.642610 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.642741 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.642869 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.642945 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.643104 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.643198 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.643344 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.643422 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.643577 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.643662 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.643816 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.643901 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.644050 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.644128 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.644286 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.644369 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.644522 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.644608 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.644755 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.644833 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.644990 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.645073 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.645240 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.645324 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.645476 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.645553 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.645713 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.645789 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.645951 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.646106 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.646181 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.646251 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.646411 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.646488 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.646644 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.646759 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.646902 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.646980 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.647133 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.647215 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.647361 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.647438 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.647590 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.647668 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.647818 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.647896 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.648056 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.648158 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.648285 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.648371 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.648523 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.648601 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.648757 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.648844 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.649005 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.649092 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.649242 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.649320 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] auth.external = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.649475 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.649578 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.649740 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.649819 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.649980 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.650059 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.650210 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] auth.external = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.650289 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] auth.password = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.650439 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.650517 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] auth.token = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.650680 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.650774 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.650948 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.651036 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.651191 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] auth.password = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.651269 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.651423 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] auth.token = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.651502 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.651661 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.651739 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.651897 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.651975 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.652129 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.652208 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.652361 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.652438 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] credential.caching = True {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.652608 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.652692 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.652853 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.652935 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.653082 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.653160 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.653317 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] credential.caching = True {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.653394 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.653564 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.653643 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.653802 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.653879 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.654046 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.654122 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.654288 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.654367 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.654531 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.654608 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.654785 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.654867 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.655032 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.655118 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.655282 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.655360 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.655517 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.655612 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.655775 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.655858 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.656055 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.656168 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.656295 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] federation.caching = True {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.656383 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.656536 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.656616 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.656776 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.656853 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.657025 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.657102 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.657257 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] federation.caching = True {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.657336 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.657493 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.657608 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.657729 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.657814 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.657974 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.658051 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.658748 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.658832 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.659000 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.659102 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.659234 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.659313 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.659483 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.659561 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.659715 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.659801 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] identity.caching = True {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.659965 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.660042 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.660197 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.660274 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.660440 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.660595 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.660677 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] identity.caching = True {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.660750 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.660908 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.660986 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.661139 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.661263 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.661377 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.661455 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.661612 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.661690 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.661857 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.661943 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.662085 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.662164 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.662317 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.662394 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.662551 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.662638 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.662819 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.662900 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.663049 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.663127 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.663276 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.663364 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.663504 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.663583 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.663747 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.663825 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.663991 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.664085 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.664234 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.664316 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.664484 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.664562 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.664727 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.664818 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.664966 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.665050 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.665202 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.665281 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.665439 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.665525 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.665668 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.665747 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.665901 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.665979 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.666134 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.666224 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.666368 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.666447 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.666604 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.666681 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.666865 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.666957 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.667106 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.667191 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.667332 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.667410 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.667597 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.667675 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.667831 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.667909 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.668070 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.668147 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.668301 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.668379 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.668543 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.668622 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.668768 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.668848 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.669004 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.669083 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.669231 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.669309 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.669465 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.669543 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.669699 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.669778 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.669936 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.670060 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.670170 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.670297 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.670405 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.670534 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.670651 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.670813 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.670928 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.671069 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.671166 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.671314 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.671393 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.671556 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.671717 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.671795 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.671968 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.672055 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.user = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.672207 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.672285 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.672443 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.672522 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.672682 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.672761 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.672915 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.user = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.672993 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.673155 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.673233 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.673414 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.673494 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.673647 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.673725 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.674457 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.674539 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.674755 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.674839 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.674966 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.675044 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.675201 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.675279 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.675432 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.675512 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.675668 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.675746 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.675904 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.675982 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.676144 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.676224 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.676376 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.676454 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.676622 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.676700 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.676860 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.676938 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.677105 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.677182 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.677345 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.677423 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.677585 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.677665 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.677813 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.677890 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.678052 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.678129 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.678286 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.678365 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.678521 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.678599 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.678780 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.678867 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.679015 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.679096 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.679261 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.679340 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.679506 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.679585 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.679742 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.679822 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.679981 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.680059 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.680213 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.680290 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.680457 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.680537 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.680694 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.680772 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.680928 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.681005 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.681162 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.681240 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.681405 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] resource.caching = True {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.681482 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.681644 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.681721 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.681876 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.681956 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.682110 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.682189 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.682350 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] resource.caching = True {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.682428 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.682602 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.682682 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.682864 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.682953 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.683098 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.683177 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.683345 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.683431 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.683586 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.683664 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.683819 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.683973 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] role.caching = True {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.684049 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.684121 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] role.driver = sql {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.684290 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.684368 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.684525 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.684612 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.684761 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] role.caching = True {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.684839 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.685007 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] role.driver = sql {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.685085 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.685235 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.685322 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.685481 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.685559 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.685729 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.685808 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.685976 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.686066 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.686226 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.686303 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.686468 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.686546 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.686735 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.686829 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.686986 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.687065 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.687234 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.687312 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.687463 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.687551 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.687710 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.687867 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.687945 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.688108 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.688186 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.688362 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.688442 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.688618 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.688798 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.688901 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.689033 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.689119 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.689283 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.689363 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.689579 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.689658 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.689829 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.689909 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.690078 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.690157 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.690311 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.690388 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.690547 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.690627 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.690805 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.690897 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.691040 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.691117 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.691269 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.691349 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.691502 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.691581 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.691733 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.691811 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.691982 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.692062 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.692226 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.692303 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.692468 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] token.caching = True {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.692546 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.692701 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.692779 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.692935 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.693013 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.693165 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.693244 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.693400 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] token.caching = True {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.693480 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.693636 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.693714 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.693882 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.694007 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.694117 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.694198 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.694363 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.694440 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.694605 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.694682 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.694864 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.694945 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.695108 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.695185 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.695348 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.695426 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.695593 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.695671 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.695828 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.695906 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.696066 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.696144 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.696307 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.696398 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.696552 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.696630 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.696826 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.696904 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] database.connection = **** {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.697054 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.697144 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.697298 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.697386 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.697539 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.697616 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.697783 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.697861 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] database.connection = **** {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.698025 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.698111 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.698265 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.698343 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.698500 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.698577 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.698760 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.698872 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.698998 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.699077 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.699235 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.699313 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.699471 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.699558 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.699708 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.699787 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.699953 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.700031 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.700187 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.700274 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.700430 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.700510 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.700662 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.700739 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.700906 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.700992 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.701141 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.701219 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.701311 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 15 12:09:43.701388 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.701600 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.701838 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.702072 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 12:09:43.702240 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 15 12:09:43.730926 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:09:43.731151 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:09:43.731253 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:09:43.731379 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:09:43.731462 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:09:43.731597 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:09:43.740356 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:09:43.740535 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:09:43.768157 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:09:43.768381 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:09:43.768638 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:09:43.768873 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:09:43.821185 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:09:43.821771 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:09:43.870035 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:09:43.870263 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:09:43.872929 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:09:43.873172 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:09:44.025519 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:09:44.025710 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:09:44.025790 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:09:44.025868 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:09:44.025968 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:09:44.026047 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:09:44.026161 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:09:44.026245 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:09:44.026380 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:09:44.026473 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:09:44.026600 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:09:44.026702 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:09:44.050257 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:09:44.050363 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:09:44.050481 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:09:44.050582 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:09:44.050731 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:09:44.050859 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:09:44.050942 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:09:44.051046 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:09:44.051158 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:09:44.051269 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:09:44.051352 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:09:44.051487 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:09:44.051567 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:09:44.051704 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:09:44.062469 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:09:44.062812 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:09:44.075600 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:09:44.075783 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:09:44.075971 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:09:44.076068 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:09:44.076207 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:09:44.076291 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:09:44.076418 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:09:44.076500 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:09:44.076631 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:09:44.076733 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:09:44.076843 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81375) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:09:44.076927 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:09:44.077059 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:09:44.077282 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81374) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 12:09:44.093307 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.093517 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 15 12:09:44.093859 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.094055 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 15 12:09:44.094323 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.094426 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.094538 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 15 12:09:44.094620 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.094854 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.094946 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.095101 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.095183 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 15 12:09:44.095380 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.095685 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.095954 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.096220 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.104619 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.104899 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.105171 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.105452 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.105821 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.106105 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.106383 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.106672 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.112903 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81375) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 12:09:44.114180 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81374) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 12:09:44.115795 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81375) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 12:09:44.116077 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.116358 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.116641 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.116921 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.117114 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81374) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 12:09:44.117208 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.117406 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.117488 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.117684 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.117765 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.117950 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.118032 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.118219 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.118298 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.118482 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.118570 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.118791 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.119072 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.119349 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.119628 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.119901 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.141726 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.143229 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81375) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 12:09:44.143481 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.143563 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.144967 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81374) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 12:09:44.145257 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.148111 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81375) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 12:09:44.148394 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.148674 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.150051 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81374) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 12:09:44.150342 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.150631 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.154979 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81375) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 12:09:44.155260 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.157083 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81374) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 12:09:44.157376 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.160821 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81375) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 12:09:44.161116 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.161405 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.161691 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.161967 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.162244 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.162519 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.162820 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.163070 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81374) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 12:09:44.163370 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.163663 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.163957 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.164242 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.164524 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.164801 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.165075 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.178606 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.178909 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.180953 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.181239 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.182730 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81375) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 12:09:44.185050 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81374) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 12:09:44.185924 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.186220 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.188272 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.188575 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.191027 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81375) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 12:09:44.193289 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81374) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 12:09:44.194126 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81375) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 12:09:44.196468 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81374) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 12:09:44.197325 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.197622 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.197907 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.198190 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.198463 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.198759 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.199704 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.200010 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.200300 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.200590 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.200888 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.201181 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.214301 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81375) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 12:09:44.214588 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.214883 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.215148 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.216902 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81374) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 12:09:44.217196 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.217469 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.217738 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.222431 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.224001 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.225139 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.225519 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.225794 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.226683 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.228252 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.228448 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81375) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 12:09:44.228539 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.228736 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.229017 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.229299 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.229689 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.231364 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81374) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 12:09:44.231656 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.231950 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.232237 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.232635 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.241288 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81375) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 12:09:44.241583 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.241864 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.242143 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.242522 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.242828 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.243122 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.244355 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81374) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 12:09:44.244645 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.244930 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.245216 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.245601 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.245895 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.246181 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.258551 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81375) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 12:09:44.261460 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81375) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 12:09:44.261848 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81374) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 12:09:44.264314 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.264771 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81374) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 12:09:44.265770 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.267258 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81375) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 12:09:44.267566 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.267723 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.267982 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.269194 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.270670 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81374) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 12:09:44.270985 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.271386 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.274242 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.275709 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81375) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 12:09:44.277745 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.278547 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.278967 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.279255 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81374) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 12:09:44.279339 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.279528 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.282131 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.282532 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.282855 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.283661 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.287807 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81375) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 12:09:44.288098 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.288377 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.291459 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81374) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 12:09:44.291764 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.292053 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.295199 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81375) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 12:09:44.295489 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.295769 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.296052 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.296323 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.296591 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.296861 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.297137 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.297415 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.297719 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.298014 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.298276 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.298536 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.299413 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81375) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.299555 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81374) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 12:09:44.299767 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.300056 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.300340 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.300632 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.300924 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.301215 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.301498 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.301775 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.302057 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.302373 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.302782 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.303062 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.303340 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81374) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 12:09:44.332735 dv-cinder-850836-7-smb devstack@keystone.service[81375]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x559c281969c0 pid: 81375 (default app) Sep 15 12:09:44.335922 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bee79c-f525-4c3e-af36-34d31a4db066 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:09:44.336207 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bee79c-f525-4c3e-af36-34d31a4db066 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:09:44.336476 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bee79c-f525-4c3e-af36-34d31a4db066 None None] PATH_INFO: `/v3` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:09:44.337470 dv-cinder-850836-7-smb devstack@keystone.service[81374]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x559c281969c0 pid: 81374 (default app) Sep 15 12:09:44.340596 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 791 bytes} [Thu Sep 15 12:09:44 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:09:51.051004 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544e5d2-2db8-4e0b-9af5-ec0dea37b3fb None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:09:51.051499 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544e5d2-2db8-4e0b-9af5-ec0dea37b3fb None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:09:51.051599 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544e5d2-2db8-4e0b-9af5-ec0dea37b3fb None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:09:51.056060 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1/2] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:09:51 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:09:51.061439 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab3b9da-f345-4e6d-934a-f361450dcea5 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:09:51.061834 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab3b9da-f345-4e6d-934a-f361450dcea5 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:09:51.061966 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab3b9da-f345-4e6d-934a-f361450dcea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:09:51.133014 dv-cinder-850836-7-smb devstack@keystone.service[81375]: INFO dbcounter [None req-fab3b9da-f345-4e6d-934a-f361450dcea5 None None] Registered counter for database keystone Sep 15 12:09:51.152130 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG oslo_db.sqlalchemy.engines [None req-fab3b9da-f345-4e6d-934a-f361450dcea5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81375) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 12:09:51.158357 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writer thread running {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 12:09:51.337650 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG passlib.handlers.bcrypt [None req-fab3b9da-f345-4e6d-934a-f361450dcea5 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81375) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 15 12:09:51.337955 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG passlib.handlers.bcrypt [None req-fab3b9da-f345-4e6d-934a-f361450dcea5 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81375) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 15 12:09:51.396078 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-fab3b9da-f345-4e6d-934a-f361450dcea5 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:09:51.397655 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-fab3b9da-f345-4e6d-934a-f361450dcea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:09:51.523968 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 2/3] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:09:51 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 463 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 15 12:09:51.956099 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a544e5d2-2db8-4e0b-9af5-ec0dea37b3fb None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:09:52.025063 dv-cinder-850836-7-smb devstack@keystone.service[81374]: INFO dbcounter [None req-a544e5d2-2db8-4e0b-9af5-ec0dea37b3fb None None] Registered counter for database keystone Sep 15 12:09:52.045934 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG oslo_db.sqlalchemy.engines [None req-a544e5d2-2db8-4e0b-9af5-ec0dea37b3fb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81374) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 12:09:52.052591 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writer thread running {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 12:09:52.169900 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a544e5d2-2db8-4e0b-9af5-ec0dea37b3fb None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:09:52.174641 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3e141b-fcb6-447e-bc6c-3ea2a41430b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:09:52.175279 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e141b-fcb6-447e-bc6c-3ea2a41430b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:09:52.175557 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e141b-fcb6-447e-bc6c-3ea2a41430b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:09:52.175829 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e141b-fcb6-447e-bc6c-3ea2a41430b2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:09:52.183809 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3e141b-fcb6-447e-bc6c-3ea2a41430b2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:09:52.234174 dv-cinder-850836-7-smb devstack@keystone.service[81374]: WARNING keystone.common.rbac_enforcer.enforcer [None req-2a3e141b-fcb6-447e-bc6c-3ea2a41430b2 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 15 12:09:52.234462 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3e141b-fcb6-447e-bc6c-3ea2a41430b2 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:09:52.244154 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 2/4] 10.222.0.16 () {58 vars in 1324 bytes} [Thu Sep 15 12:09:51 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 15 12:09:52.250013 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab3b9da-f345-4e6d-934a-f361450dcea5 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:09:52.267351 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab3b9da-f345-4e6d-934a-f361450dcea5 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:09:52.271705 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb211c4e-cdbf-469c-b639-83676f9b4ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:09:52.272800 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb211c4e-cdbf-469c-b639-83676f9b4ed6 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:09:52.273080 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb211c4e-cdbf-469c-b639-83676f9b4ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:09:52.273350 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb211c4e-cdbf-469c-b639-83676f9b4ed6 admin admin] PATH_INFO: `/v3/projects/d145f986559340aaa64b155220d60d8c` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:09:52.274951 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb211c4e-cdbf-469c-b639-83676f9b4ed6 admin admin] RBAC: Authorizing `identity:get_project(project_id=d145f986559340aaa64b155220d60d8c)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:09:52.328064 dv-cinder-850836-7-smb devstack@keystone.service[81375]: WARNING keystone.common.rbac_enforcer.enforcer [None req-bb211c4e-cdbf-469c-b639-83676f9b4ed6 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 15 12:09:52.328406 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb211c4e-cdbf-469c-b639-83676f9b4ed6 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:09:52.332971 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 3/5] 10.222.0.16 () {56 vars in 1207 bytes} [Thu Sep 15 12:09:52 2022] GET /identity/v3/projects/d145f986559340aaa64b155220d60d8c => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:09:54.430670 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d16e9b-e500-4c27-8a70-dcf14e6b9603 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:09:54.431239 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d16e9b-e500-4c27-8a70-dcf14e6b9603 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:09:54.431239 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d16e9b-e500-4c27-8a70-dcf14e6b9603 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:09:54.435271 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 3/6] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:09:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:09:54.441269 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99adce-c6fa-4bb8-b27e-005eda3d8e03 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:09:54.441667 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99adce-c6fa-4bb8-b27e-005eda3d8e03 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:09:54.441810 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99adce-c6fa-4bb8-b27e-005eda3d8e03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:09:54.461883 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-da99adce-c6fa-4bb8-b27e-005eda3d8e03 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:09:54.463443 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-da99adce-c6fa-4bb8-b27e-005eda3d8e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:09:54.471307 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 4/7] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:09:54 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 15 12:09:54.737516 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d16e9b-e500-4c27-8a70-dcf14e6b9603 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:09:54.749399 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d16e9b-e500-4c27-8a70-dcf14e6b9603 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:09:54.754275 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6231ff0e-43be-4828-a8ac-2bcf4dd80be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:09:54.754896 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6231ff0e-43be-4828-a8ac-2bcf4dd80be0 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:09:54.755176 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6231ff0e-43be-4828-a8ac-2bcf4dd80be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:09:54.755446 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6231ff0e-43be-4828-a8ac-2bcf4dd80be0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:09:54.763290 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6231ff0e-43be-4828-a8ac-2bcf4dd80be0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:09:54.765036 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6231ff0e-43be-4828-a8ac-2bcf4dd80be0 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:09:54.774122 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 4/8] 10.222.0.16 () {58 vars in 1324 bytes} [Thu Sep 15 12:09:54 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 12:09:54.779328 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da99adce-c6fa-4bb8-b27e-005eda3d8e03 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:09:54.788215 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da99adce-c6fa-4bb8-b27e-005eda3d8e03 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:09:54.792538 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7856b0e8-da8f-486f-b2ab-d4ada16a6047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:09:54.793166 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7856b0e8-da8f-486f-b2ab-d4ada16a6047 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:09:54.793445 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7856b0e8-da8f-486f-b2ab-d4ada16a6047 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:09:54.793714 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7856b0e8-da8f-486f-b2ab-d4ada16a6047 admin admin] PATH_INFO: `/v3/users/0385d82554b5461ca05c9bdb07b4a451` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:09:54.795049 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7856b0e8-da8f-486f-b2ab-d4ada16a6047 admin admin] RBAC: Authorizing `identity:get_user(user_id=0385d82554b5461ca05c9bdb07b4a451)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:09:54.796866 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7856b0e8-da8f-486f-b2ab-d4ada16a6047 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:09:54.798357 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 5/9] 10.222.0.16 () {56 vars in 1198 bytes} [Thu Sep 15 12:09:54 2022] GET /identity/v3/users/0385d82554b5461ca05c9bdb07b4a451 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:09:57.018445 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab3636c-1976-48f9-8874-e5495de0c310 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:09:57.019007 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab3636c-1976-48f9-8874-e5495de0c310 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:09:57.019111 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab3636c-1976-48f9-8874-e5495de0c310 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:09:57.020362 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 5/10] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:09:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:09:57.025640 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede93ce3-bac9-4a46-91fc-9fdb84cfc209 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:09:57.026020 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede93ce3-bac9-4a46-91fc-9fdb84cfc209 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:09:57.026189 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede93ce3-bac9-4a46-91fc-9fdb84cfc209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:09:57.043968 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-ede93ce3-bac9-4a46-91fc-9fdb84cfc209 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:09:57.045147 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-ede93ce3-bac9-4a46-91fc-9fdb84cfc209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:09:57.090628 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b939fa7-1d2b-4f71-b97d-a68b7e1cadbe None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:09:57.091024 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b939fa7-1d2b-4f71-b97d-a68b7e1cadbe None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:09:57.091306 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b939fa7-1d2b-4f71-b97d-a68b7e1cadbe None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:09:57.092648 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 6/11] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:09:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 12:09:57.098373 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369efb6e-d4d5-4e79-beb7-da9758360731 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:09:57.098655 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369efb6e-d4d5-4e79-beb7-da9758360731 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:09:57.098972 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369efb6e-d4d5-4e79-beb7-da9758360731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:09:57.135361 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 6/12] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:09:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 12:09:57.148068 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG passlib.handlers.bcrypt [None req-369efb6e-d4d5-4e79-beb7-da9758360731 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81374) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 15 12:09:57.148456 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG passlib.handlers.bcrypt [None req-369efb6e-d4d5-4e79-beb7-da9758360731 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81374) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 15 12:09:57.197225 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-369efb6e-d4d5-4e79-beb7-da9758360731 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:09:57.198825 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-369efb6e-d4d5-4e79-beb7-da9758360731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:09:57.296671 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 7/13] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:09:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 12:09:57.422628 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede93ce3-bac9-4a46-91fc-9fdb84cfc209 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:09:57.447129 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:09:57.535101 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede93ce3-bac9-4a46-91fc-9fdb84cfc209 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:09:57.568140 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4ba706-0213-481d-b9aa-38dade5af340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:09:57.568722 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ba706-0213-481d-b9aa-38dade5af340 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:09:57.569006 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ba706-0213-481d-b9aa-38dade5af340 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:09:57.569285 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ba706-0213-481d-b9aa-38dade5af340 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:09:57.575370 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369efb6e-d4d5-4e79-beb7-da9758360731 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:09:57.580912 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4ba706-0213-481d-b9aa-38dade5af340 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:09:57.589817 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-ec4ba706-0213-481d-b9aa-38dade5af340 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:09:57.589817 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:09:57.589817 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:09:57.589817 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:09:57.589817 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:09:57.589817 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:09:57.589817 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:09:57.589817 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:09:57.589817 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:09:57.589817 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:09:57.589817 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:09:57.589817 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:09:57.589817 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:09:57.589817 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:09:57.589817 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:09:57.589817 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:09:57.590901 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:09:57.590901 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:09:57.590901 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:09:57.590901 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:09:57.590901 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:09:57.590901 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:09:57.590901 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:09:57.590901 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:09:57.590901 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:09:57.590901 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:09:57.590901 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:09:57.590901 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:09:57.590901 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:09:57.590901 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:09:57.590901 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:09:57.590901 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:09:57.591818 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:09:57.591818 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:09:57.591818 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:09:57.591818 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:09:57.591818 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:09:57.591818 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:09:57.591818 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:09:57.591818 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:09:57.591818 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:09:57.591818 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:09:57.591818 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:09:57.591818 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:09:57.591818 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 7/14] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Sep 15 12:09:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:09:57.599080 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4ba706-0213-481d-b9aa-38dade5af340 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:09:57.678349 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369efb6e-d4d5-4e79-beb7-da9758360731 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:09:57.679495 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:09:57.681005 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:09:57.699121 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4ba706-0213-481d-b9aa-38dade5af340 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:09:57.717858 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9339c9dc-c0e4-4c93-a5d8-df0e8e037522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:09:57.718748 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9339c9dc-c0e4-4c93-a5d8-df0e8e037522 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:09:57.719034 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9339c9dc-c0e4-4c93-a5d8-df0e8e037522 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:09:57.719307 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9339c9dc-c0e4-4c93-a5d8-df0e8e037522 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:09:57.734210 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc80630a-9c96-4473-b4d3-8e1aa5d8847e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:09:57.734844 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc80630a-9c96-4473-b4d3-8e1aa5d8847e None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:09:57.735121 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc80630a-9c96-4473-b4d3-8e1aa5d8847e None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:09:57.735390 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc80630a-9c96-4473-b4d3-8e1aa5d8847e None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:09:57.736091 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc80630a-9c96-4473-b4d3-8e1aa5d8847e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:09:57.736373 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc80630a-9c96-4473-b4d3-8e1aa5d8847e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:09:57.737745 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc80630a-9c96-4473-b4d3-8e1aa5d8847e None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:09:57.749115 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 8/15] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 15 12:09:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:09:57.755450 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc80630a-9c96-4473-b4d3-8e1aa5d8847e None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:09:57.786240 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9339c9dc-c0e4-4c93-a5d8-df0e8e037522 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:09:57.787831 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9339c9dc-c0e4-4c93-a5d8-df0e8e037522 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:09:57.858421 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc80630a-9c96-4473-b4d3-8e1aa5d8847e None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:09:57.891283 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efec668f-baae-407e-923c-64764a59afda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:09:57.891909 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec668f-baae-407e-923c-64764a59afda None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:09:57.892187 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec668f-baae-407e-923c-64764a59afda None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:09:57.893018 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec668f-baae-407e-923c-64764a59afda None admin] PATH_INFO: `/v3/users/0385d82554b5461ca05c9bdb07b4a451` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:09:57.894151 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efec668f-baae-407e-923c-64764a59afda None admin] RBAC: Authorizing `identity:get_user(user_id=0385d82554b5461ca05c9bdb07b4a451)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:09:57.895646 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efec668f-baae-407e-923c-64764a59afda None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:09:57.897197 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 9/16] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 15 12:09:57 2022] GET /identity/v3/users/0385d82554b5461ca05c9bdb07b4a451 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:09:57.900668 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 8/17] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 15 12:09:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 15 12:09:57.902650 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efec668f-baae-407e-923c-64764a59afda None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:09:57.905979 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9339c9dc-c0e4-4c93-a5d8-df0e8e037522 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:09:57.908696 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:09:57.917682 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:09:58.000735 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efec668f-baae-407e-923c-64764a59afda None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:09:58.004535 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9339c9dc-c0e4-4c93-a5d8-df0e8e037522 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:09:58.033699 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda241d2-cec6-4f37-ba9d-d79c75b329dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:09:58.034326 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda241d2-cec6-4f37-ba9d-d79c75b329dc None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:09:58.034599 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda241d2-cec6-4f37-ba9d-d79c75b329dc None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:09:58.034894 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda241d2-cec6-4f37-ba9d-d79c75b329dc None admin] PATH_INFO: `/v3/domains/default` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:09:58.036004 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda241d2-cec6-4f37-ba9d-d79c75b329dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:09:58.037444 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda241d2-cec6-4f37-ba9d-d79c75b329dc None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:09:58.037799 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4b1c04-6249-4dc3-bb37-ff96bf6dad46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:09:58.038655 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b1c04-6249-4dc3-bb37-ff96bf6dad46 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:09:58.038965 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b1c04-6249-4dc3-bb37-ff96bf6dad46 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:09:58.039057 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 10/18] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:09:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:09:58.039242 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b1c04-6249-4dc3-bb37-ff96bf6dad46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:09:58.044640 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda241d2-cec6-4f37-ba9d-d79c75b329dc None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:09:58.058251 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4b1c04-6249-4dc3-bb37-ff96bf6dad46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:09:58.059760 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4b1c04-6249-4dc3-bb37-ff96bf6dad46 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:09:58.079323 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-cb4b1c04-6249-4dc3-bb37-ff96bf6dad46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:09:58.079323 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:09:58.079323 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:09:58.079323 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:09:58.079323 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:09:58.079323 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:09:58.079323 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:09:58.079323 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:09:58.079323 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:09:58.079323 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:09:58.079323 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:09:58.079323 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:09:58.079323 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:09:58.079323 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:09:58.079323 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:09:58.079323 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:09:58.080269 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:09:58.080269 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:09:58.080269 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:09:58.080269 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:09:58.080269 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:09:58.080269 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:09:58.080269 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:09:58.080269 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:09:58.080269 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:09:58.080269 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:09:58.080269 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:09:58.080269 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:09:58.080269 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:09:58.080269 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:09:58.080269 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:09:58.080269 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:09:58.080269 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:09:58.081226 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:09:58.081226 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:09:58.081226 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:09:58.081226 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 9/19] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:09:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:09:58.086239 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4b1c04-6249-4dc3-bb37-ff96bf6dad46 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:09:58.126047 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:09:58.144948 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:09:58.152397 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda241d2-cec6-4f37-ba9d-d79c75b329dc None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:09:58.188168 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cef21ba-9bd5-46fe-81b6-04e3ad4d2a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:09:58.188778 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef21ba-9bd5-46fe-81b6-04e3ad4d2a15 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:09:58.189103 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef21ba-9bd5-46fe-81b6-04e3ad4d2a15 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:09:58.189389 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef21ba-9bd5-46fe-81b6-04e3ad4d2a15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:09:58.190111 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cef21ba-9bd5-46fe-81b6-04e3ad4d2a15 None admin] RBAC: Adding query filter params (role.id=7f53f1c823b746529ba5057bf21b2477, scope.domain.id=default, user.id=0385d82554b5461ca05c9bdb07b4a451) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:09:58.190418 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cef21ba-9bd5-46fe-81b6-04e3ad4d2a15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:09:58.191901 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cef21ba-9bd5-46fe-81b6-04e3ad4d2a15 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:09:58.194995 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4b1c04-6249-4dc3-bb37-ff96bf6dad46 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:09:58.198367 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 11/20] 10.222.0.16 () {56 vars in 1322 bytes} [Thu Sep 15 12:09:58 2022] GET /identity/v3/role_assignments?user.id=0385d82554b5461ca05c9bdb07b4a451&scope.domain.id=default&role.id=7f53f1c823b746529ba5057bf21b2477 => generated 233 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:09:58.230708 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b827e-5a71-4511-b5f5-5989bc6771ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:09:58.231329 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b827e-5a71-4511-b5f5-5989bc6771ff None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:09:58.231605 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b827e-5a71-4511-b5f5-5989bc6771ff None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:09:58.231876 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b827e-5a71-4511-b5f5-5989bc6771ff None admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:09:58.232528 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66b827e-5a71-4511-b5f5-5989bc6771ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:09:58.232826 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66b827e-5a71-4511-b5f5-5989bc6771ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:09:58.234633 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66b827e-5a71-4511-b5f5-5989bc6771ff None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:09:58.253548 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 10/21] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 15 12:09:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:10:00.724662 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b09b81-1cf0-4d26-9b0f-5699c14a045e None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:00.725676 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b09b81-1cf0-4d26-9b0f-5699c14a045e None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:00.726160 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b09b81-1cf0-4d26-9b0f-5699c14a045e None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:00.727763 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 12/22] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:10:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:10:00.743581 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b9d784-9b35-42c1-9735-d63e23473f3d None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:00.744534 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b9d784-9b35-42c1-9735-d63e23473f3d None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:00.745037 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b9d784-9b35-42c1-9735-d63e23473f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:00.771712 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-79b9d784-9b35-42c1-9735-d63e23473f3d None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:10:00.773261 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-79b9d784-9b35-42c1-9735-d63e23473f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:10:00.832411 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd07cf90-29f9-49ff-be27-1cdf4eec44f5 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:00.832700 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd07cf90-29f9-49ff-be27-1cdf4eec44f5 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:00.832945 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd07cf90-29f9-49ff-be27-1cdf4eec44f5 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:00.834478 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 13/23] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:10:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 12:10:00.840922 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b9bab-0239-427a-926a-93053399c61f None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:00.841202 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b9bab-0239-427a-926a-93053399c61f None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:00.841476 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b9bab-0239-427a-926a-93053399c61f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:00.869510 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-f96b9bab-0239-427a-926a-93053399c61f None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:10:00.872343 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-f96b9bab-0239-427a-926a-93053399c61f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:10:00.909163 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 11/24] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:10:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:10:01.010267 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 14/25] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:10:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:10:01.013326 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e3fe3-3c0a-45d8-967e-df79f93b5294 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:01.013842 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e3fe3-3c0a-45d8-967e-df79f93b5294 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:01.014314 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e3fe3-3c0a-45d8-967e-df79f93b5294 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:01.016087 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 12/26] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:10:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:10:01.021543 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a67c5-bbb5-4dd6-ab05-3c51fdb018c1 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:01.021831 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a67c5-bbb5-4dd6-ab05-3c51fdb018c1 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:01.022102 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a67c5-bbb5-4dd6-ab05-3c51fdb018c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:01.045066 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-c31a67c5-bbb5-4dd6-ab05-3c51fdb018c1 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:10:01.046244 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-c31a67c5-bbb5-4dd6-ab05-3c51fdb018c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:10:01.139159 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 15/27] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:10:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:10:01.329963 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78034de9-ac15-49b8-9d0d-626831c11c04 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:01.330605 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78034de9-ac15-49b8-9d0d-626831c11c04 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:01.331118 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78034de9-ac15-49b8-9d0d-626831c11c04 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:01.332668 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 13/28] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:10:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:10:01.337982 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b915b43-f849-4233-a7dd-eef2defefe6b None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:01.338506 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b915b43-f849-4233-a7dd-eef2defefe6b None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:01.339022 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b915b43-f849-4233-a7dd-eef2defefe6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:01.351421 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:01.367666 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-9b915b43-f849-4233-a7dd-eef2defefe6b None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:10:01.368865 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-9b915b43-f849-4233-a7dd-eef2defefe6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:10:01.411092 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78034de9-ac15-49b8-9d0d-626831c11c04 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:01.474368 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 16/29] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:10:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:10:01.475009 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b915b43-f849-4233-a7dd-eef2defefe6b None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:01.507052 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:01.580570 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78034de9-ac15-49b8-9d0d-626831c11c04 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:01.621799 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7776a5-d7c0-456e-b2fc-7b2b21ef78f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:01.622496 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7776a5-d7c0-456e-b2fc-7b2b21ef78f3 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:01.622804 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7776a5-d7c0-456e-b2fc-7b2b21ef78f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:01.623081 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7776a5-d7c0-456e-b2fc-7b2b21ef78f3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:01.647022 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7776a5-d7c0-456e-b2fc-7b2b21ef78f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:10:01.656384 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-0e7776a5-d7c0-456e-b2fc-7b2b21ef78f3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:10:01.656384 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:10:01.656384 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:10:01.656384 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:10:01.656384 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:10:01.656384 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:10:01.656384 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:10:01.656384 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:10:01.656384 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:10:01.656384 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:10:01.656384 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:10:01.656384 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:10:01.656384 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:10:01.656384 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:10:01.656384 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:10:01.656384 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:10:01.657226 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:10:01.657226 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:10:01.657226 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:10:01.657226 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:10:01.657226 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:10:01.657226 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:10:01.657226 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:10:01.657226 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:10:01.657226 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:10:01.657226 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:10:01.657226 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:10:01.657226 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:10:01.657226 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:10:01.657226 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:10:01.657226 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:10:01.657226 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:10:01.658525 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:10:01.658525 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:10:01.658525 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:10:01.658525 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:10:01.658525 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:10:01.658525 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:10:01.658525 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:10:01.658525 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:10:01.658525 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:10:01.658525 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:10:01.658525 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:10:01.658525 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:10:01.658525 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 14/30] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Sep 15 12:10:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:10:01.659192 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7776a5-d7c0-456e-b2fc-7b2b21ef78f3 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:01.688912 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b915b43-f849-4233-a7dd-eef2defefe6b None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:01.756153 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f434f4-1364-4e7d-bae6-8aafe78d9e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:01.758519 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f434f4-1364-4e7d-bae6-8aafe78d9e9e None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:01.760401 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f434f4-1364-4e7d-bae6-8aafe78d9e9e None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:01.760883 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f434f4-1364-4e7d-bae6-8aafe78d9e9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:01.765507 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:01.783450 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f434f4-1364-4e7d-bae6-8aafe78d9e9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:01.785196 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f434f4-1364-4e7d-bae6-8aafe78d9e9e None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:01.810359 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-d7f434f4-1364-4e7d-bae6-8aafe78d9e9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:10:01.810359 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:10:01.810359 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:10:01.810359 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:10:01.810359 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:10:01.810359 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:10:01.810359 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:10:01.810359 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:10:01.810359 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:10:01.810359 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:10:01.810359 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:10:01.810359 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:10:01.810359 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:10:01.810359 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:10:01.810359 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:10:01.810359 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:10:01.811266 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:10:01.811266 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:10:01.811266 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:10:01.811266 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:10:01.811266 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:10:01.811266 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:10:01.811266 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:10:01.811266 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:10:01.811266 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:10:01.811266 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:10:01.811266 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:10:01.811266 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:10:01.811266 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:10:01.811266 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:10:01.811266 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:10:01.811266 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:10:01.811266 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:10:01.812057 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:10:01.812057 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:10:01.812057 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:10:01.814182 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 17/31] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:10:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:10:01.815225 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f434f4-1364-4e7d-bae6-8aafe78d9e9e None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:01.831907 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7776a5-d7c0-456e-b2fc-7b2b21ef78f3 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:01.840111 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:01.870525 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4425af89-7570-430a-9899-be2e35f8fe18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:01.871416 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425af89-7570-430a-9899-be2e35f8fe18 None admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:01.871900 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425af89-7570-430a-9899-be2e35f8fe18 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:01.872363 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425af89-7570-430a-9899-be2e35f8fe18 None admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:01.873168 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4425af89-7570-430a-9899-be2e35f8fe18 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:01.874920 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4425af89-7570-430a-9899-be2e35f8fe18 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:01.931070 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f434f4-1364-4e7d-bae6-8aafe78d9e9e None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:01.967429 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43b491a-ea03-4ddf-a61f-1431245424bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:01.968296 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43b491a-ea03-4ddf-a61f-1431245424bb None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:01.968734 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43b491a-ea03-4ddf-a61f-1431245424bb None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:01.969151 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43b491a-ea03-4ddf-a61f-1431245424bb None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:01.970061 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43b491a-ea03-4ddf-a61f-1431245424bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:10:01.971141 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43b491a-ea03-4ddf-a61f-1431245424bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:01.973253 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43b491a-ea03-4ddf-a61f-1431245424bb None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:01.986264 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 18/32] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 15 12:10:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:01.987097 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43b491a-ea03-4ddf-a61f-1431245424bb None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:02.022760 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 15/33] 10.222.0.16 () {60 vars in 1131 bytes} [Thu Sep 15 12:10:01 2022] POST /identity/v3/roles => generated 219 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:10:02.024156 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4425af89-7570-430a-9899-be2e35f8fe18 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:02.044304 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:02.138889 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43b491a-ea03-4ddf-a61f-1431245424bb None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:02.218801 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e977338f-0ad5-4f56-99ba-89dfbce7ac03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:02.219869 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e977338f-0ad5-4f56-99ba-89dfbce7ac03 None admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:02.220409 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e977338f-0ad5-4f56-99ba-89dfbce7ac03 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:02.220992 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e977338f-0ad5-4f56-99ba-89dfbce7ac03 None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:02.221888 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e977338f-0ad5-4f56-99ba-89dfbce7ac03 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:02.223514 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e977338f-0ad5-4f56-99ba-89dfbce7ac03 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:02.227749 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4425af89-7570-430a-9899-be2e35f8fe18 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:02.267192 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d90960-8545-4ff3-afdc-864367c5509b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:02.268317 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d90960-8545-4ff3-afdc-864367c5509b None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:02.268603 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d90960-8545-4ff3-afdc-864367c5509b None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:02.268876 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d90960-8545-4ff3-afdc-864367c5509b None admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:02.269534 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d90960-8545-4ff3-afdc-864367c5509b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:10:02.269840 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d90960-8545-4ff3-afdc-864367c5509b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:02.271434 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d90960-8545-4ff3-afdc-864367c5509b None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:02.283675 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 16/34] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 15 12:10:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:02.284509 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d90960-8545-4ff3-afdc-864367c5509b None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:02.318647 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:02.379205 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 19/35] 10.222.0.16 () {60 vars in 1131 bytes} [Thu Sep 15 12:10:01 2022] POST /identity/v3/roles => generated 225 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:10:02.380101 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e977338f-0ad5-4f56-99ba-89dfbce7ac03 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:02.414548 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d90960-8545-4ff3-afdc-864367c5509b None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:02.478610 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08270fd2-7775-4e51-8455-ae64d35eb871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:02.479315 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08270fd2-7775-4e51-8455-ae64d35eb871 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:02.482050 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08270fd2-7775-4e51-8455-ae64d35eb871 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:02.482460 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08270fd2-7775-4e51-8455-ae64d35eb871 None admin] PATH_INFO: `/v3/users/0385d82554b5461ca05c9bdb07b4a451` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:02.484679 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08270fd2-7775-4e51-8455-ae64d35eb871 None admin] RBAC: Authorizing `identity:get_user(user_id=0385d82554b5461ca05c9bdb07b4a451)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:02.486823 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08270fd2-7775-4e51-8455-ae64d35eb871 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:02.489093 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 17/36] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 15 12:10:02 2022] GET /identity/v3/users/0385d82554b5461ca05c9bdb07b4a451 => generated 247 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:02.490542 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1df6c1-cb1d-42f5-9b7f-250ffa2f2691 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:02.495168 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1df6c1-cb1d-42f5-9b7f-250ffa2f2691 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:02.495502 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1df6c1-cb1d-42f5-9b7f-250ffa2f2691 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:02.497114 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 18/37] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:10:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:10:02.498717 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1df6c1-cb1d-42f5-9b7f-250ffa2f2691 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:02.537029 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e977338f-0ad5-4f56-99ba-89dfbce7ac03 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:02.548453 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:02.585114 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a3d661-1f4b-4e69-8fbe-fb9d7ade785f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:02.586028 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a3d661-1f4b-4e69-8fbe-fb9d7ade785f None admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:02.586346 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a3d661-1f4b-4e69-8fbe-fb9d7ade785f None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:02.586626 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a3d661-1f4b-4e69-8fbe-fb9d7ade785f None admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:02.587340 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a3d661-1f4b-4e69-8fbe-fb9d7ade785f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:02.589105 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a3d661-1f4b-4e69-8fbe-fb9d7ade785f None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:02.613604 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:02.624202 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1df6c1-cb1d-42f5-9b7f-250ffa2f2691 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:02.634721 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 20/38] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Sep 15 12:10:02 2022] POST /identity/v3/projects => generated 301 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:10:02.634721 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb5ece2-9f44-47b9-8f54-18f0a2621aad None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:02.634721 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb5ece2-9f44-47b9-8f54-18f0a2621aad None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:02.634721 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb5ece2-9f44-47b9-8f54-18f0a2621aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:02.697975 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf21d49-30cf-479c-8443-00a4d7050d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:02.699087 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf21d49-30cf-479c-8443-00a4d7050d80 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:02.699515 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf21d49-30cf-479c-8443-00a4d7050d80 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:02.699954 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf21d49-30cf-479c-8443-00a4d7050d80 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:02.702449 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf21d49-30cf-479c-8443-00a4d7050d80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:02.704313 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf21d49-30cf-479c-8443-00a4d7050d80 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:02.706911 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 19/39] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:10:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:02.719868 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf21d49-30cf-479c-8443-00a4d7050d80 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:02.767958 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-fcb5ece2-9f44-47b9-8f54-18f0a2621aad None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:10:02.769637 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-fcb5ece2-9f44-47b9-8f54-18f0a2621aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:10:02.849863 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf21d49-30cf-479c-8443-00a4d7050d80 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:02.850463 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 21/40] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:10:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:10:02.851784 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4407511e-e0bf-42ff-afc7-a422826effc7 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:02.852078 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4407511e-e0bf-42ff-afc7-a422826effc7 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:02.852390 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4407511e-e0bf-42ff-afc7-a422826effc7 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:02.853730 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 22/41] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:10:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:10:02.858826 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d4ccc6-a960-4fe3-bd4d-612c3b16bbfc None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:02.859114 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d4ccc6-a960-4fe3-bd4d-612c3b16bbfc None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:02.859389 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d4ccc6-a960-4fe3-bd4d-612c3b16bbfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:02.879655 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-57d4ccc6-a960-4fe3-bd4d-612c3b16bbfc None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:10:02.880839 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-57d4ccc6-a960-4fe3-bd4d-612c3b16bbfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:10:02.891393 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f5d483-b9c6-4e9f-ae80-6d5bc306497b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:02.892058 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f5d483-b9c6-4e9f-ae80-6d5bc306497b None admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:02.892857 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f5d483-b9c6-4e9f-ae80-6d5bc306497b None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:02.893129 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f5d483-b9c6-4e9f-ae80-6d5bc306497b None admin] PATH_INFO: `/v3/domains/default/users/0385d82554b5461ca05c9bdb07b4a451/roles/7f53f1c823b746529ba5057bf21b2477` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:02.895246 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f5d483-b9c6-4e9f-ae80-6d5bc306497b None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=0385d82554b5461ca05c9bdb07b4a451, role_id=7f53f1c823b746529ba5057bf21b2477)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:02.896830 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f5d483-b9c6-4e9f-ae80-6d5bc306497b None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:02.918018 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 20/42] 10.222.0.16 () {58 vars in 1361 bytes} [Thu Sep 15 12:10:02 2022] PUT /identity/v3/domains/default/users/0385d82554b5461ca05c9bdb07b4a451/roles/7f53f1c823b746529ba5057bf21b2477 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:10:02.961893 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 23/43] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:10:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 12:10:03.128934 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f5d483-b9c6-4e9f-ae80-6d5bc306497b None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:03.159903 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:03.234339 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d4ccc6-a960-4fe3-bd4d-612c3b16bbfc None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:03.243701 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f5d483-b9c6-4e9f-ae80-6d5bc306497b None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:03.256546 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:03.283508 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd474d82-5d56-4a34-815f-3a34217da13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:03.284125 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd474d82-5d56-4a34-815f-3a34217da13b None admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:03.284407 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd474d82-5d56-4a34-815f-3a34217da13b None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:03.284678 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd474d82-5d56-4a34-815f-3a34217da13b None admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:03.285357 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd474d82-5d56-4a34-815f-3a34217da13b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:03.286756 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd474d82-5d56-4a34-815f-3a34217da13b None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:03.305077 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 21/44] 10.222.0.16 () {60 vars in 1131 bytes} [Thu Sep 15 12:10:03 2022] POST /identity/v3/roles => generated 223 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:10:03.346124 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d4ccc6-a960-4fe3-bd4d-612c3b16bbfc None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:03.384734 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e76df44-7155-495b-aa2c-e6b62ce45fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:03.385394 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e76df44-7155-495b-aa2c-e6b62ce45fd6 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:03.385674 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e76df44-7155-495b-aa2c-e6b62ce45fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:03.385946 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e76df44-7155-495b-aa2c-e6b62ce45fd6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:03.387144 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e76df44-7155-495b-aa2c-e6b62ce45fd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:03.388645 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e76df44-7155-495b-aa2c-e6b62ce45fd6 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:03.390329 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 24/45] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:10:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:10:03.396453 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd474d82-5d56-4a34-815f-3a34217da13b None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:03.492044 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:03.512908 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd474d82-5d56-4a34-815f-3a34217da13b None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:03.546373 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2d1470-9a18-4215-bd08-d16f12e30f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:03.547043 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2d1470-9a18-4215-bd08-d16f12e30f16 None admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:03.547331 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2d1470-9a18-4215-bd08-d16f12e30f16 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:03.547611 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2d1470-9a18-4215-bd08-d16f12e30f16 None admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:03.548264 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2d1470-9a18-4215-bd08-d16f12e30f16 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:03.550227 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2d1470-9a18-4215-bd08-d16f12e30f16 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:03.578713 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 22/46] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Sep 15 12:10:03 2022] POST /identity/v3/projects => generated 312 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:10:05.078814 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e578aa5-5a71-4a82-ad89-bfbbd9846071 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:05.079338 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e578aa5-5a71-4a82-ad89-bfbbd9846071 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:05.079338 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e578aa5-5a71-4a82-ad89-bfbbd9846071 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:05.080711 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 25/47] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:10:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:10:05.085837 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7e2639-c9cb-4256-9421-77f594309d15 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:05.086222 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7e2639-c9cb-4256-9421-77f594309d15 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:05.086390 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7e2639-c9cb-4256-9421-77f594309d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:05.104239 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-0d7e2639-c9cb-4256-9421-77f594309d15 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:10:05.105735 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-0d7e2639-c9cb-4256-9421-77f594309d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:10:05.171514 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 23/48] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:10:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:10:05.435251 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e578aa5-5a71-4a82-ad89-bfbbd9846071 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:05.528482 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:05.542061 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e578aa5-5a71-4a82-ad89-bfbbd9846071 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:05.576083 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3c3a63-71a0-4522-9a4e-bed9a70df826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:05.576715 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3c3a63-71a0-4522-9a4e-bed9a70df826 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:05.576996 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3c3a63-71a0-4522-9a4e-bed9a70df826 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:05.577272 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3c3a63-71a0-4522-9a4e-bed9a70df826 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:05.589384 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3c3a63-71a0-4522-9a4e-bed9a70df826 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:10:05.594620 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-8c3c3a63-71a0-4522-9a4e-bed9a70df826 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:10:05.594620 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:10:05.594620 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:10:05.594620 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:10:05.594620 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:10:05.594620 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:10:05.594620 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:10:05.594620 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:10:05.594620 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:10:05.594620 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:10:05.594620 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:10:05.594620 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:10:05.594620 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:10:05.594620 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:10:05.594620 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:10:05.594620 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:10:05.596249 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:10:05.596249 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:10:05.596249 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:10:05.596249 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:10:05.596249 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:10:05.596249 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:10:05.596249 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:10:05.596249 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:10:05.596249 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:10:05.596249 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:10:05.596249 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:10:05.596249 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:10:05.596249 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:10:05.596249 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:10:05.596249 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:10:05.596249 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:10:05.597064 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:10:05.597064 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:10:05.597064 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:10:05.597064 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:10:05.597064 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:10:05.597064 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:10:05.597064 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:10:05.597064 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:10:05.597064 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:10:05.597064 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:10:05.597064 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:10:05.597064 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:10:05.597064 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 26/49] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Sep 15 12:10:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:10:05.604118 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7e2639-c9cb-4256-9421-77f594309d15 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:05.668822 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:05.709135 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7e2639-c9cb-4256-9421-77f594309d15 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:05.736276 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae7b66-1ae9-40c0-bba4-d47d2c12a20a None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:05.736561 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae7b66-1ae9-40c0-bba4-d47d2c12a20a None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:05.736843 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae7b66-1ae9-40c0-bba4-d47d2c12a20a None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:05.738181 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 27/50] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:10:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 12:10:05.742516 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd4c62c-6864-4cf6-9270-d56f091fb3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:05.743105 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed78a2f-d150-424d-9275-2cd059198163 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:05.743208 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd4c62c-6864-4cf6-9270-d56f091fb3d4 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:05.743392 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed78a2f-d150-424d-9275-2cd059198163 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:05.743504 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd4c62c-6864-4cf6-9270-d56f091fb3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:05.743669 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed78a2f-d150-424d-9275-2cd059198163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:05.743761 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd4c62c-6864-4cf6-9270-d56f091fb3d4 None admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:05.744338 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd4c62c-6864-4cf6-9270-d56f091fb3d4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:10:05.744646 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd4c62c-6864-4cf6-9270-d56f091fb3d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:05.746026 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd4c62c-6864-4cf6-9270-d56f091fb3d4 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:05.758401 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 24/51] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 15 12:10:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:05.761355 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-3ed78a2f-d150-424d-9275-2cd059198163 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:10:05.762553 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-3ed78a2f-d150-424d-9275-2cd059198163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:10:05.763980 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd4c62c-6864-4cf6-9270-d56f091fb3d4 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:05.830109 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 28/52] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:10:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 12:10:05.860966 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd4c62c-6864-4cf6-9270-d56f091fb3d4 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:05.886836 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:05.896136 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0325998d-f56b-4a06-ba48-f98cb928da75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:05.896770 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0325998d-f56b-4a06-ba48-f98cb928da75 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:05.897051 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0325998d-f56b-4a06-ba48-f98cb928da75 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:05.897323 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0325998d-f56b-4a06-ba48-f98cb928da75 None admin] PATH_INFO: `/v3/users/0385d82554b5461ca05c9bdb07b4a451` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:05.898459 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0325998d-f56b-4a06-ba48-f98cb928da75 None admin] RBAC: Authorizing `identity:get_user(user_id=0385d82554b5461ca05c9bdb07b4a451)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:05.899956 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0325998d-f56b-4a06-ba48-f98cb928da75 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:05.901579 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 25/53] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 15 12:10:05 2022] GET /identity/v3/users/0385d82554b5461ca05c9bdb07b4a451 => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:10:05.907060 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed78a2f-d150-424d-9275-2cd059198163 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:05.984308 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:06.006143 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed78a2f-d150-424d-9275-2cd059198163 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:06.038316 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f8a1ca-bfc4-4791-b40c-fb73c61a9b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:06.038980 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f8a1ca-bfc4-4791-b40c-fb73c61a9b9a None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:06.039257 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f8a1ca-bfc4-4791-b40c-fb73c61a9b9a None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:06.039527 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f8a1ca-bfc4-4791-b40c-fb73c61a9b9a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:06.040615 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f8a1ca-bfc4-4791-b40c-fb73c61a9b9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:06.042051 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f8a1ca-bfc4-4791-b40c-fb73c61a9b9a None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:06.043622 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 29/54] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:10:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:06.049327 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0325998d-f56b-4a06-ba48-f98cb928da75 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:06.107499 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f8a1ca-bfc4-4791-b40c-fb73c61a9b9a None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:06.149318 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0325998d-f56b-4a06-ba48-f98cb928da75 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:06.214147 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f8a1ca-bfc4-4791-b40c-fb73c61a9b9a None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:06.248758 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32dad3f-09da-4c18-abd0-9b927502a8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:06.249306 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32dad3f-09da-4c18-abd0-9b927502a8f3 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:06.249581 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32dad3f-09da-4c18-abd0-9b927502a8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:06.249847 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32dad3f-09da-4c18-abd0-9b927502a8f3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:06.251248 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32dad3f-09da-4c18-abd0-9b927502a8f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:06.253219 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32dad3f-09da-4c18-abd0-9b927502a8f3 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:06.255011 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 30/55] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:10:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:10:06.260306 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32dad3f-09da-4c18-abd0-9b927502a8f3 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:06.276568 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:06.288223 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ba0e58-ae59-4e83-af5e-ff98005437d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:06.288834 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba0e58-ae59-4e83-af5e-ff98005437d4 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:06.289116 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba0e58-ae59-4e83-af5e-ff98005437d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:06.289393 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba0e58-ae59-4e83-af5e-ff98005437d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:06.290401 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ba0e58-ae59-4e83-af5e-ff98005437d4 None admin] RBAC: Adding query filter params (role.id=7f53f1c823b746529ba5057bf21b2477, scope.domain.id=default, user.id=0385d82554b5461ca05c9bdb07b4a451) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:10:06.290737 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ba0e58-ae59-4e83-af5e-ff98005437d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:06.292211 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ba0e58-ae59-4e83-af5e-ff98005437d4 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:06.300531 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 26/56] 10.222.0.16 () {56 vars in 1322 bytes} [Thu Sep 15 12:10:06 2022] GET /identity/v3/role_assignments?user.id=0385d82554b5461ca05c9bdb07b4a451&scope.domain.id=default&role.id=7f53f1c823b746529ba5057bf21b2477 => generated 530 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:06.364347 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32dad3f-09da-4c18-abd0-9b927502a8f3 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:06.399792 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0e9424-412d-41ea-b623-349a0fa9407a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:06.400412 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0e9424-412d-41ea-b623-349a0fa9407a None admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:06.400689 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0e9424-412d-41ea-b623-349a0fa9407a None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:06.400959 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0e9424-412d-41ea-b623-349a0fa9407a None admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:06.401615 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0e9424-412d-41ea-b623-349a0fa9407a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:06.403147 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0e9424-412d-41ea-b623-349a0fa9407a None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:06.432573 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 31/57] 10.222.0.16 () {60 vars in 1140 bytes} [Thu Sep 15 12:10:06 2022] POST /identity/v3/projects => generated 298 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 12:10:08.568494 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd796d7-4458-4a12-8be2-1a619b5085b2 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:08.569008 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd796d7-4458-4a12-8be2-1a619b5085b2 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:08.569008 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd796d7-4458-4a12-8be2-1a619b5085b2 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:08.570353 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 27/58] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:10:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:10:08.575552 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c007466-2824-45fe-9d58-4fe8fcd671cd None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:08.575922 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c007466-2824-45fe-9d58-4fe8fcd671cd None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:08.576114 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c007466-2824-45fe-9d58-4fe8fcd671cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:08.594367 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-0c007466-2824-45fe-9d58-4fe8fcd671cd None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:10:08.596223 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-0c007466-2824-45fe-9d58-4fe8fcd671cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:10:08.653296 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:08.661630 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 32/59] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:10:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:10:08.931131 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd796d7-4458-4a12-8be2-1a619b5085b2 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:08.990470 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:09.031980 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd796d7-4458-4a12-8be2-1a619b5085b2 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:09.063265 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d6fe39-916a-4bd0-ada6-a39c2cd22a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:09.064386 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d6fe39-916a-4bd0-ada6-a39c2cd22a34 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:09.064663 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d6fe39-916a-4bd0-ada6-a39c2cd22a34 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:09.064930 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d6fe39-916a-4bd0-ada6-a39c2cd22a34 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:09.066002 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d6fe39-916a-4bd0-ada6-a39c2cd22a34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:09.067443 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d6fe39-916a-4bd0-ada6-a39c2cd22a34 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:09.068977 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 28/60] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:10:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:09.074445 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c007466-2824-45fe-9d58-4fe8fcd671cd None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:09.168751 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c007466-2824-45fe-9d58-4fe8fcd671cd None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:09.200894 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fdd472-aeec-4fa1-8ba8-9753a461db67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:09.201479 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fdd472-aeec-4fa1-8ba8-9753a461db67 None admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:09.201755 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fdd472-aeec-4fa1-8ba8-9753a461db67 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:09.202024 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fdd472-aeec-4fa1-8ba8-9753a461db67 None admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:09.202671 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fdd472-aeec-4fa1-8ba8-9753a461db67 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:09.204137 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fdd472-aeec-4fa1-8ba8-9753a461db67 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:09.230126 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 33/61] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Sep 15 12:10:09 2022] POST /identity/v3/users => generated 275 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 12:10:12.462184 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48275190-b62b-48c4-a019-61b632daa6a9 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:12.463217 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48275190-b62b-48c4-a019-61b632daa6a9 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:12.463702 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48275190-b62b-48c4-a019-61b632daa6a9 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:12.465270 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 29/62] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:10:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:10:12.471101 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad1d1b-0367-41fd-94ad-85401989cbc6 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:12.472085 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad1d1b-0367-41fd-94ad-85401989cbc6 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:12.472561 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad1d1b-0367-41fd-94ad-85401989cbc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:12.492665 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-e1ad1d1b-0367-41fd-94ad-85401989cbc6 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:10:12.494228 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-e1ad1d1b-0367-41fd-94ad-85401989cbc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:10:12.561575 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:12.587993 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 34/63] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:10:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:10:12.710827 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be12bd-efb0-4364-a520-6c4d5ff6d05b None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:12.711141 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be12bd-efb0-4364-a520-6c4d5ff6d05b None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:12.711392 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be12bd-efb0-4364-a520-6c4d5ff6d05b None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:12.712923 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 30/64] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:10:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:10:12.724750 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85be366-5225-4c9e-bc26-f9ed27dfcb67 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:12.725046 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85be366-5225-4c9e-bc26-f9ed27dfcb67 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:12.725329 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85be366-5225-4c9e-bc26-f9ed27dfcb67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:12.751726 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-a85be366-5225-4c9e-bc26-f9ed27dfcb67 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:10:12.753258 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-a85be366-5225-4c9e-bc26-f9ed27dfcb67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:10:12.803728 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1c5b7-8bb7-494c-9b17-3e0bc98f78fa None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:12.804357 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1c5b7-8bb7-494c-9b17-3e0bc98f78fa None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:12.804833 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1c5b7-8bb7-494c-9b17-3e0bc98f78fa None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:12.806818 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 31/65] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:10:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 12:10:12.813003 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c364e-bb2c-4a15-a118-929958008676 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:12.813542 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c364e-bb2c-4a15-a118-929958008676 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:12.814057 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c364e-bb2c-4a15-a118-929958008676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:12.833961 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-387c364e-bb2c-4a15-a118-929958008676 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:10:12.835514 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-387c364e-bb2c-4a15-a118-929958008676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:10:12.853304 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 35/66] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:10:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:10:12.908457 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 32/67] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:10:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 12:10:12.994595 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85be366-5225-4c9e-bc26-f9ed27dfcb67 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:13.040648 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d32339-4c10-4fb5-b53c-ec2dfeacab65 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:13.041286 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d32339-4c10-4fb5-b53c-ec2dfeacab65 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:13.041763 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d32339-4c10-4fb5-b53c-ec2dfeacab65 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:13.043623 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 33/68] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:10:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:10:13.051825 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b98a1-0023-4f67-b205-f92fb6068164 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:13.052299 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b98a1-0023-4f67-b205-f92fb6068164 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:13.052758 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b98a1-0023-4f67-b205-f92fb6068164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:13.091845 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-ee3b98a1-0023-4f67-b205-f92fb6068164 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:10:13.093078 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-ee3b98a1-0023-4f67-b205-f92fb6068164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:10:13.181695 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85be366-5225-4c9e-bc26-f9ed27dfcb67 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:13.208874 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:13.216015 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:13.236099 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd906230-863f-4e55-852a-1a236fe42479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:13.236660 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd906230-863f-4e55-852a-1a236fe42479 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:13.236948 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd906230-863f-4e55-852a-1a236fe42479 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:13.237221 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd906230-863f-4e55-852a-1a236fe42479 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:13.239227 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 34/69] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:10:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:10:13.245671 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3b98a1-0023-4f67-b205-f92fb6068164 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:13.247977 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd906230-863f-4e55-852a-1a236fe42479 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:10:13.253631 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-fd906230-863f-4e55-852a-1a236fe42479 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 12:10:13.253631 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:10:13.253631 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:10:13.253631 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:10:13.253631 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:10:13.253631 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:10:13.253631 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:10:13.253631 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:10:13.253631 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:10:13.253631 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:10:13.253631 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:10:13.253631 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:10:13.253631 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:10:13.253631 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:10:13.253631 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:10:13.253631 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:10:13.254655 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:10:13.254655 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:10:13.254655 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:10:13.254655 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:10:13.254655 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:10:13.254655 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:10:13.254655 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:10:13.254655 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:10:13.254655 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:10:13.254655 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:10:13.254655 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:10:13.254655 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:10:13.254655 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:10:13.254655 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:10:13.254655 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:10:13.254655 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:10:13.255586 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:10:13.255586 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:10:13.255586 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:10:13.255586 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:10:13.255586 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:10:13.255586 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:10:13.255586 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:10:13.255586 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:10:13.255586 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:10:13.255586 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:10:13.255586 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 12:10:13.255586 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:10:13.257395 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 36/70] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 15 12:10:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:10:13.269117 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd906230-863f-4e55-852a-1a236fe42479 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:13.366277 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3b98a1-0023-4f67-b205-f92fb6068164 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:13.372490 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd906230-863f-4e55-852a-1a236fe42479 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:13.410317 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0e89e8-02a5-4d13-bfe2-efd9ced181bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:13.410962 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0e89e8-02a5-4d13-bfe2-efd9ced181bb None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:13.411246 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0e89e8-02a5-4d13-bfe2-efd9ced181bb None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:13.411522 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0e89e8-02a5-4d13-bfe2-efd9ced181bb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:13.413165 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d8de6d-f23a-45cd-a2c6-b836a4a92647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:13.413788 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d8de6d-f23a-45cd-a2c6-b836a4a92647 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:13.414078 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d8de6d-f23a-45cd-a2c6-b836a4a92647 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:13.414574 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d8de6d-f23a-45cd-a2c6-b836a4a92647 None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:13.415857 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d8de6d-f23a-45cd-a2c6-b836a4a92647 None admin] RBAC: Adding query filter params (name=member) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:10:13.416183 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d8de6d-f23a-45cd-a2c6-b836a4a92647 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:13.417598 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d8de6d-f23a-45cd-a2c6-b836a4a92647 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:13.424074 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0e89e8-02a5-4d13-bfe2-efd9ced181bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:10:13.427480 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 37/71] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Sep 15 12:10:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:13.428123 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d8de6d-f23a-45cd-a2c6-b836a4a92647 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:13.429034 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-fd0e89e8-02a5-4d13-bfe2-efd9ced181bb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:10:13.429034 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:10:13.429034 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:10:13.429034 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:10:13.429034 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:10:13.429034 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:10:13.429034 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:10:13.429034 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:10:13.429034 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:10:13.429034 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:10:13.429034 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:10:13.429034 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:10:13.429034 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:10:13.429034 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:10:13.429034 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:10:13.429034 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:10:13.429843 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:10:13.429843 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:10:13.429843 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:10:13.429843 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:10:13.429843 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:10:13.429843 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:10:13.429843 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:10:13.429843 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:10:13.429843 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:10:13.429843 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:10:13.429843 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:10:13.429843 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:10:13.429843 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:10:13.429843 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:10:13.429843 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:10:13.429843 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:10:13.435553 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:10:13.435553 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:10:13.435553 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:10:13.435553 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:10:13.435553 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:10:13.435553 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:10:13.435553 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:10:13.435553 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:10:13.435553 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:10:13.435553 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:10:13.435553 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:10:13.435553 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:10:13.435553 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 35/72] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Sep 15 12:10:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:10:13.435553 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab9f1f-ba70-4e7d-8960-11e0cf927517 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:13.436232 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab9f1f-ba70-4e7d-8960-11e0cf927517 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:13.436232 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab9f1f-ba70-4e7d-8960-11e0cf927517 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:13.436232 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 36/73] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:10:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:10:13.436232 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dab9f1f-ba70-4e7d-8960-11e0cf927517 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:13.470814 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:13.485089 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:13.541368 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dab9f1f-ba70-4e7d-8960-11e0cf927517 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:13.541688 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d8de6d-f23a-45cd-a2c6-b836a4a92647 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:13.576708 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45050aba-ed7e-4733-968e-a69efea7afe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:13.577344 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45050aba-ed7e-4733-968e-a69efea7afe4 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:13.577628 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45050aba-ed7e-4733-968e-a69efea7afe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:13.577789 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a297d5ad-a976-4c5d-b993-fe4b51d32351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:13.577938 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45050aba-ed7e-4733-968e-a69efea7afe4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:13.578411 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a297d5ad-a976-4c5d-b993-fe4b51d32351 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:13.578702 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a297d5ad-a976-4c5d-b993-fe4b51d32351 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:13.578984 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a297d5ad-a976-4c5d-b993-fe4b51d32351 None admin] PATH_INFO: `/v3/users/b0dd68fd960b44079ef49a5f9f3b0675` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:13.588454 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45050aba-ed7e-4733-968e-a69efea7afe4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:10:13.593342 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-45050aba-ed7e-4733-968e-a69efea7afe4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 12:10:13.593342 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:10:13.593342 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:10:13.593342 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:10:13.593342 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:10:13.593342 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:10:13.593342 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:10:13.593342 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:10:13.593342 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:10:13.593342 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:10:13.593342 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:10:13.593342 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:10:13.593342 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:10:13.593342 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:10:13.593342 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:10:13.593342 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:10:13.594156 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:10:13.594156 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:10:13.594156 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:10:13.594156 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:10:13.594156 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:10:13.594156 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:10:13.594156 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:10:13.594156 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:10:13.594156 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:10:13.594156 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:10:13.594156 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:10:13.594156 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:10:13.594156 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:10:13.594156 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:10:13.594156 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:10:13.594156 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:10:13.594959 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:10:13.594959 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:10:13.594959 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:10:13.594959 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:10:13.594959 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:10:13.594959 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:10:13.594959 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:10:13.594959 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:10:13.594959 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:10:13.594959 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:10:13.594959 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 12:10:13.594959 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:10:13.595540 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a297d5ad-a976-4c5d-b993-fe4b51d32351 None admin] RBAC: Authorizing `identity:get_user(user_id=b0dd68fd960b44079ef49a5f9f3b0675)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:13.595615 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 38/74] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Sep 15 12:10:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:10:13.595615 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45050aba-ed7e-4733-968e-a69efea7afe4 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:13.595729 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a297d5ad-a976-4c5d-b993-fe4b51d32351 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:13.601965 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 37/75] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 15 12:10:13 2022] GET /identity/v3/users/b0dd68fd960b44079ef49a5f9f3b0675 => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:13.601965 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2c8f5-cf00-4738-9e5c-289591083469 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:13.601965 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2c8f5-cf00-4738-9e5c-289591083469 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:13.601965 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2c8f5-cf00-4738-9e5c-289591083469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:13.616546 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-58d2c8f5-cf00-4738-9e5c-289591083469 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:10:13.617741 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-58d2c8f5-cf00-4738-9e5c-289591083469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:10:13.682786 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 38/76] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:10:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:10:13.683724 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d2c8f5-cf00-4738-9e5c-289591083469 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:13.700446 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:13.708953 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45050aba-ed7e-4733-968e-a69efea7afe4 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:13.719693 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:13.755580 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7325f4-b5d1-4d24-aea5-3afc602ed665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:13.756198 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7325f4-b5d1-4d24-aea5-3afc602ed665 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:13.756787 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7325f4-b5d1-4d24-aea5-3afc602ed665 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:13.757071 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7325f4-b5d1-4d24-aea5-3afc602ed665 None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:13.757797 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7325f4-b5d1-4d24-aea5-3afc602ed665 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:10:13.758040 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7325f4-b5d1-4d24-aea5-3afc602ed665 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:13.759447 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7325f4-b5d1-4d24-aea5-3afc602ed665 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:13.768465 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 39/77] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 15 12:10:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:13.769094 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7325f4-b5d1-4d24-aea5-3afc602ed665 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:13.810180 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d2c8f5-cf00-4738-9e5c-289591083469 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:13.846133 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc73f03-2200-4f74-ba9c-49eae1ec0616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:13.846812 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc73f03-2200-4f74-ba9c-49eae1ec0616 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:13.847094 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc73f03-2200-4f74-ba9c-49eae1ec0616 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:13.847365 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc73f03-2200-4f74-ba9c-49eae1ec0616 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:13.848596 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc73f03-2200-4f74-ba9c-49eae1ec0616 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:13.850663 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc73f03-2200-4f74-ba9c-49eae1ec0616 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:13.852396 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 39/78] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:10:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:13.853061 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc73f03-2200-4f74-ba9c-49eae1ec0616 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:13.872765 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7325f4-b5d1-4d24-aea5-3afc602ed665 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:13.909294 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37204d18-cdf6-4964-b53a-bfbc5b552db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:13.909905 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37204d18-cdf6-4964-b53a-bfbc5b552db1 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:13.910187 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37204d18-cdf6-4964-b53a-bfbc5b552db1 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:13.910456 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37204d18-cdf6-4964-b53a-bfbc5b552db1 None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:13.911151 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37204d18-cdf6-4964-b53a-bfbc5b552db1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:10:13.911455 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37204d18-cdf6-4964-b53a-bfbc5b552db1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:13.912847 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37204d18-cdf6-4964-b53a-bfbc5b552db1 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:13.920822 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 40/79] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 15 12:10:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:13.924117 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37204d18-cdf6-4964-b53a-bfbc5b552db1 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:13.943171 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:13.962356 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc73f03-2200-4f74-ba9c-49eae1ec0616 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:13.963894 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:13.999230 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc51b192-0c35-405c-8335-3f0b1dae012a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:13.999835 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc51b192-0c35-405c-8335-3f0b1dae012a None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:14.000112 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc51b192-0c35-405c-8335-3f0b1dae012a None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:14.000629 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc51b192-0c35-405c-8335-3f0b1dae012a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:14.024205 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37204d18-cdf6-4964-b53a-bfbc5b552db1 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:14.059560 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e1d9af-c1b9-4ac0-a0b4-38052e6e3da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:14.060254 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e1d9af-c1b9-4ac0-a0b4-38052e6e3da1 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:14.060483 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e1d9af-c1b9-4ac0-a0b4-38052e6e3da1 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:14.060751 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e1d9af-c1b9-4ac0-a0b4-38052e6e3da1 None admin] PATH_INFO: `/v3/users/0385d82554b5461ca05c9bdb07b4a451` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:14.061886 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e1d9af-c1b9-4ac0-a0b4-38052e6e3da1 None admin] RBAC: Authorizing `identity:get_user(user_id=0385d82554b5461ca05c9bdb07b4a451)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:14.063379 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e1d9af-c1b9-4ac0-a0b4-38052e6e3da1 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:14.065518 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 41/80] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 15 12:10:13 2022] GET /identity/v3/users/0385d82554b5461ca05c9bdb07b4a451 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:14.066263 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e1d9af-c1b9-4ac0-a0b4-38052e6e3da1 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:14.078138 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc51b192-0c35-405c-8335-3f0b1dae012a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:14.079652 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc51b192-0c35-405c-8335-3f0b1dae012a None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:14.150162 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:14.165609 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e1d9af-c1b9-4ac0-a0b4-38052e6e3da1 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:14.177934 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 40/81] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 15 12:10:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 12:10:14.179106 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc51b192-0c35-405c-8335-3f0b1dae012a None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:14.181285 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:14.205567 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74a4d24-0f88-4e4d-aa05-f48f2efc3b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:14.206166 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a4d24-0f88-4e4d-aa05-f48f2efc3b37 None admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:14.206454 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a4d24-0f88-4e4d-aa05-f48f2efc3b37 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:14.206751 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a4d24-0f88-4e4d-aa05-f48f2efc3b37 None admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:14.207407 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74a4d24-0f88-4e4d-aa05-f48f2efc3b37 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:14.208868 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74a4d24-0f88-4e4d-aa05-f48f2efc3b37 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:14.229564 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 42/82] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Sep 15 12:10:14 2022] POST /identity/v3/users => generated 289 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:10:14.230361 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74a4d24-0f88-4e4d-aa05-f48f2efc3b37 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:14.288511 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc51b192-0c35-405c-8335-3f0b1dae012a None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:14.332571 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9ea847-fba3-47a8-8d89-7d06bdf88628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:14.332985 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ea847-fba3-47a8-8d89-7d06bdf88628 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:14.333270 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ea847-fba3-47a8-8d89-7d06bdf88628 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:14.333546 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ea847-fba3-47a8-8d89-7d06bdf88628 None admin] PATH_INFO: `/v3/users/b0dd68fd960b44079ef49a5f9f3b0675` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:14.335000 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9ea847-fba3-47a8-8d89-7d06bdf88628 None admin] RBAC: Authorizing `identity:get_user(user_id=b0dd68fd960b44079ef49a5f9f3b0675)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:14.336485 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9ea847-fba3-47a8-8d89-7d06bdf88628 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:14.338547 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 41/83] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 15 12:10:14 2022] GET /identity/v3/users/b0dd68fd960b44079ef49a5f9f3b0675 => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:14.339202 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9ea847-fba3-47a8-8d89-7d06bdf88628 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:14.356492 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74a4d24-0f88-4e4d-aa05-f48f2efc3b37 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:14.401390 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0faf81e-215d-477d-8fba-2e64440c5a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:14.402042 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0faf81e-215d-477d-8fba-2e64440c5a21 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:14.402321 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0faf81e-215d-477d-8fba-2e64440c5a21 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:14.402594 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0faf81e-215d-477d-8fba-2e64440c5a21 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:14.415211 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0faf81e-215d-477d-8fba-2e64440c5a21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:10:14.420487 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-a0faf81e-215d-477d-8fba-2e64440c5a21 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 12:10:14.420487 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:10:14.420487 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:10:14.420487 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:10:14.420487 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:10:14.420487 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:10:14.420487 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:10:14.420487 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:10:14.420487 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:10:14.420487 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:10:14.420487 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:10:14.420487 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:10:14.420487 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:10:14.420487 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:10:14.420487 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:10:14.420487 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:10:14.421498 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:10:14.421498 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:10:14.421498 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:10:14.421498 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:10:14.421498 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:10:14.421498 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:10:14.421498 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:10:14.421498 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:10:14.421498 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:10:14.421498 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:10:14.421498 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:10:14.421498 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:10:14.421498 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:10:14.421498 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:10:14.421498 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:10:14.421498 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:10:14.422284 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:10:14.422284 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:10:14.422284 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:10:14.422284 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:10:14.422284 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:10:14.422284 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:10:14.422284 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:10:14.422284 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:10:14.422284 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:10:14.422284 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:10:14.422284 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 12:10:14.422284 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:10:14.422284 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 43/84] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 15 12:10:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:10:14.423148 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0faf81e-215d-477d-8fba-2e64440c5a21 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:14.430194 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:14.437467 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:14.472775 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9ea847-fba3-47a8-8d89-7d06bdf88628 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:14.521671 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f898d3-e69d-4a7e-86bd-0be8837eb7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:14.523308 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f898d3-e69d-4a7e-86bd-0be8837eb7e6 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:14.523777 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f898d3-e69d-4a7e-86bd-0be8837eb7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:14.524063 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f898d3-e69d-4a7e-86bd-0be8837eb7e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:14.547523 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0faf81e-215d-477d-8fba-2e64440c5a21 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:14.592526 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8580d309-9020-4e47-81b2-cc0e056f1069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:14.592719 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8580d309-9020-4e47-81b2-cc0e056f1069 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:14.592935 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8580d309-9020-4e47-81b2-cc0e056f1069 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:14.593168 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8580d309-9020-4e47-81b2-cc0e056f1069 None admin] PATH_INFO: `/v3/projects/23903d1c5f234a8ba964a00b23864453` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:14.595880 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8580d309-9020-4e47-81b2-cc0e056f1069 None admin] RBAC: Authorizing `identity:get_project(project_id=23903d1c5f234a8ba964a00b23864453)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:14.597347 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8580d309-9020-4e47-81b2-cc0e056f1069 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:14.599180 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 44/85] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 15 12:10:14 2022] GET /identity/v3/projects/23903d1c5f234a8ba964a00b23864453 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:14.599780 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8580d309-9020-4e47-81b2-cc0e056f1069 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:14.612102 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f898d3-e69d-4a7e-86bd-0be8837eb7e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:14.614280 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f898d3-e69d-4a7e-86bd-0be8837eb7e6 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:14.685981 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:14.705276 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:14.728888 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8580d309-9020-4e47-81b2-cc0e056f1069 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:14.744999 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 42/86] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 15 12:10:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 12:10:14.745932 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f898d3-e69d-4a7e-86bd-0be8837eb7e6 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:14.768943 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cabe31-5d92-4c32-8ee7-c998e7469767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:14.769958 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cabe31-5d92-4c32-8ee7-c998e7469767 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:14.770460 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cabe31-5d92-4c32-8ee7-c998e7469767 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:14.771067 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cabe31-5d92-4c32-8ee7-c998e7469767 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:14.854490 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cabe31-5d92-4c32-8ee7-c998e7469767 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:14.855935 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cabe31-5d92-4c32-8ee7-c998e7469767 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:14.857021 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f898d3-e69d-4a7e-86bd-0be8837eb7e6 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:14.894361 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e85aa-59bc-45b4-8274-c9721051ef03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:14.895337 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e85aa-59bc-45b4-8274-c9721051ef03 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:14.895811 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e85aa-59bc-45b4-8274-c9721051ef03 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:14.896274 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e85aa-59bc-45b4-8274-c9721051ef03 None admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:14.897150 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127e85aa-59bc-45b4-8274-c9721051ef03 None admin] RBAC: Adding query filter params (name=member) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:10:14.897717 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127e85aa-59bc-45b4-8274-c9721051ef03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:14.899337 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127e85aa-59bc-45b4-8274-c9721051ef03 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:14.908239 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 43/87] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Sep 15 12:10:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:14.909310 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e85aa-59bc-45b4-8274-c9721051ef03 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:14.929027 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:14.944437 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:14.966487 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 45/88] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 15 12:10:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 12:10:14.969567 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cabe31-5d92-4c32-8ee7-c998e7469767 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:15.037594 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e85aa-59bc-45b4-8274-c9721051ef03 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:15.075070 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cabe31-5d92-4c32-8ee7-c998e7469767 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:15.080230 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b37cc7-5bea-442e-afe1-5600d4c57a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:15.080951 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b37cc7-5bea-442e-afe1-5600d4c57a57 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:15.081375 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b37cc7-5bea-442e-afe1-5600d4c57a57 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:15.081751 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b37cc7-5bea-442e-afe1-5600d4c57a57 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:15.082582 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b37cc7-5bea-442e-afe1-5600d4c57a57 None admin] RBAC: Adding query filter params (role.id=9371e5bbc55848949eb951a815f817f2, scope.project.id=23903d1c5f234a8ba964a00b23864453, user.id=b0dd68fd960b44079ef49a5f9f3b0675) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:10:15.083020 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b37cc7-5bea-442e-afe1-5600d4c57a57 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:15.084540 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b37cc7-5bea-442e-afe1-5600d4c57a57 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:15.102868 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 44/89] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 15 12:10:14 2022] GET /identity/v3/role_assignments?user.id=b0dd68fd960b44079ef49a5f9f3b0675&scope.project.id=23903d1c5f234a8ba964a00b23864453&role.id=9371e5bbc55848949eb951a815f817f2 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:15.102868 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b37cc7-5bea-442e-afe1-5600d4c57a57 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:15.167561 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7a0516-0eb0-4bf8-862c-2f550fb4a20b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:15.168209 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a0516-0eb0-4bf8-862c-2f550fb4a20b None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:15.168494 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a0516-0eb0-4bf8-862c-2f550fb4a20b None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:15.168766 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a0516-0eb0-4bf8-862c-2f550fb4a20b None admin] PATH_INFO: `/v3/projects/23903d1c5f234a8ba964a00b23864453` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:15.169981 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7a0516-0eb0-4bf8-862c-2f550fb4a20b None admin] RBAC: Authorizing `identity:get_project(project_id=23903d1c5f234a8ba964a00b23864453)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:15.171474 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7a0516-0eb0-4bf8-862c-2f550fb4a20b None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:15.173676 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 46/90] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 15 12:10:14 2022] GET /identity/v3/projects/23903d1c5f234a8ba964a00b23864453 => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:15.179205 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7a0516-0eb0-4bf8-862c-2f550fb4a20b None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:15.219501 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:15.228022 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b37cc7-5bea-442e-afe1-5600d4c57a57 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:15.268496 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:15.272466 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9605507-c77c-4c2e-ac21-d53eb7b8acc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:15.273476 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9605507-c77c-4c2e-ac21-d53eb7b8acc7 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:15.274001 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9605507-c77c-4c2e-ac21-d53eb7b8acc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:15.274467 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9605507-c77c-4c2e-ac21-d53eb7b8acc7 None admin] PATH_INFO: `/v3/users/b0dd68fd960b44079ef49a5f9f3b0675` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:15.275957 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9605507-c77c-4c2e-ac21-d53eb7b8acc7 None admin] RBAC: Authorizing `identity:get_user(user_id=b0dd68fd960b44079ef49a5f9f3b0675)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:15.278818 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9605507-c77c-4c2e-ac21-d53eb7b8acc7 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:15.280769 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 45/91] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 15 12:10:15 2022] GET /identity/v3/users/b0dd68fd960b44079ef49a5f9f3b0675 => generated 275 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:15.281752 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9605507-c77c-4c2e-ac21-d53eb7b8acc7 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:15.412239 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9605507-c77c-4c2e-ac21-d53eb7b8acc7 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:15.416449 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7a0516-0eb0-4bf8-862c-2f550fb4a20b None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:15.456791 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5237fc5f-0962-409f-95b3-0d7c9bd2278f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:15.457680 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5237fc5f-0962-409f-95b3-0d7c9bd2278f None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:15.458462 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5237fc5f-0962-409f-95b3-0d7c9bd2278f None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:15.458936 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5237fc5f-0962-409f-95b3-0d7c9bd2278f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:15.459977 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5237fc5f-0962-409f-95b3-0d7c9bd2278f None admin] RBAC: Adding query filter params (role.id=7f53f1c823b746529ba5057bf21b2477, scope.project.id=23903d1c5f234a8ba964a00b23864453, user.id=0385d82554b5461ca05c9bdb07b4a451) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:10:15.460617 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5237fc5f-0962-409f-95b3-0d7c9bd2278f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:15.463183 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5237fc5f-0962-409f-95b3-0d7c9bd2278f None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:15.469866 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 46/92] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 15 12:10:15 2022] GET /identity/v3/role_assignments?user.id=0385d82554b5461ca05c9bdb07b4a451&scope.project.id=23903d1c5f234a8ba964a00b23864453&role.id=7f53f1c823b746529ba5057bf21b2477 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:15.471148 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5237fc5f-0962-409f-95b3-0d7c9bd2278f None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:15.471660 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81da0cc8-bc9f-4163-9cb4-a9498fd8a237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:15.472439 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da0cc8-bc9f-4163-9cb4-a9498fd8a237 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:15.472813 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da0cc8-bc9f-4163-9cb4-a9498fd8a237 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:15.473160 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da0cc8-bc9f-4163-9cb4-a9498fd8a237 None admin] PATH_INFO: `/v3/projects/23903d1c5f234a8ba964a00b23864453` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:15.477705 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81da0cc8-bc9f-4163-9cb4-a9498fd8a237 None admin] RBAC: Authorizing `identity:get_project(project_id=23903d1c5f234a8ba964a00b23864453)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:15.479408 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81da0cc8-bc9f-4163-9cb4-a9498fd8a237 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:15.481465 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 47/93] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 15 12:10:15 2022] GET /identity/v3/projects/23903d1c5f234a8ba964a00b23864453 => generated 298 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:15.495805 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81da0cc8-bc9f-4163-9cb4-a9498fd8a237 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:15.520661 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:15.653211 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5237fc5f-0962-409f-95b3-0d7c9bd2278f None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:15.727588 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbf0636-26a5-497f-8965-51c12202453a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:15.728124 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf0636-26a5-497f-8965-51c12202453a None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:15.728405 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf0636-26a5-497f-8965-51c12202453a None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:15.728677 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf0636-26a5-497f-8965-51c12202453a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:15.766246 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81da0cc8-bc9f-4163-9cb4-a9498fd8a237 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:15.777764 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:15.830982 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37287b07-58a9-4591-a45e-adf24a739365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:15.831597 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37287b07-58a9-4591-a45e-adf24a739365 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:15.831876 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37287b07-58a9-4591-a45e-adf24a739365 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:15.832147 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37287b07-58a9-4591-a45e-adf24a739365 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:15.832876 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37287b07-58a9-4591-a45e-adf24a739365 None admin] RBAC: Adding query filter params (role.id=19ee0f56c10b47628ba0b1c3deee4448, scope.project.id=23903d1c5f234a8ba964a00b23864453, user.id=b0dd68fd960b44079ef49a5f9f3b0675) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:10:15.833182 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37287b07-58a9-4591-a45e-adf24a739365 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:15.834631 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37287b07-58a9-4591-a45e-adf24a739365 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:15.847589 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 48/94] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 15 12:10:15 2022] GET /identity/v3/role_assignments?user.id=b0dd68fd960b44079ef49a5f9f3b0675&scope.project.id=23903d1c5f234a8ba964a00b23864453&role.id=19ee0f56c10b47628ba0b1c3deee4448 => generated 259 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:15.853717 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbf0636-26a5-497f-8965-51c12202453a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:15.855250 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbf0636-26a5-497f-8965-51c12202453a None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:15.896413 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:16.011869 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 47/95] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 15 12:10:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 12:10:16.018103 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37287b07-58a9-4591-a45e-adf24a739365 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:16.153388 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37287b07-58a9-4591-a45e-adf24a739365 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:16.204521 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b52447-2e4b-4c4e-8220-2fc4565d5130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:16.205534 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b52447-2e4b-4c4e-8220-2fc4565d5130 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:16.206007 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b52447-2e4b-4c4e-8220-2fc4565d5130 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:16.206470 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b52447-2e4b-4c4e-8220-2fc4565d5130 None admin] PATH_INFO: `/v3/projects/78241f1452694570bd17703ff5866deb` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:16.207825 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b52447-2e4b-4c4e-8220-2fc4565d5130 None admin] RBAC: Authorizing `identity:get_project(project_id=78241f1452694570bd17703ff5866deb)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:16.209473 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b52447-2e4b-4c4e-8220-2fc4565d5130 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:16.211712 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 49/96] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 15 12:10:16 2022] GET /identity/v3/projects/78241f1452694570bd17703ff5866deb => generated 312 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:16.217185 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbf0636-26a5-497f-8965-51c12202453a None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:16.371117 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbf0636-26a5-497f-8965-51c12202453a None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:16.400205 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:16.408242 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749d5904-97f4-4f56-8630-07cea20b2665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:16.409277 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d5904-97f4-4f56-8630-07cea20b2665 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:16.409946 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d5904-97f4-4f56-8630-07cea20b2665 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:16.410219 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d5904-97f4-4f56-8630-07cea20b2665 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:16.410976 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749d5904-97f4-4f56-8630-07cea20b2665 None admin] RBAC: Adding query filter params (role.id=9371e5bbc55848949eb951a815f817f2, scope.project.id=78241f1452694570bd17703ff5866deb, user.id=b0dd68fd960b44079ef49a5f9f3b0675) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:10:16.411282 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749d5904-97f4-4f56-8630-07cea20b2665 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:16.412714 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749d5904-97f4-4f56-8630-07cea20b2665 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:16.418063 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 48/97] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 15 12:10:16 2022] GET /identity/v3/role_assignments?user.id=b0dd68fd960b44079ef49a5f9f3b0675&scope.project.id=78241f1452694570bd17703ff5866deb&role.id=9371e5bbc55848949eb951a815f817f2 => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:17.115310 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5694c4-e998-425a-b383-68ae2b6d57fe None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:17.115842 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5694c4-e998-425a-b383-68ae2b6d57fe None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:17.115842 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5694c4-e998-425a-b383-68ae2b6d57fe None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:17.117200 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 50/98] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:10:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:10:17.123076 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3c483-a99a-4c90-acda-c87fcd065096 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:17.123563 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3c483-a99a-4c90-acda-c87fcd065096 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:17.123634 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3c483-a99a-4c90-acda-c87fcd065096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:17.144171 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-5de3c483-a99a-4c90-acda-c87fcd065096 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:10:17.145392 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-5de3c483-a99a-4c90-acda-c87fcd065096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:10:17.232227 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 49/99] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:10:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:10:17.333433 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b57d7a7-c2c2-4a76-b269-6604b47a965a None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:17.334043 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b57d7a7-c2c2-4a76-b269-6604b47a965a None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:17.334511 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b57d7a7-c2c2-4a76-b269-6604b47a965a None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:17.336150 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 51/100] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:10:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:10:17.341485 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea0198-40d5-4b58-82e6-203f27ccd217 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:17.341770 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea0198-40d5-4b58-82e6-203f27ccd217 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:17.342043 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea0198-40d5-4b58-82e6-203f27ccd217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:17.364479 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-c1ea0198-40d5-4b58-82e6-203f27ccd217 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:10:17.365671 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-c1ea0198-40d5-4b58-82e6-203f27ccd217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:10:17.446336 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 50/101] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:10:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:10:17.647196 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b57d7a7-c2c2-4a76-b269-6604b47a965a None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:17.693825 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:17.773311 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b57d7a7-c2c2-4a76-b269-6604b47a965a None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:17.815154 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ced7ffb-1fc7-4419-a069-e76e902c18b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:17.815783 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced7ffb-1fc7-4419-a069-e76e902c18b4 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:17.816061 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced7ffb-1fc7-4419-a069-e76e902c18b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:17.816331 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced7ffb-1fc7-4419-a069-e76e902c18b4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:17.823758 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ea0198-40d5-4b58-82e6-203f27ccd217 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:17.828298 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ced7ffb-1fc7-4419-a069-e76e902c18b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:10:17.834221 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-6ced7ffb-1fc7-4419-a069-e76e902c18b4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 12:10:17.834221 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:10:17.834221 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:10:17.834221 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:10:17.834221 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:10:17.834221 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:10:17.834221 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:10:17.834221 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:10:17.834221 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:10:17.834221 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:10:17.834221 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:10:17.834221 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:10:17.834221 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:10:17.834221 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:10:17.834221 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:10:17.834221 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:10:17.835085 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:10:17.835085 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:10:17.835085 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:10:17.835085 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:10:17.835085 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:10:17.835085 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:10:17.835085 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:10:17.835085 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:10:17.835085 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:10:17.835085 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:10:17.835085 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:10:17.835085 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:10:17.835085 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:10:17.835085 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:10:17.835085 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:10:17.835085 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:10:17.835836 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:10:17.835836 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:10:17.835836 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:10:17.835836 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:10:17.835836 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:10:17.835836 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:10:17.835836 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:10:17.835836 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:10:17.835836 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:10:17.835836 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:10:17.835836 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 12:10:17.835836 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:10:17.836397 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 52/102] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 15 12:10:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:10:17.843011 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ced7ffb-1fc7-4419-a069-e76e902c18b4 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:17.945520 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:18.000048 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:18.005417 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ced7ffb-1fc7-4419-a069-e76e902c18b4 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:18.038259 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ea0198-40d5-4b58-82e6-203f27ccd217 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:18.075910 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff17d92c-a7e7-4511-9be3-efe97f95e3d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:18.076573 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17d92c-a7e7-4511-9be3-efe97f95e3d1 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:18.076854 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17d92c-a7e7-4511-9be3-efe97f95e3d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:18.077125 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17d92c-a7e7-4511-9be3-efe97f95e3d1 None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:18.077794 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff17d92c-a7e7-4511-9be3-efe97f95e3d1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:10:18.078094 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff17d92c-a7e7-4511-9be3-efe97f95e3d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:18.079560 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff17d92c-a7e7-4511-9be3-efe97f95e3d1 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:18.098521 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 53/103] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Sep 15 12:10:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:18.102410 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac39612-286a-4345-9212-ed6fe9944df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:18.103083 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac39612-286a-4345-9212-ed6fe9944df4 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:18.103362 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac39612-286a-4345-9212-ed6fe9944df4 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:18.104517 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff17d92c-a7e7-4511-9be3-efe97f95e3d1 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:18.107480 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac39612-286a-4345-9212-ed6fe9944df4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:18.109428 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac39612-286a-4345-9212-ed6fe9944df4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:18.116226 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac39612-286a-4345-9212-ed6fe9944df4 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:18.120228 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 51/104] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:10:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:10:18.126621 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac39612-286a-4345-9212-ed6fe9944df4 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:18.233299 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff17d92c-a7e7-4511-9be3-efe97f95e3d1 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:18.240163 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac39612-286a-4345-9212-ed6fe9944df4 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:18.260830 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:18.272481 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53533a54-c327-4b8c-a142-1ecbf617fe32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:18.273352 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53533a54-c327-4b8c-a142-1ecbf617fe32 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:18.273635 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53533a54-c327-4b8c-a142-1ecbf617fe32 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:18.273956 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53533a54-c327-4b8c-a142-1ecbf617fe32 None admin] PATH_INFO: `/v3/users/f42e14b9dced4ff6a25a81848413c849` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:18.275856 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac08a056-76ab-416b-9520-32478db02434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:18.276465 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac08a056-76ab-416b-9520-32478db02434 None admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:18.276742 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac08a056-76ab-416b-9520-32478db02434 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:18.277014 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac08a056-76ab-416b-9520-32478db02434 None admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:18.277668 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac08a056-76ab-416b-9520-32478db02434 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:18.279137 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac08a056-76ab-416b-9520-32478db02434 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:18.288770 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53533a54-c327-4b8c-a142-1ecbf617fe32 None admin] RBAC: Authorizing `identity:get_user(user_id=f42e14b9dced4ff6a25a81848413c849)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:18.290733 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53533a54-c327-4b8c-a142-1ecbf617fe32 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:18.292405 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 54/105] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 15 12:10:18 2022] GET /identity/v3/users/f42e14b9dced4ff6a25a81848413c849 => generated 289 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:18.293574 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9973249f-596c-4a05-a84b-e54f751d9a86 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:18.293856 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9973249f-596c-4a05-a84b-e54f751d9a86 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:18.294129 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9973249f-596c-4a05-a84b-e54f751d9a86 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:18.295561 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 55/106] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:10:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:10:18.298801 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9973249f-596c-4a05-a84b-e54f751d9a86 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:18.310554 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 52/107] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Sep 15 12:10:18 2022] POST /identity/v3/projects => generated 302 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 12:10:18.311921 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1797c2-02a1-46b9-862d-36021739979c None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:18.312210 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1797c2-02a1-46b9-862d-36021739979c None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:18.312483 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1797c2-02a1-46b9-862d-36021739979c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:18.327763 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:18.332674 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-bc1797c2-02a1-46b9-862d-36021739979c None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:10:18.334253 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-bc1797c2-02a1-46b9-862d-36021739979c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:10:18.411610 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 53/108] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:10:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:10:18.441312 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9973249f-596c-4a05-a84b-e54f751d9a86 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:18.479213 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222f0d4d-5fb3-46dc-8df5-54aa387f79b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:18.479842 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f0d4d-5fb3-46dc-8df5-54aa387f79b5 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:18.480122 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f0d4d-5fb3-46dc-8df5-54aa387f79b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:18.480392 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f0d4d-5fb3-46dc-8df5-54aa387f79b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:18.555209 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222f0d4d-5fb3-46dc-8df5-54aa387f79b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:18.556825 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222f0d4d-5fb3-46dc-8df5-54aa387f79b5 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:18.576780 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:18.667319 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 56/109] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 15 12:10:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 12:10:18.672796 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1797c2-02a1-46b9-862d-36021739979c None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:18.782716 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1797c2-02a1-46b9-862d-36021739979c None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:18.783796 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:18.826801 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de9cd73-b972-43c7-9fb5-87e25b06b3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:18.826801 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de9cd73-b972-43c7-9fb5-87e25b06b3bb None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:18.826801 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de9cd73-b972-43c7-9fb5-87e25b06b3bb None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:18.826801 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de9cd73-b972-43c7-9fb5-87e25b06b3bb None admin] PATH_INFO: `/v3/projects/23903d1c5f234a8ba964a00b23864453` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:18.827398 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de9cd73-b972-43c7-9fb5-87e25b06b3bb None admin] RBAC: Authorizing `identity:get_project(project_id=23903d1c5f234a8ba964a00b23864453)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:18.829015 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de9cd73-b972-43c7-9fb5-87e25b06b3bb None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:18.838722 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 54/110] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 15 12:10:18 2022] GET /identity/v3/projects/23903d1c5f234a8ba964a00b23864453 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:18.838903 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222f0d4d-5fb3-46dc-8df5-54aa387f79b5 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:18.849512 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de9cd73-b972-43c7-9fb5-87e25b06b3bb None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:19.025037 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de9cd73-b972-43c7-9fb5-87e25b06b3bb None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:19.067452 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3749e948-64fc-48d4-9435-c4686d40163a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:19.068440 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3749e948-64fc-48d4-9435-c4686d40163a None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:19.068913 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3749e948-64fc-48d4-9435-c4686d40163a None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:19.069397 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3749e948-64fc-48d4-9435-c4686d40163a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:19.081177 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3749e948-64fc-48d4-9435-c4686d40163a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:10:19.086972 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-3749e948-64fc-48d4-9435-c4686d40163a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 12:10:19.086972 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:10:19.086972 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:10:19.086972 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:10:19.086972 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:10:19.086972 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:10:19.086972 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:10:19.086972 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:10:19.086972 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:10:19.086972 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:10:19.086972 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:10:19.086972 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:10:19.086972 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:10:19.086972 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:10:19.086972 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:10:19.086972 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:10:19.087802 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:10:19.087802 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:10:19.087802 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:10:19.087802 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:10:19.087802 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:10:19.087802 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:10:19.087802 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:10:19.087802 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:10:19.087802 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:10:19.087802 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:10:19.087802 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:10:19.087802 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:10:19.087802 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:10:19.087802 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:10:19.087802 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:10:19.087802 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:10:19.088545 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:10:19.088545 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:10:19.088545 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:10:19.088545 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:10:19.088545 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:10:19.088545 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:10:19.088545 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:10:19.088545 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:10:19.088545 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:10:19.088545 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:10:19.088545 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 12:10:19.088545 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:10:19.090957 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 55/111] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 15 12:10:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:10:19.093054 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617dfe3-2029-4715-a01c-8b24cb73f97a None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:19.093581 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617dfe3-2029-4715-a01c-8b24cb73f97a None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:19.094045 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617dfe3-2029-4715-a01c-8b24cb73f97a None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:19.095544 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 56/112] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:10:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:10:19.097999 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f617dfe3-2029-4715-a01c-8b24cb73f97a None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:19.136133 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:19.152672 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222f0d4d-5fb3-46dc-8df5-54aa387f79b5 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:19.226742 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:19.253525 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f617dfe3-2029-4715-a01c-8b24cb73f97a None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:19.276293 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b0af23-72d5-4036-89a6-2aff701a3e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:19.278779 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b0af23-72d5-4036-89a6-2aff701a3e77 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:19.278779 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b0af23-72d5-4036-89a6-2aff701a3e77 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:19.278779 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b0af23-72d5-4036-89a6-2aff701a3e77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:19.278779 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b0af23-72d5-4036-89a6-2aff701a3e77 None admin] RBAC: Adding query filter params (role.id=da591cd17baa4d009b74f6facf2a6688, scope.project.id=23903d1c5f234a8ba964a00b23864453, user.id=f42e14b9dced4ff6a25a81848413c849) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:10:19.278779 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b0af23-72d5-4036-89a6-2aff701a3e77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:19.284953 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b0af23-72d5-4036-89a6-2aff701a3e77 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:19.308864 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 57/113] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 15 12:10:18 2022] GET /identity/v3/role_assignments?user.id=f42e14b9dced4ff6a25a81848413c849&scope.project.id=23903d1c5f234a8ba964a00b23864453&role.id=da591cd17baa4d009b74f6facf2a6688 => generated 259 bytes in 471 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:19.309175 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fc6db2-d1f7-4208-a63a-69e8a2ca696a None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:19.310728 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fc6db2-d1f7-4208-a63a-69e8a2ca696a None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:19.310728 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fc6db2-d1f7-4208-a63a-69e8a2ca696a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:19.354604 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14792ed5-7671-42aa-b561-cfe80acd4579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:19.357816 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14792ed5-7671-42aa-b561-cfe80acd4579 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:19.358241 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14792ed5-7671-42aa-b561-cfe80acd4579 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:19.358649 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14792ed5-7671-42aa-b561-cfe80acd4579 None admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:19.359508 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14792ed5-7671-42aa-b561-cfe80acd4579 None admin] RBAC: Adding query filter params (name=member) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:10:19.361551 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14792ed5-7671-42aa-b561-cfe80acd4579 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:19.363147 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14792ed5-7671-42aa-b561-cfe80acd4579 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:19.364617 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-06fc6db2-d1f7-4208-a63a-69e8a2ca696a None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:10:19.368244 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-06fc6db2-d1f7-4208-a63a-69e8a2ca696a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:10:19.390166 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 57/114] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Sep 15 12:10:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:19.395812 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14792ed5-7671-42aa-b561-cfe80acd4579 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:19.496054 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 58/115] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:10:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:10:19.550859 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902f7761-f42c-4240-8e9b-cc8d0d51072e None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:19.552028 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902f7761-f42c-4240-8e9b-cc8d0d51072e None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:19.552560 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902f7761-f42c-4240-8e9b-cc8d0d51072e None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:19.554461 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 59/116] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:10:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:10:19.560186 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a5a0a7-f4a3-4b20-8f63-1367394fd11a None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:19.560746 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a5a0a7-f4a3-4b20-8f63-1367394fd11a None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:19.561624 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a5a0a7-f4a3-4b20-8f63-1367394fd11a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:19.591224 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-f0a5a0a7-f4a3-4b20-8f63-1367394fd11a None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:10:19.593356 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-f0a5a0a7-f4a3-4b20-8f63-1367394fd11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:10:19.600300 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:19.620726 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14792ed5-7671-42aa-b561-cfe80acd4579 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:19.677729 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 60/117] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:10:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 12:10:19.691308 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31dd943-8175-4244-ae14-d5f7e4b15258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:19.692400 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31dd943-8175-4244-ae14-d5f7e4b15258 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:19.692854 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31dd943-8175-4244-ae14-d5f7e4b15258 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:19.693318 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31dd943-8175-4244-ae14-d5f7e4b15258 None admin] PATH_INFO: `/v3/users/b0dd68fd960b44079ef49a5f9f3b0675` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:19.694656 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31dd943-8175-4244-ae14-d5f7e4b15258 None admin] RBAC: Authorizing `identity:get_user(user_id=b0dd68fd960b44079ef49a5f9f3b0675)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:19.696408 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31dd943-8175-4244-ae14-d5f7e4b15258 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:19.698551 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 58/118] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 15 12:10:19 2022] GET /identity/v3/users/b0dd68fd960b44079ef49a5f9f3b0675 => generated 275 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:19.707846 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a5a0a7-f4a3-4b20-8f63-1367394fd11a None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:19.754144 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:19.833126 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a5a0a7-f4a3-4b20-8f63-1367394fd11a None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:19.874338 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3354414a-182f-4d55-b554-ad647cd7a9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:19.875737 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354414a-182f-4d55-b554-ad647cd7a9c2 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:19.876763 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354414a-182f-4d55-b554-ad647cd7a9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:19.877233 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354414a-182f-4d55-b554-ad647cd7a9c2 None admin] PATH_INFO: `/v3/projects/23903d1c5f234a8ba964a00b23864453` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:19.878645 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3354414a-182f-4d55-b554-ad647cd7a9c2 None admin] RBAC: Authorizing `identity:get_project(project_id=23903d1c5f234a8ba964a00b23864453)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:19.880402 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3354414a-182f-4d55-b554-ad647cd7a9c2 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:19.882439 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 61/119] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 15 12:10:19 2022] GET /identity/v3/projects/23903d1c5f234a8ba964a00b23864453 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:19.888345 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31dd943-8175-4244-ae14-d5f7e4b15258 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:19.949257 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3354414a-182f-4d55-b554-ad647cd7a9c2 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:20.028919 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31dd943-8175-4244-ae14-d5f7e4b15258 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:20.072348 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e8609e-02aa-4754-ae8b-84d5c58bd43b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:20.073456 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e8609e-02aa-4754-ae8b-84d5c58bd43b None admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:20.073892 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e8609e-02aa-4754-ae8b-84d5c58bd43b None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:20.074302 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e8609e-02aa-4754-ae8b-84d5c58bd43b None admin] PATH_INFO: `/v3/projects/23903d1c5f234a8ba964a00b23864453/users/b0dd68fd960b44079ef49a5f9f3b0675/roles/9371e5bbc55848949eb951a815f817f2` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:20.077250 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e8609e-02aa-4754-ae8b-84d5c58bd43b None admin] RBAC: Authorizing `identity:create_grant(project_id=23903d1c5f234a8ba964a00b23864453, user_id=b0dd68fd960b44079ef49a5f9f3b0675, role_id=9371e5bbc55848949eb951a815f817f2)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:20.080225 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e8609e-02aa-4754-ae8b-84d5c58bd43b None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:20.106444 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 59/120] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Sep 15 12:10:19 2022] PUT /identity/v3/projects/23903d1c5f234a8ba964a00b23864453/users/b0dd68fd960b44079ef49a5f9f3b0675/roles/9371e5bbc55848949eb951a815f817f2 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:10:20.108415 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e8609e-02aa-4754-ae8b-84d5c58bd43b None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:20.122332 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3354414a-182f-4d55-b554-ad647cd7a9c2 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:20.135527 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:20.149898 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:20.189447 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af47da4b-de28-42ac-89cf-7aae507982eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:20.190319 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af47da4b-de28-42ac-89cf-7aae507982eb None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:20.190815 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af47da4b-de28-42ac-89cf-7aae507982eb None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:20.191192 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af47da4b-de28-42ac-89cf-7aae507982eb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:20.217792 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af47da4b-de28-42ac-89cf-7aae507982eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:10:20.224355 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-af47da4b-de28-42ac-89cf-7aae507982eb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:10:20.224355 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:10:20.224355 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:10:20.224355 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:10:20.224355 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:10:20.224355 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:10:20.224355 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:10:20.224355 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:10:20.224355 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:10:20.224355 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:10:20.224355 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:10:20.224355 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:10:20.224355 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:10:20.224355 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:10:20.224355 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:10:20.224355 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:10:20.225371 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:10:20.225371 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:10:20.225371 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:10:20.225371 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:10:20.225371 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:10:20.225371 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:10:20.225371 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:10:20.225371 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:10:20.225371 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:10:20.225371 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:10:20.225371 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:10:20.225371 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:10:20.225371 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:10:20.225371 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:10:20.225371 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:10:20.225371 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:10:20.226157 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:10:20.226157 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:10:20.226157 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:10:20.226157 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:10:20.226157 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:10:20.226157 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:10:20.226157 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:10:20.226157 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:10:20.226157 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:10:20.226157 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:10:20.226157 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:10:20.226157 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:10:20.231545 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 62/121] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Sep 15 12:10:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:10:20.232785 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9fe365-0a3b-44a3-add8-01898fd95042 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:20.233073 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9fe365-0a3b-44a3-add8-01898fd95042 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:20.233522 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9fe365-0a3b-44a3-add8-01898fd95042 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:20.234600 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 63/122] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:10:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:10:20.239392 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9fe365-0a3b-44a3-add8-01898fd95042 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:20.258643 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e8609e-02aa-4754-ae8b-84d5c58bd43b None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:20.340347 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfd7203-b8b7-4b68-ada3-88a76f519efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:20.341388 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd7203-b8b7-4b68-ada3-88a76f519efa None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:20.341883 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd7203-b8b7-4b68-ada3-88a76f519efa None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:20.342345 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd7203-b8b7-4b68-ada3-88a76f519efa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:20.366037 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfd7203-b8b7-4b68-ada3-88a76f519efa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:10:20.371882 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-4cfd7203-b8b7-4b68-ada3-88a76f519efa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 12:10:20.371882 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:10:20.371882 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:10:20.371882 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:10:20.371882 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:10:20.371882 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:10:20.371882 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:10:20.371882 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:10:20.371882 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:10:20.371882 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:10:20.371882 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:10:20.371882 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:10:20.371882 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:10:20.371882 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:10:20.371882 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:10:20.371882 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:10:20.372738 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:10:20.372738 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:10:20.372738 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:10:20.372738 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:10:20.372738 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:10:20.372738 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:10:20.372738 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:10:20.372738 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:10:20.372738 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:10:20.372738 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:10:20.372738 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:10:20.372738 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:10:20.372738 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:10:20.372738 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:10:20.372738 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:10:20.372738 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:10:20.373570 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:10:20.373570 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:10:20.373570 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:10:20.373570 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:10:20.373570 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:10:20.373570 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:10:20.373570 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:10:20.373570 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:10:20.373570 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:10:20.373570 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:10:20.373570 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 12:10:20.373570 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:10:20.373570 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 60/123] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Sep 15 12:10:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:10:20.381980 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb15633-fe3c-4e30-90cb-32cb48988c8b None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:20.382281 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb15633-fe3c-4e30-90cb-32cb48988c8b None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:20.382596 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb15633-fe3c-4e30-90cb-32cb48988c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:20.417048 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-6fb15633-fe3c-4e30-90cb-32cb48988c8b None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:10:20.418819 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-6fb15633-fe3c-4e30-90cb-32cb48988c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:10:20.440432 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9fe365-0a3b-44a3-add8-01898fd95042 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:20.513379 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2af214-c406-4e26-96ac-fb578d2d8590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:20.514109 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2af214-c406-4e26-96ac-fb578d2d8590 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:20.514400 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2af214-c406-4e26-96ac-fb578d2d8590 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:20.514675 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2af214-c406-4e26-96ac-fb578d2d8590 None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:20.517222 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2af214-c406-4e26-96ac-fb578d2d8590 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:10:20.517544 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2af214-c406-4e26-96ac-fb578d2d8590 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:20.520045 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2af214-c406-4e26-96ac-fb578d2d8590 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:20.538115 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 64/124] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 15 12:10:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:20.538820 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2af214-c406-4e26-96ac-fb578d2d8590 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:20.561236 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 61/125] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:10:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:10:20.562123 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb15633-fe3c-4e30-90cb-32cb48988c8b None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:20.594587 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:20.616884 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:20.744609 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb15633-fe3c-4e30-90cb-32cb48988c8b None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:20.769308 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2af214-c406-4e26-96ac-fb578d2d8590 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:20.781671 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f66693-d4e3-4cb6-a753-817255b99d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:20.782981 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f66693-d4e3-4cb6-a753-817255b99d9b None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:20.783247 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f66693-d4e3-4cb6-a753-817255b99d9b None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:20.783527 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f66693-d4e3-4cb6-a753-817255b99d9b None admin] PATH_INFO: `/v3/users/0385d82554b5461ca05c9bdb07b4a451` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:20.784688 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f66693-d4e3-4cb6-a753-817255b99d9b None admin] RBAC: Authorizing `identity:get_user(user_id=0385d82554b5461ca05c9bdb07b4a451)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:20.786268 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f66693-d4e3-4cb6-a753-817255b99d9b None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:20.787940 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 62/126] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 15 12:10:20 2022] GET /identity/v3/users/0385d82554b5461ca05c9bdb07b4a451 => generated 247 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:20.793441 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f66693-d4e3-4cb6-a753-817255b99d9b None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:20.863321 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2697aaa-48b8-4b12-8b76-033199c59e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:20.863948 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2697aaa-48b8-4b12-8b76-033199c59e0c None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:20.864232 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2697aaa-48b8-4b12-8b76-033199c59e0c None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:20.864510 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2697aaa-48b8-4b12-8b76-033199c59e0c None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:20.865185 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2697aaa-48b8-4b12-8b76-033199c59e0c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:10:20.865492 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2697aaa-48b8-4b12-8b76-033199c59e0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:20.870973 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2697aaa-48b8-4b12-8b76-033199c59e0c None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:20.883478 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:20.894131 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 65/127] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 15 12:10:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:20.899502 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f66693-d4e3-4cb6-a753-817255b99d9b None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:20.899748 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2697aaa-48b8-4b12-8b76-033199c59e0c None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:20.937717 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50bc659-dc31-4369-b5fe-3487af489e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:20.939116 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50bc659-dc31-4369-b5fe-3487af489e88 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:20.939417 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50bc659-dc31-4369-b5fe-3487af489e88 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:20.939695 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50bc659-dc31-4369-b5fe-3487af489e88 None admin] PATH_INFO: `/v3/projects/23903d1c5f234a8ba964a00b23864453` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:20.940887 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50bc659-dc31-4369-b5fe-3487af489e88 None admin] RBAC: Authorizing `identity:get_project(project_id=23903d1c5f234a8ba964a00b23864453)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:20.942662 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50bc659-dc31-4369-b5fe-3487af489e88 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:20.944941 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 63/128] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 15 12:10:20 2022] GET /identity/v3/projects/23903d1c5f234a8ba964a00b23864453 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:10:20.950637 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50bc659-dc31-4369-b5fe-3487af489e88 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:21.061889 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50bc659-dc31-4369-b5fe-3487af489e88 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:21.100645 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b58569-258f-4f73-bc9e-df18ad3fb6c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:21.101371 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b58569-258f-4f73-bc9e-df18ad3fb6c8 None admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:21.101661 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b58569-258f-4f73-bc9e-df18ad3fb6c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:21.101939 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b58569-258f-4f73-bc9e-df18ad3fb6c8 None admin] PATH_INFO: `/v3/projects/23903d1c5f234a8ba964a00b23864453/users/0385d82554b5461ca05c9bdb07b4a451/roles/7f53f1c823b746529ba5057bf21b2477` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:21.103907 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b58569-258f-4f73-bc9e-df18ad3fb6c8 None admin] RBAC: Authorizing `identity:create_grant(project_id=23903d1c5f234a8ba964a00b23864453, user_id=0385d82554b5461ca05c9bdb07b4a451, role_id=7f53f1c823b746529ba5057bf21b2477)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:21.105450 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b58569-258f-4f73-bc9e-df18ad3fb6c8 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:21.122332 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 64/129] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Sep 15 12:10:20 2022] PUT /identity/v3/projects/23903d1c5f234a8ba964a00b23864453/users/0385d82554b5461ca05c9bdb07b4a451/roles/7f53f1c823b746529ba5057bf21b2477 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:10:21.129346 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b58569-258f-4f73-bc9e-df18ad3fb6c8 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:21.151357 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:21.163787 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:21.189214 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2697aaa-48b8-4b12-8b76-033199c59e0c None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:21.254891 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c379a1a-6f8c-4602-8062-40b66db2abda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:21.255541 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c379a1a-6f8c-4602-8062-40b66db2abda None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:21.255822 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c379a1a-6f8c-4602-8062-40b66db2abda None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:21.256102 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c379a1a-6f8c-4602-8062-40b66db2abda None admin] PATH_INFO: `/v3/users/b0dd68fd960b44079ef49a5f9f3b0675` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:21.257256 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c379a1a-6f8c-4602-8062-40b66db2abda None admin] RBAC: Authorizing `identity:get_user(user_id=b0dd68fd960b44079ef49a5f9f3b0675)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:21.258746 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c379a1a-6f8c-4602-8062-40b66db2abda None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:21.265045 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 66/130] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 15 12:10:20 2022] GET /identity/v3/users/b0dd68fd960b44079ef49a5f9f3b0675 => generated 275 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:21.266034 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c379a1a-6f8c-4602-8062-40b66db2abda None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:21.320468 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b58569-258f-4f73-bc9e-df18ad3fb6c8 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:21.396020 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46bd2df-d62e-41ee-ad74-f05f8fceb074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:21.396686 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46bd2df-d62e-41ee-ad74-f05f8fceb074 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:21.396972 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46bd2df-d62e-41ee-ad74-f05f8fceb074 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:21.397246 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46bd2df-d62e-41ee-ad74-f05f8fceb074 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:21.431778 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46bd2df-d62e-41ee-ad74-f05f8fceb074 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:10:21.437117 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-f46bd2df-d62e-41ee-ad74-f05f8fceb074 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 12:10:21.437117 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:10:21.437117 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:10:21.437117 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:10:21.437117 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:10:21.437117 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:10:21.437117 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:10:21.437117 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:10:21.437117 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:10:21.437117 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:10:21.437117 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:10:21.437117 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:10:21.437117 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:10:21.437117 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:10:21.437117 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:10:21.437117 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:10:21.438057 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:10:21.438057 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:10:21.438057 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:10:21.438057 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:10:21.438057 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:10:21.438057 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:10:21.438057 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:10:21.438057 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:10:21.438057 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:10:21.438057 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:10:21.438057 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:10:21.438057 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:10:21.438057 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:10:21.438057 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:10:21.438057 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:10:21.438057 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:10:21.439416 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:10:21.439416 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:10:21.439416 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:10:21.439416 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:10:21.439416 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:10:21.439416 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:10:21.439416 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:10:21.439416 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:10:21.439416 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:10:21.439416 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:10:21.439416 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 12:10:21.439416 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:10:21.439416 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 65/131] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 15 12:10:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:10:21.446774 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46bd2df-d62e-41ee-ad74-f05f8fceb074 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:21.455934 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c379a1a-6f8c-4602-8062-40b66db2abda None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:21.521810 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cd61b3-ab81-41b1-94fc-ba1baff44c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:21.523659 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cd61b3-ab81-41b1-94fc-ba1baff44c60 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:21.525037 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cd61b3-ab81-41b1-94fc-ba1baff44c60 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:21.525706 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cd61b3-ab81-41b1-94fc-ba1baff44c60 None admin] PATH_INFO: `/v3/projects/23903d1c5f234a8ba964a00b23864453` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:21.528407 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cd61b3-ab81-41b1-94fc-ba1baff44c60 None admin] RBAC: Authorizing `identity:get_project(project_id=23903d1c5f234a8ba964a00b23864453)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:21.530204 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cd61b3-ab81-41b1-94fc-ba1baff44c60 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:21.533239 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 67/132] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 15 12:10:21 2022] GET /identity/v3/projects/23903d1c5f234a8ba964a00b23864453 => generated 298 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:21.539531 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cd61b3-ab81-41b1-94fc-ba1baff44c60 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:21.602401 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:21.603699 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:21.649110 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46bd2df-d62e-41ee-ad74-f05f8fceb074 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:21.686296 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777123a6-4dfb-4563-b74a-fc18446c732a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:21.686936 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777123a6-4dfb-4563-b74a-fc18446c732a None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:21.687223 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777123a6-4dfb-4563-b74a-fc18446c732a None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:21.687498 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777123a6-4dfb-4563-b74a-fc18446c732a None admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:21.688178 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777123a6-4dfb-4563-b74a-fc18446c732a None admin] RBAC: Adding query filter params (name=member) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:10:21.688485 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777123a6-4dfb-4563-b74a-fc18446c732a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:21.690250 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cd61b3-ab81-41b1-94fc-ba1baff44c60 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:21.690480 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777123a6-4dfb-4563-b74a-fc18446c732a None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:21.699942 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 66/133] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Sep 15 12:10:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:10:21.701206 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567325a2-c25c-4130-b2b8-54fa78fd7c20 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:21.701492 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567325a2-c25c-4130-b2b8-54fa78fd7c20 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:21.701771 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567325a2-c25c-4130-b2b8-54fa78fd7c20 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:21.703016 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 67/134] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:10:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:10:21.707592 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567325a2-c25c-4130-b2b8-54fa78fd7c20 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:21.757748 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248e2b43-5809-4e53-84c7-f970fe458c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:21.758795 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248e2b43-5809-4e53-84c7-f970fe458c86 None admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:21.759272 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248e2b43-5809-4e53-84c7-f970fe458c86 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:21.759859 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248e2b43-5809-4e53-84c7-f970fe458c86 None admin] PATH_INFO: `/v3/projects/23903d1c5f234a8ba964a00b23864453/users/b0dd68fd960b44079ef49a5f9f3b0675/roles/19ee0f56c10b47628ba0b1c3deee4448` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:21.768098 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248e2b43-5809-4e53-84c7-f970fe458c86 None admin] RBAC: Authorizing `identity:create_grant(project_id=23903d1c5f234a8ba964a00b23864453, user_id=b0dd68fd960b44079ef49a5f9f3b0675, role_id=19ee0f56c10b47628ba0b1c3deee4448)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:21.769865 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248e2b43-5809-4e53-84c7-f970fe458c86 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:21.801867 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 68/135] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Sep 15 12:10:21 2022] PUT /identity/v3/projects/23903d1c5f234a8ba964a00b23864453/users/b0dd68fd960b44079ef49a5f9f3b0675/roles/19ee0f56c10b47628ba0b1c3deee4448 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:10:21.803744 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ed157-0b04-4f31-af1b-f3bdf805fe92 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:21.804304 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ed157-0b04-4f31-af1b-f3bdf805fe92 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:21.804796 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ed157-0b04-4f31-af1b-f3bdf805fe92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:21.822959 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567325a2-c25c-4130-b2b8-54fa78fd7c20 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:21.844115 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-6b4ed157-0b04-4f31-af1b-f3bdf805fe92 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:10:21.845859 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-6b4ed157-0b04-4f31-af1b-f3bdf805fe92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:10:21.853065 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:21.862415 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5c5c3c-89b5-4865-8051-5f3eec81ecb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:21.863512 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5c5c3c-89b5-4865-8051-5f3eec81ecb0 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:21.864061 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5c5c3c-89b5-4865-8051-5f3eec81ecb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:21.864899 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5c5c3c-89b5-4865-8051-5f3eec81ecb0 None admin] PATH_INFO: `/v3/users/b0dd68fd960b44079ef49a5f9f3b0675` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:21.866182 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5c5c3c-89b5-4865-8051-5f3eec81ecb0 None admin] RBAC: Authorizing `identity:get_user(user_id=b0dd68fd960b44079ef49a5f9f3b0675)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:21.867905 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5c5c3c-89b5-4865-8051-5f3eec81ecb0 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:21.874717 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 68/136] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 15 12:10:21 2022] GET /identity/v3/users/b0dd68fd960b44079ef49a5f9f3b0675 => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:21.875439 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5c5c3c-89b5-4865-8051-5f3eec81ecb0 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:21.992318 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5c5c3c-89b5-4865-8051-5f3eec81ecb0 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:22.005734 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 69/137] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:10:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:10:22.046198 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86877a79-d800-4790-bb2b-a367e42d3cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:22.047235 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86877a79-d800-4790-bb2b-a367e42d3cfa None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:22.047710 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86877a79-d800-4790-bb2b-a367e42d3cfa None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:22.048693 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86877a79-d800-4790-bb2b-a367e42d3cfa None admin] PATH_INFO: `/v3/projects/78241f1452694570bd17703ff5866deb` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:22.052282 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86877a79-d800-4790-bb2b-a367e42d3cfa None admin] RBAC: Authorizing `identity:get_project(project_id=78241f1452694570bd17703ff5866deb)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:22.054006 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86877a79-d800-4790-bb2b-a367e42d3cfa None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:22.055902 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 69/138] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 15 12:10:21 2022] GET /identity/v3/projects/78241f1452694570bd17703ff5866deb => generated 312 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:22.061805 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4ed157-0b04-4f31-af1b-f3bdf805fe92 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:22.094961 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:22.206085 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4ed157-0b04-4f31-af1b-f3bdf805fe92 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:22.251980 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91bd905-4f8c-427f-9a6f-b23713a9c96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:22.253033 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91bd905-4f8c-427f-9a6f-b23713a9c96e None admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:22.253504 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91bd905-4f8c-427f-9a6f-b23713a9c96e None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:22.253965 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91bd905-4f8c-427f-9a6f-b23713a9c96e None admin] PATH_INFO: `/v3/projects/78241f1452694570bd17703ff5866deb/users/b0dd68fd960b44079ef49a5f9f3b0675/roles/9371e5bbc55848949eb951a815f817f2` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:22.256870 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91bd905-4f8c-427f-9a6f-b23713a9c96e None admin] RBAC: Authorizing `identity:create_grant(project_id=78241f1452694570bd17703ff5866deb, user_id=b0dd68fd960b44079ef49a5f9f3b0675, role_id=9371e5bbc55848949eb951a815f817f2)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:22.258614 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91bd905-4f8c-427f-9a6f-b23713a9c96e None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:22.284324 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 70/139] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Sep 15 12:10:22 2022] PUT /identity/v3/projects/78241f1452694570bd17703ff5866deb/users/b0dd68fd960b44079ef49a5f9f3b0675/roles/9371e5bbc55848949eb951a815f817f2 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:10:22.465171 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f5990b-00d5-45ea-948f-62ae9914d927 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:22.465648 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f5990b-00d5-45ea-948f-62ae9914d927 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:22.465648 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f5990b-00d5-45ea-948f-62ae9914d927 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:22.467106 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 70/140] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:10:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:10:22.480230 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5977e0cb-35e5-4bb2-a32c-af8daa4adcce None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:22.481205 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5977e0cb-35e5-4bb2-a32c-af8daa4adcce None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:22.481684 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5977e0cb-35e5-4bb2-a32c-af8daa4adcce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:22.507374 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-5977e0cb-35e5-4bb2-a32c-af8daa4adcce None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:10:22.507582 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f5990b-00d5-45ea-948f-62ae9914d927 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:22.509109 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-5977e0cb-35e5-4bb2-a32c-af8daa4adcce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:10:22.645139 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 71/141] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:10:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:10:22.663344 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:22.709431 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f5990b-00d5-45ea-948f-62ae9914d927 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:22.754721 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d2c19b-53d8-4f09-93ba-8732d14213f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:22.755381 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d2c19b-53d8-4f09-93ba-8732d14213f9 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:22.755612 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d2c19b-53d8-4f09-93ba-8732d14213f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:22.755894 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d2c19b-53d8-4f09-93ba-8732d14213f9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:22.757126 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d2c19b-53d8-4f09-93ba-8732d14213f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:22.758633 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d2c19b-53d8-4f09-93ba-8732d14213f9 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:22.760323 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 71/142] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:10:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:22.766163 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5977e0cb-35e5-4bb2-a32c-af8daa4adcce None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:22.778830 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:22.888910 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5977e0cb-35e5-4bb2-a32c-af8daa4adcce None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:22.929507 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb9eed9-106b-4c60-8785-cf31018d8c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:22.930519 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb9eed9-106b-4c60-8785-cf31018d8c1d None admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:22.931010 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb9eed9-106b-4c60-8785-cf31018d8c1d None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:22.931473 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb9eed9-106b-4c60-8785-cf31018d8c1d None admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:22.932317 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb9eed9-106b-4c60-8785-cf31018d8c1d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:22.933973 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb9eed9-106b-4c60-8785-cf31018d8c1d None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:22.962565 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 72/143] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Sep 15 12:10:22 2022] POST /identity/v3/users => generated 283 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:10:23.055231 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d2c19b-53d8-4f09-93ba-8732d14213f9 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:23.147720 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff37b070-2254-4bcd-bb6e-2e5f3c874290 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:23.148350 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff37b070-2254-4bcd-bb6e-2e5f3c874290 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:23.148843 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff37b070-2254-4bcd-bb6e-2e5f3c874290 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:23.150571 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 73/144] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:10:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:10:23.156574 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94964b9-9dea-4d93-8756-268010902ca4 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:23.157121 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94964b9-9dea-4d93-8756-268010902ca4 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:23.157635 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94964b9-9dea-4d93-8756-268010902ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:23.197599 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-f94964b9-9dea-4d93-8756-268010902ca4 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:10:23.199245 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-f94964b9-9dea-4d93-8756-268010902ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:10:23.214036 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d2c19b-53d8-4f09-93ba-8732d14213f9 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:23.292355 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:23.300743 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17200d68-7d32-4ca0-8533-95ccc0b4eeb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:23.301866 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17200d68-7d32-4ca0-8533-95ccc0b4eeb4 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:23.302376 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17200d68-7d32-4ca0-8533-95ccc0b4eeb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:23.302876 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17200d68-7d32-4ca0-8533-95ccc0b4eeb4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:23.314624 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:23.324312 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17200d68-7d32-4ca0-8533-95ccc0b4eeb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:10:23.329985 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-17200d68-7d32-4ca0-8533-95ccc0b4eeb4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 12:10:23.329985 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:10:23.329985 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:10:23.329985 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:10:23.329985 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:10:23.329985 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:10:23.329985 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:10:23.329985 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:10:23.329985 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:10:23.329985 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:10:23.329985 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:10:23.329985 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:10:23.329985 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:10:23.329985 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:10:23.329985 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:10:23.329985 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:10:23.330884 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:10:23.330884 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:10:23.330884 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:10:23.330884 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:10:23.330884 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:10:23.330884 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:10:23.330884 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:10:23.330884 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:10:23.330884 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:10:23.330884 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:10:23.330884 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:10:23.330884 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:10:23.330884 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:10:23.330884 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:10:23.330884 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:10:23.330884 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:10:23.331688 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:10:23.331688 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:10:23.331688 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:10:23.331688 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:10:23.331688 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:10:23.331688 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:10:23.331688 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:10:23.331688 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:10:23.331688 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:10:23.331688 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:10:23.331688 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 12:10:23.331688 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:10:23.331688 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 72/145] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 15 12:10:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:10:23.339865 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 74/146] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:10:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 12:10:23.340691 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17200d68-7d32-4ca0-8533-95ccc0b4eeb4 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:23.476171 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17200d68-7d32-4ca0-8533-95ccc0b4eeb4 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:23.516035 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac38fc8-dedc-4ead-b2f1-3054c6f657ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:23.516680 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac38fc8-dedc-4ead-b2f1-3054c6f657ac None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:23.517519 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac38fc8-dedc-4ead-b2f1-3054c6f657ac None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:23.517798 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac38fc8-dedc-4ead-b2f1-3054c6f657ac None admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:23.518476 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac38fc8-dedc-4ead-b2f1-3054c6f657ac None admin] RBAC: Adding query filter params (name=reader) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:10:23.518847 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac38fc8-dedc-4ead-b2f1-3054c6f657ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:23.520499 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac38fc8-dedc-4ead-b2f1-3054c6f657ac None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:23.535032 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 73/147] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Sep 15 12:10:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:23.540851 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94964b9-9dea-4d93-8756-268010902ca4 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:23.684774 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94964b9-9dea-4d93-8756-268010902ca4 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:23.685938 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac38fc8-dedc-4ead-b2f1-3054c6f657ac None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:23.736112 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3582226-81eb-4da1-b190-55422f1cd618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:23.736765 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3582226-81eb-4da1-b190-55422f1cd618 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:23.737045 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3582226-81eb-4da1-b190-55422f1cd618 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:23.737321 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3582226-81eb-4da1-b190-55422f1cd618 None admin] PATH_INFO: `/v3/users/f42e14b9dced4ff6a25a81848413c849` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:23.738755 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3582226-81eb-4da1-b190-55422f1cd618 None admin] RBAC: Authorizing `identity:get_user(user_id=f42e14b9dced4ff6a25a81848413c849)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:23.740245 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3582226-81eb-4da1-b190-55422f1cd618 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:23.746335 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 75/148] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 15 12:10:23 2022] GET /identity/v3/users/f42e14b9dced4ff6a25a81848413c849 => generated 289 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:23.747194 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3582226-81eb-4da1-b190-55422f1cd618 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:23.810235 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:23.895041 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:23.905243 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac38fc8-dedc-4ead-b2f1-3054c6f657ac None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:23.952994 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3582226-81eb-4da1-b190-55422f1cd618 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:24.006334 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee654eb8-9a33-4e5d-8cb0-c3d566d97413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:24.007178 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee654eb8-9a33-4e5d-8cb0-c3d566d97413 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:24.007470 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee654eb8-9a33-4e5d-8cb0-c3d566d97413 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:24.007747 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee654eb8-9a33-4e5d-8cb0-c3d566d97413 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:24.009371 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad72c5e8-dfca-4dd4-8fcd-adc4feb29229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:24.010012 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad72c5e8-dfca-4dd4-8fcd-adc4feb29229 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:24.010296 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad72c5e8-dfca-4dd4-8fcd-adc4feb29229 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:24.010625 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad72c5e8-dfca-4dd4-8fcd-adc4feb29229 None admin] PATH_INFO: `/v3/projects/23903d1c5f234a8ba964a00b23864453` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:24.011868 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad72c5e8-dfca-4dd4-8fcd-adc4feb29229 None admin] RBAC: Authorizing `identity:get_project(project_id=23903d1c5f234a8ba964a00b23864453)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:24.013533 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad72c5e8-dfca-4dd4-8fcd-adc4feb29229 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:24.015421 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 76/149] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 15 12:10:23 2022] GET /identity/v3/projects/23903d1c5f234a8ba964a00b23864453 => generated 298 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:24.021930 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad72c5e8-dfca-4dd4-8fcd-adc4feb29229 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:24.041771 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee654eb8-9a33-4e5d-8cb0-c3d566d97413 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:10:24.047277 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-ee654eb8-9a33-4e5d-8cb0-c3d566d97413 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 12:10:24.047277 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:10:24.047277 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:10:24.047277 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:10:24.047277 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:10:24.047277 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:10:24.047277 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:10:24.047277 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:10:24.047277 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:10:24.047277 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:10:24.047277 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:10:24.047277 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:10:24.047277 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:10:24.047277 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:10:24.047277 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:10:24.047277 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:10:24.048170 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:10:24.048170 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:10:24.048170 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:10:24.048170 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:10:24.048170 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:10:24.048170 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:10:24.048170 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:10:24.048170 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:10:24.048170 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:10:24.048170 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:10:24.048170 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:10:24.048170 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:10:24.048170 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:10:24.048170 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:10:24.048170 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:10:24.048170 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:10:24.048918 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:10:24.048918 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:10:24.048918 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:10:24.048918 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:10:24.048918 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:10:24.048918 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:10:24.048918 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:10:24.048918 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:10:24.048918 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:10:24.048918 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:10:24.048918 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 12:10:24.048918 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:10:24.049495 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 74/150] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 15 12:10:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:10:24.059728 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee654eb8-9a33-4e5d-8cb0-c3d566d97413 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:24.130681 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad72c5e8-dfca-4dd4-8fcd-adc4feb29229 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:24.167629 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42173f4d-14dc-4bfc-86dd-dd55fb45c420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:24.168309 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42173f4d-14dc-4bfc-86dd-dd55fb45c420 None admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:24.168599 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42173f4d-14dc-4bfc-86dd-dd55fb45c420 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:24.168883 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42173f4d-14dc-4bfc-86dd-dd55fb45c420 None admin] PATH_INFO: `/v3/projects/23903d1c5f234a8ba964a00b23864453/users/f42e14b9dced4ff6a25a81848413c849/roles/da591cd17baa4d009b74f6facf2a6688` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:24.171027 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42173f4d-14dc-4bfc-86dd-dd55fb45c420 None admin] RBAC: Authorizing `identity:create_grant(project_id=23903d1c5f234a8ba964a00b23864453, user_id=f42e14b9dced4ff6a25a81848413c849, role_id=da591cd17baa4d009b74f6facf2a6688)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:24.172505 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42173f4d-14dc-4bfc-86dd-dd55fb45c420 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:24.181604 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:24.206754 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 77/151] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Sep 15 12:10:24 2022] PUT /identity/v3/projects/23903d1c5f234a8ba964a00b23864453/users/f42e14b9dced4ff6a25a81848413c849/roles/da591cd17baa4d009b74f6facf2a6688 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:10:24.308006 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee654eb8-9a33-4e5d-8cb0-c3d566d97413 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:24.333199 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:24.357116 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb4ee15-2d25-49f6-9022-22b300486d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:24.357739 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb4ee15-2d25-49f6-9022-22b300486d86 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:24.358017 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb4ee15-2d25-49f6-9022-22b300486d86 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:24.358286 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb4ee15-2d25-49f6-9022-22b300486d86 None admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:24.359008 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb4ee15-2d25-49f6-9022-22b300486d86 None admin] RBAC: Adding query filter params (name=member) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:10:24.359312 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb4ee15-2d25-49f6-9022-22b300486d86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:24.360794 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb4ee15-2d25-49f6-9022-22b300486d86 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:24.374864 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 75/152] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Sep 15 12:10:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:24.381455 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42173f4d-14dc-4bfc-86dd-dd55fb45c420 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:24.561994 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa0530a-104a-4ff2-a63f-c1879f197d7c None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:24.562487 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa0530a-104a-4ff2-a63f-c1879f197d7c None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:24.562487 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa0530a-104a-4ff2-a63f-c1879f197d7c None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:24.564049 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 76/153] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:10:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:10:24.564685 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42173f4d-14dc-4bfc-86dd-dd55fb45c420 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:24.571610 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b432eae-76b1-47ca-9ba7-1abace92c6f5 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:24.571893 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b432eae-76b1-47ca-9ba7-1abace92c6f5 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:24.572163 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b432eae-76b1-47ca-9ba7-1abace92c6f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:24.605750 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-7b432eae-76b1-47ca-9ba7-1abace92c6f5 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:10:24.607201 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-7b432eae-76b1-47ca-9ba7-1abace92c6f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:10:24.607879 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7d7746-76ce-4335-8844-2ca2a530c3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:24.608532 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d7746-76ce-4335-8844-2ca2a530c3bc None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:24.608820 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d7746-76ce-4335-8844-2ca2a530c3bc None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:24.609097 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d7746-76ce-4335-8844-2ca2a530c3bc None admin] PATH_INFO: `/v3/users/b0dd68fd960b44079ef49a5f9f3b0675` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:24.610876 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7d7746-76ce-4335-8844-2ca2a530c3bc None admin] RBAC: Authorizing `identity:get_user(user_id=b0dd68fd960b44079ef49a5f9f3b0675)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:24.613279 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7d7746-76ce-4335-8844-2ca2a530c3bc None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:24.615261 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 78/154] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 15 12:10:24 2022] GET /identity/v3/users/b0dd68fd960b44079ef49a5f9f3b0675 => generated 275 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:24.621327 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7d7746-76ce-4335-8844-2ca2a530c3bc None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:24.727547 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:24.727989 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 77/155] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:10:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 12:10:24.782317 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7d7746-76ce-4335-8844-2ca2a530c3bc None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:24.826052 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ac8e24-c4c4-42a9-b593-03ce01bc1cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:24.826636 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac8e24-c4c4-42a9-b593-03ce01bc1cb0 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:24.826959 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac8e24-c4c4-42a9-b593-03ce01bc1cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:24.827233 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac8e24-c4c4-42a9-b593-03ce01bc1cb0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:24.918151 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ac8e24-c4c4-42a9-b593-03ce01bc1cb0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:24.919737 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ac8e24-c4c4-42a9-b593-03ce01bc1cb0 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:25.010176 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:25.065494 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 79/156] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 15 12:10:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 12:10:25.070759 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b432eae-76b1-47ca-9ba7-1abace92c6f5 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:25.208930 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b432eae-76b1-47ca-9ba7-1abace92c6f5 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:25.216477 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:25.254720 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfee06e-2ab1-43b4-b379-e8f5769e845e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:25.255389 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfee06e-2ab1-43b4-b379-e8f5769e845e None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:25.255669 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfee06e-2ab1-43b4-b379-e8f5769e845e None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:25.255941 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfee06e-2ab1-43b4-b379-e8f5769e845e None admin] PATH_INFO: `/v3/projects/23903d1c5f234a8ba964a00b23864453` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:25.257086 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfee06e-2ab1-43b4-b379-e8f5769e845e None admin] RBAC: Authorizing `identity:get_project(project_id=23903d1c5f234a8ba964a00b23864453)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:25.258546 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfee06e-2ab1-43b4-b379-e8f5769e845e None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:25.260214 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 78/157] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 15 12:10:25 2022] GET /identity/v3/projects/23903d1c5f234a8ba964a00b23864453 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:25.266322 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ac8e24-c4c4-42a9-b593-03ce01bc1cb0 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:25.340447 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94b30be-0d79-44d3-a935-31dfd48eaf7b None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:25.340744 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94b30be-0d79-44d3-a935-31dfd48eaf7b None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:25.341002 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94b30be-0d79-44d3-a935-31dfd48eaf7b None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:25.342347 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 79/158] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:10:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:10:25.352691 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e55df8-e23f-4080-8240-e4e1de6d9aa9 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:25.352969 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e55df8-e23f-4080-8240-e4e1de6d9aa9 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:25.353242 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e55df8-e23f-4080-8240-e4e1de6d9aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:25.381366 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-f5e55df8-e23f-4080-8240-e4e1de6d9aa9 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:10:25.382565 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-f5e55df8-e23f-4080-8240-e4e1de6d9aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:10:25.430191 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ac8e24-c4c4-42a9-b593-03ce01bc1cb0 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:25.477275 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 80/159] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:10:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 12:10:25.477881 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e55df8-e23f-4080-8240-e4e1de6d9aa9 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:25.511403 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9780015-9824-4094-94b3-3577a4dc547d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:25.512369 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9780015-9824-4094-94b3-3577a4dc547d None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:25.512887 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9780015-9824-4094-94b3-3577a4dc547d None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:25.513354 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9780015-9824-4094-94b3-3577a4dc547d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:25.514274 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9780015-9824-4094-94b3-3577a4dc547d None admin] RBAC: Adding query filter params (role.id=9371e5bbc55848949eb951a815f817f2, scope.project.id=23903d1c5f234a8ba964a00b23864453, user.id=b0dd68fd960b44079ef49a5f9f3b0675) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:10:25.514808 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9780015-9824-4094-94b3-3577a4dc547d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:25.516454 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9780015-9824-4094-94b3-3577a4dc547d None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:25.533489 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 80/160] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 15 12:10:25 2022] GET /identity/v3/role_assignments?user.id=b0dd68fd960b44079ef49a5f9f3b0675&scope.project.id=23903d1c5f234a8ba964a00b23864453&role.id=9371e5bbc55848949eb951a815f817f2 => generated 608 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:25.621228 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e55df8-e23f-4080-8240-e4e1de6d9aa9 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:25.623615 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:25.670337 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608ae810-6164-42f1-a9d2-5e27ef053450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:25.671021 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ae810-6164-42f1-a9d2-5e27ef053450 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:25.671302 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ae810-6164-42f1-a9d2-5e27ef053450 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:25.671577 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ae810-6164-42f1-a9d2-5e27ef053450 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:25.683317 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608ae810-6164-42f1-a9d2-5e27ef053450 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:10:25.692653 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-608ae810-6164-42f1-a9d2-5e27ef053450 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:10:25.692653 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:10:25.692653 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:10:25.692653 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:10:25.692653 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:10:25.692653 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:10:25.692653 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:10:25.692653 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:10:25.692653 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:10:25.692653 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:10:25.692653 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:10:25.692653 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:10:25.692653 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:10:25.692653 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:10:25.692653 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:10:25.692653 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:10:25.693835 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:10:25.693835 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:10:25.693835 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:10:25.693835 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:10:25.693835 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:10:25.693835 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:10:25.693835 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:10:25.693835 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:10:25.693835 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:10:25.693835 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:10:25.693835 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:10:25.693835 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:10:25.693835 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:10:25.693835 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:10:25.693835 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:10:25.693835 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:10:25.694619 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:10:25.694619 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:10:25.694619 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:10:25.694619 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:10:25.694619 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:10:25.694619 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:10:25.694619 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:10:25.694619 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:10:25.694619 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:10:25.694619 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:10:25.694619 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:10:25.694619 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:10:25.694619 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 81/161] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Sep 15 12:10:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:10:25.700275 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9780015-9824-4094-94b3-3577a4dc547d None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:25.748652 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:25.860038 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9780015-9824-4094-94b3-3577a4dc547d None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:25.910794 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492e3a17-5e89-4d00-b5ae-f3e6967ba0c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:25.911416 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e3a17-5e89-4d00-b5ae-f3e6967ba0c8 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:25.911691 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e3a17-5e89-4d00-b5ae-f3e6967ba0c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:25.911961 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e3a17-5e89-4d00-b5ae-f3e6967ba0c8 None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:25.912623 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492e3a17-5e89-4d00-b5ae-f3e6967ba0c8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:10:25.912926 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492e3a17-5e89-4d00-b5ae-f3e6967ba0c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:25.914306 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492e3a17-5e89-4d00-b5ae-f3e6967ba0c8 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:25.926454 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 81/162] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 15 12:10:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:25.932287 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608ae810-6164-42f1-a9d2-5e27ef053450 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:26.078130 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608ae810-6164-42f1-a9d2-5e27ef053450 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:26.122166 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fae63b2-1a19-49c7-9b44-32b847484c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:26.122839 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae63b2-1a19-49c7-9b44-32b847484c57 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:26.123121 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae63b2-1a19-49c7-9b44-32b847484c57 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:26.123394 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae63b2-1a19-49c7-9b44-32b847484c57 None admin] PATH_INFO: `/v3/users/0385d82554b5461ca05c9bdb07b4a451` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:26.124572 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fae63b2-1a19-49c7-9b44-32b847484c57 None admin] RBAC: Authorizing `identity:get_user(user_id=0385d82554b5461ca05c9bdb07b4a451)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:26.127075 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fae63b2-1a19-49c7-9b44-32b847484c57 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:26.128795 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 82/163] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 15 12:10:25 2022] GET /identity/v3/users/0385d82554b5461ca05c9bdb07b4a451 => generated 247 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:26.134555 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492e3a17-5e89-4d00-b5ae-f3e6967ba0c8 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:26.135059 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fae63b2-1a19-49c7-9b44-32b847484c57 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:26.175047 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:26.265812 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fae63b2-1a19-49c7-9b44-32b847484c57 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:26.303462 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:26.324952 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d298a492-c454-4a56-b5be-1599018c5518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:26.325600 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298a492-c454-4a56-b5be-1599018c5518 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:26.325880 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298a492-c454-4a56-b5be-1599018c5518 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:26.326149 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298a492-c454-4a56-b5be-1599018c5518 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:26.327168 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492e3a17-5e89-4d00-b5ae-f3e6967ba0c8 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:26.341653 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d298a492-c454-4a56-b5be-1599018c5518 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:10:26.347081 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-d298a492-c454-4a56-b5be-1599018c5518 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 12:10:26.347081 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:10:26.347081 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:10:26.347081 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:10:26.347081 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:10:26.347081 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:10:26.347081 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:10:26.347081 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:10:26.347081 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:10:26.347081 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:10:26.347081 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:10:26.347081 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:10:26.347081 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:10:26.347081 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:10:26.347081 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:10:26.347081 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:10:26.347955 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:10:26.347955 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:10:26.347955 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:10:26.347955 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:10:26.347955 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:10:26.347955 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:10:26.347955 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:10:26.347955 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:10:26.347955 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:10:26.347955 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:10:26.347955 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:10:26.347955 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:10:26.347955 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:10:26.347955 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:10:26.347955 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:10:26.347955 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:10:26.348738 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:10:26.348738 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:10:26.348738 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:10:26.348738 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:10:26.348738 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:10:26.348738 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:10:26.348738 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:10:26.348738 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:10:26.348738 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:10:26.348738 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:10:26.348738 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 12:10:26.348738 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:10:26.348738 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 83/164] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Sep 15 12:10:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:10:26.354082 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d298a492-c454-4a56-b5be-1599018c5518 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:26.412154 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6656ab-0224-4d3f-9488-48eb61385580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:26.412792 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6656ab-0224-4d3f-9488-48eb61385580 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:26.413071 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6656ab-0224-4d3f-9488-48eb61385580 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:26.413343 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6656ab-0224-4d3f-9488-48eb61385580 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:26.527748 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:26.544555 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d298a492-c454-4a56-b5be-1599018c5518 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:26.578463 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6656ab-0224-4d3f-9488-48eb61385580 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:26.580503 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6656ab-0224-4d3f-9488-48eb61385580 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:26.628516 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8a569f-8fe1-4a42-99f9-c0a7947df90a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:26.629122 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a569f-8fe1-4a42-99f9-c0a7947df90a None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:26.629303 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a569f-8fe1-4a42-99f9-c0a7947df90a None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:26.629571 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a569f-8fe1-4a42-99f9-c0a7947df90a None admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:26.630238 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8a569f-8fe1-4a42-99f9-c0a7947df90a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:10:26.630534 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8a569f-8fe1-4a42-99f9-c0a7947df90a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:26.631928 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8a569f-8fe1-4a42-99f9-c0a7947df90a None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:26.654894 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 84/165] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 15 12:10:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:10:26.656559 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49017ea9-6872-422f-afb4-dbd2926c3bbb None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:26.656837 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49017ea9-6872-422f-afb4-dbd2926c3bbb None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:26.657103 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49017ea9-6872-422f-afb4-dbd2926c3bbb None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:26.670120 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 85/166] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:10:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:10:26.670955 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49017ea9-6872-422f-afb4-dbd2926c3bbb None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:26.775874 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:26.807942 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 82/167] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 15 12:10:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 674 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 12:10:26.809580 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c5992-0799-4442-9114-5a62bd5b3260 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:26.810076 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c5992-0799-4442-9114-5a62bd5b3260 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:26.810567 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c5992-0799-4442-9114-5a62bd5b3260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:26.844221 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-011c5992-0799-4442-9114-5a62bd5b3260 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:10:26.846371 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-011c5992-0799-4442-9114-5a62bd5b3260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:10:26.871012 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49017ea9-6872-422f-afb4-dbd2926c3bbb None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:26.933498 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53973646-3506-43d8-9b08-cca0c17fb009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:26.934080 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53973646-3506-43d8-9b08-cca0c17fb009 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:26.934363 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53973646-3506-43d8-9b08-cca0c17fb009 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:26.934634 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53973646-3506-43d8-9b08-cca0c17fb009 None admin] PATH_INFO: `/v3/users/b0dd68fd960b44079ef49a5f9f3b0675` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:26.935812 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53973646-3506-43d8-9b08-cca0c17fb009 None admin] RBAC: Authorizing `identity:get_user(user_id=b0dd68fd960b44079ef49a5f9f3b0675)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:26.937720 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53973646-3506-43d8-9b08-cca0c17fb009 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:26.939451 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 86/168] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 15 12:10:26 2022] GET /identity/v3/users/b0dd68fd960b44079ef49a5f9f3b0675 => generated 275 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:26.941762 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53973646-3506-43d8-9b08-cca0c17fb009 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:26.982503 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:26.991163 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 83/169] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:10:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:10:26.991862 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011c5992-0799-4442-9114-5a62bd5b3260 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:27.118196 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53973646-3506-43d8-9b08-cca0c17fb009 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:27.214841 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03ec3d9-69da-4b12-b278-aeb5c72cc212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:27.215407 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ec3d9-69da-4b12-b278-aeb5c72cc212 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:27.215681 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ec3d9-69da-4b12-b278-aeb5c72cc212 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:27.215951 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ec3d9-69da-4b12-b278-aeb5c72cc212 None admin] PATH_INFO: `/v3/projects/23903d1c5f234a8ba964a00b23864453` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:27.222272 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03ec3d9-69da-4b12-b278-aeb5c72cc212 None admin] RBAC: Authorizing `identity:get_project(project_id=23903d1c5f234a8ba964a00b23864453)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:27.223735 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03ec3d9-69da-4b12-b278-aeb5c72cc212 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:27.231580 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 87/170] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 15 12:10:26 2022] GET /identity/v3/projects/23903d1c5f234a8ba964a00b23864453 => generated 298 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:27.232470 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03ec3d9-69da-4b12-b278-aeb5c72cc212 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:27.265155 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011c5992-0799-4442-9114-5a62bd5b3260 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:27.306637 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:27.349773 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665a5976-4d92-4fe6-b9f1-48f0a0c06f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:27.350384 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a5976-4d92-4fe6-b9f1-48f0a0c06f70 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:27.350656 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a5976-4d92-4fe6-b9f1-48f0a0c06f70 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:27.352345 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a5976-4d92-4fe6-b9f1-48f0a0c06f70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:27.457850 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:27.479021 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03ec3d9-69da-4b12-b278-aeb5c72cc212 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:27.531214 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665a5976-4d92-4fe6-b9f1-48f0a0c06f70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:27.533072 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665a5976-4d92-4fe6-b9f1-48f0a0c06f70 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:27.574080 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591a9e6c-7fbd-4dde-9de5-f5d97d53395b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:27.574712 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a9e6c-7fbd-4dde-9de5-f5d97d53395b None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:27.575009 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a9e6c-7fbd-4dde-9de5-f5d97d53395b None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:27.575266 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a9e6c-7fbd-4dde-9de5-f5d97d53395b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:27.576000 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591a9e6c-7fbd-4dde-9de5-f5d97d53395b None admin] RBAC: Adding query filter params (role.id=7f53f1c823b746529ba5057bf21b2477, scope.project.id=23903d1c5f234a8ba964a00b23864453, user.id=0385d82554b5461ca05c9bdb07b4a451) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:10:27.576303 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591a9e6c-7fbd-4dde-9de5-f5d97d53395b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:27.577739 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591a9e6c-7fbd-4dde-9de5-f5d97d53395b None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:27.598747 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 88/171] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 15 12:10:27 2022] GET /identity/v3/role_assignments?user.id=0385d82554b5461ca05c9bdb07b4a451&scope.project.id=23903d1c5f234a8ba964a00b23864453&role.id=7f53f1c823b746529ba5057bf21b2477 => generated 608 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:27.598747 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591a9e6c-7fbd-4dde-9de5-f5d97d53395b None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:27.711721 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 84/172] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 15 12:10:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 720 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 12:10:27.713562 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46dd279-3854-428c-8b72-09e85ad0bb79 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:27.714051 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46dd279-3854-428c-8b72-09e85ad0bb79 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:27.714557 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46dd279-3854-428c-8b72-09e85ad0bb79 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:27.716447 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 85/173] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:10:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:10:27.723971 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46dd279-3854-428c-8b72-09e85ad0bb79 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:27.749559 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:27.877049 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591a9e6c-7fbd-4dde-9de5-f5d97d53395b None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:27.916461 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46dd279-3854-428c-8b72-09e85ad0bb79 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:27.942576 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c725246-5abe-4129-a6bc-be5db1bbc2e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:27.943239 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c725246-5abe-4129-a6bc-be5db1bbc2e2 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:27.943513 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c725246-5abe-4129-a6bc-be5db1bbc2e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:27.943783 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c725246-5abe-4129-a6bc-be5db1bbc2e2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:27.963023 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c725246-5abe-4129-a6bc-be5db1bbc2e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:10:27.968420 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-0c725246-5abe-4129-a6bc-be5db1bbc2e2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 12:10:27.968420 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:10:27.968420 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:10:27.968420 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:10:27.968420 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:10:27.968420 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:10:27.968420 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:10:27.968420 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:10:27.968420 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:10:27.968420 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:10:27.968420 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:10:27.968420 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:10:27.968420 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:10:27.968420 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:10:27.968420 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:10:27.968420 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:10:27.969366 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:10:27.969366 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:10:27.969366 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:10:27.969366 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:10:27.969366 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:10:27.969366 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:10:27.969366 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:10:27.969366 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:10:27.969366 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:10:27.969366 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:10:27.969366 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:10:27.969366 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:10:27.969366 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:10:27.969366 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:10:27.969366 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:10:27.969366 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:10:27.970740 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:10:27.970740 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:10:27.970740 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:10:27.970740 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:10:27.970740 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:10:27.970740 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:10:27.970740 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:10:27.970740 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:10:27.970740 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:10:27.970740 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:10:27.970740 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 12:10:27.970740 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:10:27.971369 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 89/174] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 15 12:10:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 375 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:10:27.979433 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f85da-d340-4b34-932e-72fca63d7934 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:27.979433 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f85da-d340-4b34-932e-72fca63d7934 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:27.979433 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f85da-d340-4b34-932e-72fca63d7934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:28.009198 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-8e4f85da-d340-4b34-932e-72fca63d7934 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:10:28.010322 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-8e4f85da-d340-4b34-932e-72fca63d7934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:10:28.027045 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:28.031398 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b479adb9-6df5-465a-83ca-436f763acac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:28.032081 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b479adb9-6df5-465a-83ca-436f763acac5 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:28.032873 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b479adb9-6df5-465a-83ca-436f763acac5 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:28.033214 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b479adb9-6df5-465a-83ca-436f763acac5 None admin] PATH_INFO: `/v3/projects/23903d1c5f234a8ba964a00b23864453` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:28.039464 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b479adb9-6df5-465a-83ca-436f763acac5 None admin] RBAC: Authorizing `identity:get_project(project_id=23903d1c5f234a8ba964a00b23864453)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:28.040975 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b479adb9-6df5-465a-83ca-436f763acac5 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:28.042905 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 86/175] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 15 12:10:27 2022] GET /identity/v3/projects/23903d1c5f234a8ba964a00b23864453 => generated 298 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:28.043438 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b479adb9-6df5-465a-83ca-436f763acac5 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:28.093119 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 90/176] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:10:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:10:28.093999 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4f85da-d340-4b34-932e-72fca63d7934 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:28.214964 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4f85da-d340-4b34-932e-72fca63d7934 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:28.220637 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:28.244351 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b479adb9-6df5-465a-83ca-436f763acac5 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:28.252532 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6b59c6-c249-4f7c-9e19-32ba25eb17ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:28.253151 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b59c6-c249-4f7c-9e19-32ba25eb17ac None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:28.253434 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b59c6-c249-4f7c-9e19-32ba25eb17ac None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:28.253762 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b59c6-c249-4f7c-9e19-32ba25eb17ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:28.254502 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6b59c6-c249-4f7c-9e19-32ba25eb17ac None admin] RBAC: Adding query filter params (role.id=19ee0f56c10b47628ba0b1c3deee4448, scope.project.id=23903d1c5f234a8ba964a00b23864453, user.id=b0dd68fd960b44079ef49a5f9f3b0675) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:10:28.254894 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6b59c6-c249-4f7c-9e19-32ba25eb17ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:28.256486 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6b59c6-c249-4f7c-9e19-32ba25eb17ac None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:28.262764 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 91/177] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 15 12:10:28 2022] GET /identity/v3/role_assignments?user.id=b0dd68fd960b44079ef49a5f9f3b0675&scope.project.id=23903d1c5f234a8ba964a00b23864453&role.id=19ee0f56c10b47628ba0b1c3deee4448 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:28.284207 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af7591d-b197-4a32-9044-a5527cb422d0 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:28.284520 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af7591d-b197-4a32-9044-a5527cb422d0 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:28.284767 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af7591d-b197-4a32-9044-a5527cb422d0 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:28.286116 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 92/178] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:10:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 12:10:28.296188 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55941f71-4cb6-4197-9843-1f1106e02a6e None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:28.296489 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55941f71-4cb6-4197-9843-1f1106e02a6e None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:28.296740 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55941f71-4cb6-4197-9843-1f1106e02a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:28.317449 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-55941f71-4cb6-4197-9843-1f1106e02a6e None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:10:28.318725 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-55941f71-4cb6-4197-9843-1f1106e02a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:10:28.319506 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9bfbea-d4e4-4583-9310-c64012759ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:28.320158 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9bfbea-d4e4-4583-9310-c64012759ec0 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:28.320441 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9bfbea-d4e4-4583-9310-c64012759ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:28.320714 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9bfbea-d4e4-4583-9310-c64012759ec0 None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:28.320974 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:28.321648 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9bfbea-d4e4-4583-9310-c64012759ec0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:10:28.321752 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9bfbea-d4e4-4583-9310-c64012759ec0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:28.323143 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9bfbea-d4e4-4583-9310-c64012759ec0 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:28.333988 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 87/179] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Sep 15 12:10:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:28.359770 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9bfbea-d4e4-4583-9310-c64012759ec0 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:28.409847 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 93/180] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:10:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 12:10:28.410988 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec7f37-5026-44b9-8572-f05cd0f68056 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:28.411278 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec7f37-5026-44b9-8572-f05cd0f68056 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:28.411606 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec7f37-5026-44b9-8572-f05cd0f68056 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:28.413365 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 94/181] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:10:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:10:28.422960 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58abec6c-b918-440b-a4a5-771c765fac8a None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:28.423276 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58abec6c-b918-440b-a4a5-771c765fac8a None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:28.423515 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58abec6c-b918-440b-a4a5-771c765fac8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:28.455423 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-58abec6c-b918-440b-a4a5-771c765fac8a None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:10:28.456635 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-58abec6c-b918-440b-a4a5-771c765fac8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:10:28.547802 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 95/182] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:10:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 12:10:28.550467 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58abec6c-b918-440b-a4a5-771c765fac8a None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:28.583910 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9bfbea-d4e4-4583-9310-c64012759ec0 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:28.624676 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:28.639138 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a060edb-ea9e-4ea6-8228-ea9395e2ef2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:28.639770 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a060edb-ea9e-4ea6-8228-ea9395e2ef2c None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:28.640098 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a060edb-ea9e-4ea6-8228-ea9395e2ef2c None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:28.640371 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a060edb-ea9e-4ea6-8228-ea9395e2ef2c None admin] PATH_INFO: `/v3/users/b0dd68fd960b44079ef49a5f9f3b0675` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:28.642282 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a060edb-ea9e-4ea6-8228-ea9395e2ef2c None admin] RBAC: Authorizing `identity:get_user(user_id=b0dd68fd960b44079ef49a5f9f3b0675)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:28.643948 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a060edb-ea9e-4ea6-8228-ea9395e2ef2c None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:28.646413 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 88/183] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 15 12:10:28 2022] GET /identity/v3/users/b0dd68fd960b44079ef49a5f9f3b0675 => generated 275 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:28.647791 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9475683-f9f8-410d-807c-b9cd144337f0 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:28.648067 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9475683-f9f8-410d-807c-b9cd144337f0 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:28.648338 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9475683-f9f8-410d-807c-b9cd144337f0 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:28.649766 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 89/184] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:10:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:10:28.655105 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9475683-f9f8-410d-807c-b9cd144337f0 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:28.672636 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58abec6c-b918-440b-a4a5-771c765fac8a None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:28.677431 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:28.716041 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c99ccdc-15ef-44c0-89dc-efe4967a2cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:28.716954 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99ccdc-15ef-44c0-89dc-efe4967a2cdd None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:28.717367 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99ccdc-15ef-44c0-89dc-efe4967a2cdd None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:28.717923 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99ccdc-15ef-44c0-89dc-efe4967a2cdd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:28.729969 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c99ccdc-15ef-44c0-89dc-efe4967a2cdd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:10:28.736052 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-0c99ccdc-15ef-44c0-89dc-efe4967a2cdd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:10:28.736052 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:10:28.736052 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:10:28.736052 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:10:28.736052 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:10:28.736052 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:10:28.736052 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:10:28.736052 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:10:28.736052 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:10:28.736052 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:10:28.736052 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:10:28.736052 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:10:28.736052 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:10:28.736052 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:10:28.736052 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:10:28.736052 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:10:28.736939 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:10:28.736939 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:10:28.736939 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:10:28.736939 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:10:28.736939 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:10:28.736939 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:10:28.736939 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:10:28.736939 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:10:28.736939 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:10:28.736939 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:10:28.736939 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:10:28.736939 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:10:28.736939 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:10:28.736939 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:10:28.736939 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:10:28.736939 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:10:28.737716 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:10:28.737716 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:10:28.737716 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:10:28.737716 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:10:28.737716 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:10:28.737716 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:10:28.737716 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:10:28.737716 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:10:28.737716 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:10:28.737716 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:10:28.737716 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:10:28.737716 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:10:28.737716 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 96/185] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Sep 15 12:10:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:10:28.738540 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15bd6fa-fb88-454f-98e4-9082247f69a2 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:28.738735 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15bd6fa-fb88-454f-98e4-9082247f69a2 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:28.739013 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15bd6fa-fb88-454f-98e4-9082247f69a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:28.762224 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-e15bd6fa-fb88-454f-98e4-9082247f69a2 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:10:28.763897 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-e15bd6fa-fb88-454f-98e4-9082247f69a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:10:28.794675 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9475683-f9f8-410d-807c-b9cd144337f0 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:28.835856 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a0c35-7f07-48e5-b68a-3eb1011b539a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:28.836552 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a0c35-7f07-48e5-b68a-3eb1011b539a None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:28.836891 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a0c35-7f07-48e5-b68a-3eb1011b539a None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:28.837285 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a0c35-7f07-48e5-b68a-3eb1011b539a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:28.844641 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 97/186] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:10:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:10:28.845825 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15bd6fa-fb88-454f-98e4-9082247f69a2 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:28.929281 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786a0c35-7f07-48e5-b68a-3eb1011b539a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:28.930381 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:28.930812 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786a0c35-7f07-48e5-b68a-3eb1011b539a None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:28.945791 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:28.981485 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15bd6fa-fb88-454f-98e4-9082247f69a2 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:29.019673 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e4f4b7-44c3-4905-a01f-36dbf5bb4f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:29.020280 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e4f4b7-44c3-4905-a01f-36dbf5bb4f9a None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:29.020557 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e4f4b7-44c3-4905-a01f-36dbf5bb4f9a None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:29.020832 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e4f4b7-44c3-4905-a01f-36dbf5bb4f9a None admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:29.021496 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e4f4b7-44c3-4905-a01f-36dbf5bb4f9a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:10:29.021912 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e4f4b7-44c3-4905-a01f-36dbf5bb4f9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:29.023515 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e4f4b7-44c3-4905-a01f-36dbf5bb4f9a None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:29.032818 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 98/187] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 15 12:10:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:29.042494 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 90/188] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 15 12:10:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 15 12:10:29.042660 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e4f4b7-44c3-4905-a01f-36dbf5bb4f9a None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:29.042767 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a0c35-7f07-48e5-b68a-3eb1011b539a None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:29.138256 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a0c35-7f07-48e5-b68a-3eb1011b539a None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:29.145757 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e4f4b7-44c3-4905-a01f-36dbf5bb4f9a None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:29.152763 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:29.166152 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:29.173517 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ecca90-c4b3-479d-ad33-374bd05e575a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:29.174136 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ecca90-c4b3-479d-ad33-374bd05e575a None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:29.174407 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ecca90-c4b3-479d-ad33-374bd05e575a None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:29.174671 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ecca90-c4b3-479d-ad33-374bd05e575a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:29.183007 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c93f88-fecd-4247-8710-e6031b1822de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:29.183645 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c93f88-fecd-4247-8710-e6031b1822de None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:29.183925 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c93f88-fecd-4247-8710-e6031b1822de None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:29.184194 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c93f88-fecd-4247-8710-e6031b1822de None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:29.185289 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ecca90-c4b3-479d-ad33-374bd05e575a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:10:29.190812 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-c8ecca90-c4b3-479d-ad33-374bd05e575a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 12:10:29.190812 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:10:29.190812 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:10:29.190812 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:10:29.190812 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:10:29.190812 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:10:29.190812 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:10:29.190812 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:10:29.190812 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:10:29.190812 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:10:29.190812 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:10:29.190812 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:10:29.190812 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:10:29.190812 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:10:29.190812 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:10:29.190812 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:10:29.191689 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:10:29.191689 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:10:29.191689 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:10:29.191689 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:10:29.191689 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:10:29.191689 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:10:29.191689 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:10:29.191689 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:10:29.191689 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:10:29.191689 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:10:29.191689 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:10:29.191689 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:10:29.191689 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:10:29.191689 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:10:29.191689 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:10:29.191689 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:10:29.192482 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:10:29.192482 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:10:29.192482 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:10:29.192482 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:10:29.192482 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:10:29.192482 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:10:29.192482 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:10:29.192482 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:10:29.192482 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:10:29.192482 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:10:29.192482 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 12:10:29.192482 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:10:29.192482 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 91/189] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Sep 15 12:10:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:10:29.193155 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ecca90-c4b3-479d-ad33-374bd05e575a None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:29.199701 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c93f88-fecd-4247-8710-e6031b1822de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:10:29.205003 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-d7c93f88-fecd-4247-8710-e6031b1822de None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 12:10:29.205003 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:10:29.205003 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:10:29.205003 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:10:29.205003 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:10:29.205003 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:10:29.205003 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:10:29.205003 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:10:29.205003 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:10:29.205003 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:10:29.205003 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:10:29.205003 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:10:29.205003 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:10:29.205003 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:10:29.205003 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:10:29.205003 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:10:29.206077 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:10:29.206077 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:10:29.206077 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:10:29.206077 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:10:29.206077 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:10:29.206077 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:10:29.206077 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:10:29.206077 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:10:29.206077 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:10:29.206077 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:10:29.206077 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:10:29.206077 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:10:29.206077 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:10:29.206077 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:10:29.206077 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:10:29.206077 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:10:29.207123 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:10:29.207123 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:10:29.207123 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:10:29.207123 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:10:29.207123 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:10:29.207123 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:10:29.207123 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:10:29.207123 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:10:29.207123 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:10:29.207123 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:10:29.207123 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 12:10:29.207123 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:10:29.207123 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 99/190] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 15 12:10:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:10:29.207924 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c93f88-fecd-4247-8710-e6031b1822de None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:29.304251 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ecca90-c4b3-479d-ad33-374bd05e575a None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:29.306893 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c93f88-fecd-4247-8710-e6031b1822de None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:29.336899 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73fc01b-47b7-444b-9392-84ec856d1b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:29.337522 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73fc01b-47b7-444b-9392-84ec856d1b4d None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:29.337798 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73fc01b-47b7-444b-9392-84ec856d1b4d None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:29.338067 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73fc01b-47b7-444b-9392-84ec856d1b4d None admin] PATH_INFO: `/v3/users/ef54996bfb7d4e548ec01a8948ea49b8` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:29.339773 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183f0419-bf4c-4913-9856-556299cd477c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:29.340384 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f0419-bf4c-4913-9856-556299cd477c None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:29.340663 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f0419-bf4c-4913-9856-556299cd477c None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:29.340934 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f0419-bf4c-4913-9856-556299cd477c None admin] PATH_INFO: `/v3/projects/78241f1452694570bd17703ff5866deb` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:29.342051 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183f0419-bf4c-4913-9856-556299cd477c None admin] RBAC: Authorizing `identity:get_project(project_id=78241f1452694570bd17703ff5866deb)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:29.343512 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183f0419-bf4c-4913-9856-556299cd477c None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:29.345612 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 100/191] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 15 12:10:29 2022] GET /identity/v3/projects/78241f1452694570bd17703ff5866deb => generated 312 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:29.346366 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183f0419-bf4c-4913-9856-556299cd477c None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:29.356696 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73fc01b-47b7-444b-9392-84ec856d1b4d None admin] RBAC: Authorizing `identity:get_user(user_id=ef54996bfb7d4e548ec01a8948ea49b8)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:29.358167 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73fc01b-47b7-444b-9392-84ec856d1b4d None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:29.359949 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 92/192] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 15 12:10:29 2022] GET /identity/v3/users/ef54996bfb7d4e548ec01a8948ea49b8 => generated 283 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:29.361243 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73fc01b-47b7-444b-9392-84ec856d1b4d None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:29.390812 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:29.399839 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:29.449691 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183f0419-bf4c-4913-9856-556299cd477c None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:29.456707 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73fc01b-47b7-444b-9392-84ec856d1b4d None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:29.482797 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1e7a8d-8146-4de1-ba7b-87f7428219d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:29.483418 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1e7a8d-8146-4de1-ba7b-87f7428219d9 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:29.483687 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1e7a8d-8146-4de1-ba7b-87f7428219d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:29.483950 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1e7a8d-8146-4de1-ba7b-87f7428219d9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:29.485156 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1e7a8d-8146-4de1-ba7b-87f7428219d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:29.487235 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1e7a8d-8146-4de1-ba7b-87f7428219d9 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:29.488791 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 101/193] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:10:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:29.489537 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1e7a8d-8146-4de1-ba7b-87f7428219d9 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:29.492376 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a958c4f3-cc48-4b1d-a3f9-de2dbd683e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:29.493737 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a958c4f3-cc48-4b1d-a3f9-de2dbd683e88 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:29.494023 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a958c4f3-cc48-4b1d-a3f9-de2dbd683e88 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:29.494295 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a958c4f3-cc48-4b1d-a3f9-de2dbd683e88 None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:29.494995 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a958c4f3-cc48-4b1d-a3f9-de2dbd683e88 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:10:29.495299 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a958c4f3-cc48-4b1d-a3f9-de2dbd683e88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:29.496666 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a958c4f3-cc48-4b1d-a3f9-de2dbd683e88 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:29.505763 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 93/194] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 15 12:10:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:29.506294 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a958c4f3-cc48-4b1d-a3f9-de2dbd683e88 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:29.595419 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1e7a8d-8146-4de1-ba7b-87f7428219d9 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:29.602629 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:29.609611 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a958c4f3-cc48-4b1d-a3f9-de2dbd683e88 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:29.611342 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:29.628831 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8d2feb-63c2-4875-8b54-7de9c8a641e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:29.629431 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d2feb-63c2-4875-8b54-7de9c8a641e3 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:29.629707 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d2feb-63c2-4875-8b54-7de9c8a641e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:29.629974 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d2feb-63c2-4875-8b54-7de9c8a641e3 None admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:29.630634 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8d2feb-63c2-4875-8b54-7de9c8a641e3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:10:29.630972 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8d2feb-63c2-4875-8b54-7de9c8a641e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:29.632358 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8d2feb-63c2-4875-8b54-7de9c8a641e3 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:29.640215 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 102/195] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Sep 15 12:10:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:29.641043 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8d2feb-63c2-4875-8b54-7de9c8a641e3 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:29.644685 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d193a65b-5cfa-4f04-a15b-a17419f721dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:29.645296 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d193a65b-5cfa-4f04-a15b-a17419f721dd None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:29.645577 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d193a65b-5cfa-4f04-a15b-a17419f721dd None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:29.645841 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d193a65b-5cfa-4f04-a15b-a17419f721dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:29.646557 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d193a65b-5cfa-4f04-a15b-a17419f721dd None admin] RBAC: Adding query filter params (role.id=9371e5bbc55848949eb951a815f817f2, scope.project.id=78241f1452694570bd17703ff5866deb, user.id=b0dd68fd960b44079ef49a5f9f3b0675) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:10:29.646905 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d193a65b-5cfa-4f04-a15b-a17419f721dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:29.648324 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d193a65b-5cfa-4f04-a15b-a17419f721dd None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:29.654177 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 94/196] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 15 12:10:29 2022] GET /identity/v3/role_assignments?user.id=b0dd68fd960b44079ef49a5f9f3b0675&scope.project.id=78241f1452694570bd17703ff5866deb&role.id=9371e5bbc55848949eb951a815f817f2 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:29.654794 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d193a65b-5cfa-4f04-a15b-a17419f721dd None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:29.755745 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8d2feb-63c2-4875-8b54-7de9c8a641e3 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:29.768819 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d193a65b-5cfa-4f04-a15b-a17419f721dd None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:29.795465 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f25213-8472-44ba-9ad9-966f3d9abf4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:29.796341 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f25213-8472-44ba-9ad9-966f3d9abf4c None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:29.796620 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f25213-8472-44ba-9ad9-966f3d9abf4c None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:29.797001 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f25213-8472-44ba-9ad9-966f3d9abf4c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:29.805369 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e3c78a-2290-4f9a-829f-b544ba4fe94d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:29.805995 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e3c78a-2290-4f9a-829f-b544ba4fe94d None admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:29.806273 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e3c78a-2290-4f9a-829f-b544ba4fe94d None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:29.806542 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e3c78a-2290-4f9a-829f-b544ba4fe94d None admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:29.807242 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e3c78a-2290-4f9a-829f-b544ba4fe94d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:29.808730 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e3c78a-2290-4f9a-829f-b544ba4fe94d None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:29.838046 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 95/197] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Sep 15 12:10:29 2022] POST /identity/v3/users => generated 297 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:10:29.839802 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e3c78a-2290-4f9a-829f-b544ba4fe94d None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:29.858300 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:29.873814 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:29.887257 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f25213-8472-44ba-9ad9-966f3d9abf4c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:29.889289 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f25213-8472-44ba-9ad9-966f3d9abf4c None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:29.995796 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e3c78a-2290-4f9a-829f-b544ba4fe94d None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:30.032603 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 103/198] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 15 12:10:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 12:10:30.034256 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f25213-8472-44ba-9ad9-966f3d9abf4c None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:30.043005 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dcf3e0-f161-402d-ae3d-3b7a45eba086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:30.043655 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dcf3e0-f161-402d-ae3d-3b7a45eba086 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:30.044040 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dcf3e0-f161-402d-ae3d-3b7a45eba086 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:30.044309 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dcf3e0-f161-402d-ae3d-3b7a45eba086 None admin] PATH_INFO: `/v3/users/ef54996bfb7d4e548ec01a8948ea49b8` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:30.045447 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dcf3e0-f161-402d-ae3d-3b7a45eba086 None admin] RBAC: Authorizing `identity:get_user(user_id=ef54996bfb7d4e548ec01a8948ea49b8)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:30.047068 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dcf3e0-f161-402d-ae3d-3b7a45eba086 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:30.048689 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 96/199] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 15 12:10:29 2022] GET /identity/v3/users/ef54996bfb7d4e548ec01a8948ea49b8 => generated 283 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:30.049433 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dcf3e0-f161-402d-ae3d-3b7a45eba086 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:30.123201 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:30.148943 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:30.159468 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f25213-8472-44ba-9ad9-966f3d9abf4c None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:30.175485 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dcf3e0-f161-402d-ae3d-3b7a45eba086 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:30.205032 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091872b7-cee8-4b6c-9fba-c8dd3ecc9e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:30.205985 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091872b7-cee8-4b6c-9fba-c8dd3ecc9e02 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:30.206427 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091872b7-cee8-4b6c-9fba-c8dd3ecc9e02 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:30.206718 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091872b7-cee8-4b6c-9fba-c8dd3ecc9e02 None admin] PATH_INFO: `/v3/users/f42e14b9dced4ff6a25a81848413c849` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:30.207863 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091872b7-cee8-4b6c-9fba-c8dd3ecc9e02 None admin] RBAC: Authorizing `identity:get_user(user_id=f42e14b9dced4ff6a25a81848413c849)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:30.209287 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091872b7-cee8-4b6c-9fba-c8dd3ecc9e02 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:30.211341 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 104/200] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 15 12:10:30 2022] GET /identity/v3/users/f42e14b9dced4ff6a25a81848413c849 => generated 289 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:30.211674 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091872b7-cee8-4b6c-9fba-c8dd3ecc9e02 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:30.219929 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103357ae-f67b-4b03-86cc-04e951d42ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:30.220492 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103357ae-f67b-4b03-86cc-04e951d42ec7 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:30.220772 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103357ae-f67b-4b03-86cc-04e951d42ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:30.221042 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103357ae-f67b-4b03-86cc-04e951d42ec7 None admin] PATH_INFO: `/v3/projects/dd97fe3d09654c728d99e82d47ef59a5` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:30.222255 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103357ae-f67b-4b03-86cc-04e951d42ec7 None admin] RBAC: Authorizing `identity:get_project(project_id=dd97fe3d09654c728d99e82d47ef59a5)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:30.224418 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103357ae-f67b-4b03-86cc-04e951d42ec7 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:30.227028 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 97/201] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 15 12:10:30 2022] GET /identity/v3/projects/dd97fe3d09654c728d99e82d47ef59a5 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:30.228184 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103357ae-f67b-4b03-86cc-04e951d42ec7 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:30.319159 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091872b7-cee8-4b6c-9fba-c8dd3ecc9e02 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:30.360917 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dab4a5-fc1c-4153-a154-a326cb45ee61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:30.361532 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dab4a5-fc1c-4153-a154-a326cb45ee61 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:30.361814 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dab4a5-fc1c-4153-a154-a326cb45ee61 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:30.362088 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dab4a5-fc1c-4153-a154-a326cb45ee61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:30.363397 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103357ae-f67b-4b03-86cc-04e951d42ec7 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:30.384343 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:30.400693 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2947e396-7fc5-4b6a-aad6-07baa4bc1c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:30.401633 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2947e396-7fc5-4b6a-aad6-07baa4bc1c3d None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:30.402101 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2947e396-7fc5-4b6a-aad6-07baa4bc1c3d None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:30.402559 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2947e396-7fc5-4b6a-aad6-07baa4bc1c3d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:30.423377 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:30.460497 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dab4a5-fc1c-4153-a154-a326cb45ee61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:30.462091 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dab4a5-fc1c-4153-a154-a326cb45ee61 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:30.496103 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2947e396-7fc5-4b6a-aad6-07baa4bc1c3d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:30.498865 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2947e396-7fc5-4b6a-aad6-07baa4bc1c3d None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:30.567552 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 105/202] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 15 12:10:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 12:10:30.568221 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dab4a5-fc1c-4153-a154-a326cb45ee61 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:30.620809 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:30.636602 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 98/203] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 15 12:10:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 12:10:30.637818 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2947e396-7fc5-4b6a-aad6-07baa4bc1c3d None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:30.683569 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dab4a5-fc1c-4153-a154-a326cb45ee61 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:30.708460 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:30.723978 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014dc694-73df-42b4-908a-5b90db1152e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:30.725101 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014dc694-73df-42b4-908a-5b90db1152e0 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:30.725474 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014dc694-73df-42b4-908a-5b90db1152e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:30.725844 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014dc694-73df-42b4-908a-5b90db1152e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:30.726680 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014dc694-73df-42b4-908a-5b90db1152e0 None admin] RBAC: Adding query filter params (role.id=7f53f1c823b746529ba5057bf21b2477, scope.project.id=dd97fe3d09654c728d99e82d47ef59a5, user.id=ef54996bfb7d4e548ec01a8948ea49b8) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:10:30.727127 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014dc694-73df-42b4-908a-5b90db1152e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:30.728670 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014dc694-73df-42b4-908a-5b90db1152e0 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:30.736648 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 106/204] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 15 12:10:30 2022] GET /identity/v3/role_assignments?user.id=ef54996bfb7d4e548ec01a8948ea49b8&scope.project.id=dd97fe3d09654c728d99e82d47ef59a5&role.id=7f53f1c823b746529ba5057bf21b2477 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:30.737416 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014dc694-73df-42b4-908a-5b90db1152e0 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:30.782744 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2947e396-7fc5-4b6a-aad6-07baa4bc1c3d None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:30.857029 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db008adb-9bd4-4433-beec-46ca1be58388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:30.857687 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db008adb-9bd4-4433-beec-46ca1be58388 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:30.857965 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db008adb-9bd4-4433-beec-46ca1be58388 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:30.858236 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db008adb-9bd4-4433-beec-46ca1be58388 None admin] PATH_INFO: `/v3/projects/dd97fe3d09654c728d99e82d47ef59a5` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:30.859638 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db008adb-9bd4-4433-beec-46ca1be58388 None admin] RBAC: Authorizing `identity:get_project(project_id=dd97fe3d09654c728d99e82d47ef59a5)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:30.861171 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db008adb-9bd4-4433-beec-46ca1be58388 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:30.864405 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 99/205] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 15 12:10:30 2022] GET /identity/v3/projects/dd97fe3d09654c728d99e82d47ef59a5 => generated 302 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:30.870166 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db008adb-9bd4-4433-beec-46ca1be58388 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:30.935709 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014dc694-73df-42b4-908a-5b90db1152e0 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:30.960820 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:30.994415 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d8fab5-a962-4e01-927f-dbf363a78c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:30.995581 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d8fab5-a962-4e01-927f-dbf363a78c67 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:30.996121 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d8fab5-a962-4e01-927f-dbf363a78c67 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:30.996583 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d8fab5-a962-4e01-927f-dbf363a78c67 None admin] PATH_INFO: `/v3/projects/23903d1c5f234a8ba964a00b23864453` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:30.997897 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d8fab5-a962-4e01-927f-dbf363a78c67 None admin] RBAC: Authorizing `identity:get_project(project_id=23903d1c5f234a8ba964a00b23864453)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:30.999552 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d8fab5-a962-4e01-927f-dbf363a78c67 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:31.002252 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 107/206] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 15 12:10:30 2022] GET /identity/v3/projects/23903d1c5f234a8ba964a00b23864453 => generated 298 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:31.008244 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d8fab5-a962-4e01-927f-dbf363a78c67 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:31.042542 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db008adb-9bd4-4433-beec-46ca1be58388 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:31.071805 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:31.101091 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a26233d-9af3-477f-b897-507c1aa45e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:31.101706 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a26233d-9af3-477f-b897-507c1aa45e79 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:31.101989 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a26233d-9af3-477f-b897-507c1aa45e79 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:31.102298 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a26233d-9af3-477f-b897-507c1aa45e79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:31.103066 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a26233d-9af3-477f-b897-507c1aa45e79 None admin] RBAC: Adding query filter params (role.id=19ee0f56c10b47628ba0b1c3deee4448, scope.project.id=dd97fe3d09654c728d99e82d47ef59a5, user.id=ef54996bfb7d4e548ec01a8948ea49b8) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:10:31.103374 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a26233d-9af3-477f-b897-507c1aa45e79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:31.104985 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a26233d-9af3-477f-b897-507c1aa45e79 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:31.115855 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 100/207] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 15 12:10:30 2022] GET /identity/v3/role_assignments?user.id=ef54996bfb7d4e548ec01a8948ea49b8&scope.project.id=dd97fe3d09654c728d99e82d47ef59a5&role.id=19ee0f56c10b47628ba0b1c3deee4448 => generated 259 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:10:31.117303 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d8fab5-a962-4e01-927f-dbf363a78c67 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:31.154781 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9641fb-ca9a-474a-8798-805c78248fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:31.155776 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9641fb-ca9a-474a-8798-805c78248fa7 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:31.156252 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9641fb-ca9a-474a-8798-805c78248fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:31.156712 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9641fb-ca9a-474a-8798-805c78248fa7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:31.157707 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9641fb-ca9a-474a-8798-805c78248fa7 None admin] RBAC: Adding query filter params (role.id=da591cd17baa4d009b74f6facf2a6688, scope.project.id=23903d1c5f234a8ba964a00b23864453, user.id=f42e14b9dced4ff6a25a81848413c849) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:10:31.158220 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9641fb-ca9a-474a-8798-805c78248fa7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:31.159915 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9641fb-ca9a-474a-8798-805c78248fa7 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:31.167147 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 108/208] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 15 12:10:31 2022] GET /identity/v3/role_assignments?user.id=f42e14b9dced4ff6a25a81848413c849&scope.project.id=23903d1c5f234a8ba964a00b23864453&role.id=da591cd17baa4d009b74f6facf2a6688 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:32.225278 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79815196-408c-43f1-8d18-41fa1ee55d23 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:32.225775 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79815196-408c-43f1-8d18-41fa1ee55d23 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:32.225775 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79815196-408c-43f1-8d18-41fa1ee55d23 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:32.227163 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 101/209] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:10:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:10:32.233133 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3170861d-13c7-49a7-b5ee-bc3726756ea4 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:32.233638 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3170861d-13c7-49a7-b5ee-bc3726756ea4 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:32.233638 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3170861d-13c7-49a7-b5ee-bc3726756ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:32.252832 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-3170861d-13c7-49a7-b5ee-bc3726756ea4 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:10:32.254009 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-3170861d-13c7-49a7-b5ee-bc3726756ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:10:32.289302 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:32.321492 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 109/210] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:10:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:10:32.348210 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c3494-b630-4ec2-8091-315e11ffa906 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:32.348508 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c3494-b630-4ec2-8091-315e11ffa906 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:32.348750 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c3494-b630-4ec2-8091-315e11ffa906 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:32.350244 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 102/211] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:10:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:10:32.355928 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ce1a5-160d-4a4e-9e74-b7130d7b3a4c None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:32.356212 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ce1a5-160d-4a4e-9e74-b7130d7b3a4c None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:32.356481 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ce1a5-160d-4a4e-9e74-b7130d7b3a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:32.375176 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-0d0ce1a5-160d-4a4e-9e74-b7130d7b3a4c None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:10:32.376613 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-0d0ce1a5-160d-4a4e-9e74-b7130d7b3a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:10:32.443052 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 110/212] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:10:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:10:32.611793 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0c3494-b630-4ec2-8091-315e11ffa906 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:32.712508 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0ce1a5-160d-4a4e-9e74-b7130d7b3a4c None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:32.716950 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0c3494-b630-4ec2-8091-315e11ffa906 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:32.753946 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f70194-d19f-4908-88c7-deae6864561a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:32.754586 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f70194-d19f-4908-88c7-deae6864561a None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:32.754893 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f70194-d19f-4908-88c7-deae6864561a None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:32.755165 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f70194-d19f-4908-88c7-deae6864561a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:32.756278 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f70194-d19f-4908-88c7-deae6864561a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:32.757730 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f70194-d19f-4908-88c7-deae6864561a None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:32.759607 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 103/213] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:10:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:32.764714 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f70194-d19f-4908-88c7-deae6864561a None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:32.824815 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:32.826866 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0ce1a5-160d-4a4e-9e74-b7130d7b3a4c None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:32.830390 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:32.872452 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef31300-7f00-49f6-8257-0683351bce7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:32.873814 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef31300-7f00-49f6-8257-0683351bce7c None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:32.874285 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef31300-7f00-49f6-8257-0683351bce7c None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:32.874817 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef31300-7f00-49f6-8257-0683351bce7c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:32.888192 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef31300-7f00-49f6-8257-0683351bce7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:10:32.890621 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f70194-d19f-4908-88c7-deae6864561a None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:32.895220 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-8ef31300-7f00-49f6-8257-0683351bce7c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 12:10:32.895220 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:10:32.895220 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:10:32.895220 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:10:32.895220 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:10:32.895220 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:10:32.895220 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:10:32.895220 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:10:32.895220 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:10:32.895220 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:10:32.895220 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:10:32.895220 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:10:32.895220 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:10:32.895220 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:10:32.895220 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:10:32.895220 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:10:32.896084 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:10:32.896084 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:10:32.896084 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:10:32.896084 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:10:32.896084 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:10:32.896084 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:10:32.896084 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:10:32.896084 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:10:32.896084 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:10:32.896084 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:10:32.896084 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:10:32.896084 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:10:32.896084 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:10:32.896084 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:10:32.896084 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:10:32.896084 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:10:32.896867 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:10:32.896867 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:10:32.896867 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:10:32.896867 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:10:32.896867 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:10:32.896867 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:10:32.896867 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:10:32.896867 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:10:32.896867 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:10:32.896867 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:10:32.896867 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 12:10:32.896867 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:10:32.904553 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 111/214] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 15 12:10:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:10:32.906350 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef31300-7f00-49f6-8257-0683351bce7c None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:32.932637 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de6b929-b352-4238-8929-e331bbf673bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:32.933581 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de6b929-b352-4238-8929-e331bbf673bf None admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:32.934052 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de6b929-b352-4238-8929-e331bbf673bf None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:32.934517 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de6b929-b352-4238-8929-e331bbf673bf None admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:32.935413 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de6b929-b352-4238-8929-e331bbf673bf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:32.937036 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de6b929-b352-4238-8929-e331bbf673bf None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:32.967146 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 104/215] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Sep 15 12:10:32 2022] POST /identity/v3/users => generated 297 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 12:10:33.028235 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef31300-7f00-49f6-8257-0683351bce7c None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:33.070207 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fab385d-bde9-4aac-94e7-9dcceb0cf4cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:33.071241 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab385d-bde9-4aac-94e7-9dcceb0cf4cd None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:33.071747 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab385d-bde9-4aac-94e7-9dcceb0cf4cd None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:33.072276 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab385d-bde9-4aac-94e7-9dcceb0cf4cd None admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:33.073172 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fab385d-bde9-4aac-94e7-9dcceb0cf4cd None admin] RBAC: Adding query filter params (name=member) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:10:33.073692 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fab385d-bde9-4aac-94e7-9dcceb0cf4cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:33.075334 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fab385d-bde9-4aac-94e7-9dcceb0cf4cd None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:33.086035 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 112/216] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Sep 15 12:10:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:33.092327 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de6b929-b352-4238-8929-e331bbf673bf None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:33.205928 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de6b929-b352-4238-8929-e331bbf673bf None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:33.213808 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:33.247893 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65ba3a3-7e47-479c-95bb-fe2f67c26757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:33.248625 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65ba3a3-7e47-479c-95bb-fe2f67c26757 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:33.248804 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65ba3a3-7e47-479c-95bb-fe2f67c26757 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:33.249063 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65ba3a3-7e47-479c-95bb-fe2f67c26757 None admin] PATH_INFO: `/v3/users/ed3b2819298a4d2f8a4d571594754f38` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:33.254908 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e885ea-9412-4af7-9796-3a34576d1c65 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:33.255323 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e885ea-9412-4af7-9796-3a34576d1c65 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:33.255490 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e885ea-9412-4af7-9796-3a34576d1c65 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:33.256906 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 113/217] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:10:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 12:10:33.266072 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65ba3a3-7e47-479c-95bb-fe2f67c26757 None admin] RBAC: Authorizing `identity:get_user(user_id=ed3b2819298a4d2f8a4d571594754f38)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:33.267349 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a870162-7e92-4345-8eeb-80b7c189a45d None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:33.267629 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a870162-7e92-4345-8eeb-80b7c189a45d None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:33.267898 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a870162-7e92-4345-8eeb-80b7c189a45d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:33.268130 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65ba3a3-7e47-479c-95bb-fe2f67c26757 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:33.269921 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 105/218] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 15 12:10:33 2022] GET /identity/v3/users/ed3b2819298a4d2f8a4d571594754f38 => generated 297 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:33.275792 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65ba3a3-7e47-479c-95bb-fe2f67c26757 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:33.293595 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-3a870162-7e92-4345-8eeb-80b7c189a45d None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:10:33.294829 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-3a870162-7e92-4345-8eeb-80b7c189a45d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:10:33.317214 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:33.387065 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 114/219] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:10:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:10:33.404891 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65ba3a3-7e47-479c-95bb-fe2f67c26757 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:33.441607 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdaeefe-d132-4215-8f0a-ae16d19a58b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:33.442597 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdaeefe-d132-4215-8f0a-ae16d19a58b2 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:33.443120 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdaeefe-d132-4215-8f0a-ae16d19a58b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:33.443588 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdaeefe-d132-4215-8f0a-ae16d19a58b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:33.476017 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:33.483939 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90405a50-1605-4eb2-8e50-b94cc8ef49a3 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:33.484232 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90405a50-1605-4eb2-8e50-b94cc8ef49a3 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:33.484495 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90405a50-1605-4eb2-8e50-b94cc8ef49a3 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:33.486482 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 115/220] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:10:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:10:33.495316 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe1bf19-52d1-4231-a17a-d9ec4a7432f7 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:33.495841 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe1bf19-52d1-4231-a17a-d9ec4a7432f7 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:33.496126 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe1bf19-52d1-4231-a17a-d9ec4a7432f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:33.520776 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdaeefe-d132-4215-8f0a-ae16d19a58b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:33.522256 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdaeefe-d132-4215-8f0a-ae16d19a58b2 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:33.522434 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-ffe1bf19-52d1-4231-a17a-d9ec4a7432f7 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:10:33.523680 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-ffe1bf19-52d1-4231-a17a-d9ec4a7432f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:10:33.619027 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 116/221] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:10:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:10:33.644040 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 106/222] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 15 12:10:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 12:10:33.649596 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe1bf19-52d1-4231-a17a-d9ec4a7432f7 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:33.683760 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdaeefe-d132-4215-8f0a-ae16d19a58b2 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:33.741324 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:33.758887 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe1bf19-52d1-4231-a17a-d9ec4a7432f7 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:33.794616 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780447cf-5544-4ed8-8cbc-cde02b71453c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:33.795280 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780447cf-5544-4ed8-8cbc-cde02b71453c None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:33.795559 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780447cf-5544-4ed8-8cbc-cde02b71453c None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:33.795830 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780447cf-5544-4ed8-8cbc-cde02b71453c None admin] PATH_INFO: `/v3/projects/dd97fe3d09654c728d99e82d47ef59a5` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:33.796956 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780447cf-5544-4ed8-8cbc-cde02b71453c None admin] RBAC: Authorizing `identity:get_project(project_id=dd97fe3d09654c728d99e82d47ef59a5)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:33.798988 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780447cf-5544-4ed8-8cbc-cde02b71453c None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:33.800948 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 117/223] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 15 12:10:33 2022] GET /identity/v3/projects/dd97fe3d09654c728d99e82d47ef59a5 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:33.805621 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:33.806371 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780447cf-5544-4ed8-8cbc-cde02b71453c None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:33.884870 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdaeefe-d132-4215-8f0a-ae16d19a58b2 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:33.944406 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780447cf-5544-4ed8-8cbc-cde02b71453c None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:33.961357 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392aa163-dcdc-44f8-8d65-a8329a803021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:33.962329 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392aa163-dcdc-44f8-8d65-a8329a803021 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:33.962840 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392aa163-dcdc-44f8-8d65-a8329a803021 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:33.963303 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392aa163-dcdc-44f8-8d65-a8329a803021 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:33.983708 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99af326a-07b5-4e56-b9db-d9ddf5398f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:33.984323 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af326a-07b5-4e56-b9db-d9ddf5398f5b None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:33.984601 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af326a-07b5-4e56-b9db-d9ddf5398f5b None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:33.984869 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af326a-07b5-4e56-b9db-d9ddf5398f5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:33.986160 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99af326a-07b5-4e56-b9db-d9ddf5398f5b None admin] RBAC: Adding query filter params (role.id=9371e5bbc55848949eb951a815f817f2, scope.project.id=dd97fe3d09654c728d99e82d47ef59a5, user.id=ed3b2819298a4d2f8a4d571594754f38) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:10:33.986463 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99af326a-07b5-4e56-b9db-d9ddf5398f5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:33.988021 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99af326a-07b5-4e56-b9db-d9ddf5398f5b None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:33.993998 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 118/224] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 15 12:10:33 2022] GET /identity/v3/role_assignments?user.id=ed3b2819298a4d2f8a4d571594754f38&scope.project.id=dd97fe3d09654c728d99e82d47ef59a5&role.id=9371e5bbc55848949eb951a815f817f2 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:10:34.008096 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392aa163-dcdc-44f8-8d65-a8329a803021 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:10:34.012951 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99af326a-07b5-4e56-b9db-d9ddf5398f5b None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:34.013278 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-392aa163-dcdc-44f8-8d65-a8329a803021 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:10:34.013278 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:10:34.013278 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:10:34.013278 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:10:34.013278 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:10:34.013278 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:10:34.013278 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:10:34.013278 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:10:34.013278 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:10:34.013278 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:10:34.013278 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:10:34.013278 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:10:34.013278 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:10:34.013278 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:10:34.013278 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:10:34.013278 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:10:34.014121 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:10:34.014121 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:10:34.014121 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:10:34.014121 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:10:34.014121 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:10:34.014121 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:10:34.014121 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:10:34.014121 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:10:34.014121 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:10:34.014121 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:10:34.014121 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:10:34.014121 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:10:34.014121 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:10:34.014121 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:10:34.014121 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:10:34.014121 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:10:34.015308 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:10:34.015308 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:10:34.015308 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:10:34.015308 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:10:34.015308 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:10:34.015308 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:10:34.015308 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:10:34.015308 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:10:34.015308 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:10:34.015308 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:10:34.015308 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:10:34.015308 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:10:34.015308 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 107/225] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Sep 15 12:10:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:10:34.020147 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392aa163-dcdc-44f8-8d65-a8329a803021 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:34.057967 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:34.185053 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392aa163-dcdc-44f8-8d65-a8329a803021 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:34.213662 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:34.232942 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b95eec7-dddc-4aaf-8615-0363eb319755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:34.233560 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95eec7-dddc-4aaf-8615-0363eb319755 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:34.233837 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95eec7-dddc-4aaf-8615-0363eb319755 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:34.234107 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95eec7-dddc-4aaf-8615-0363eb319755 None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:34.235364 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b95eec7-dddc-4aaf-8615-0363eb319755 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:10:34.235364 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b95eec7-dddc-4aaf-8615-0363eb319755 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:34.236686 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b95eec7-dddc-4aaf-8615-0363eb319755 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:34.248094 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99af326a-07b5-4e56-b9db-d9ddf5398f5b None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:34.249272 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 108/226] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 15 12:10:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:34.255012 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b95eec7-dddc-4aaf-8615-0363eb319755 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:34.321304 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42aabe7-f178-4b95-aad6-f1de9a62f8c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:34.322093 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42aabe7-f178-4b95-aad6-f1de9a62f8c7 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:34.322495 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42aabe7-f178-4b95-aad6-f1de9a62f8c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:34.322900 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42aabe7-f178-4b95-aad6-f1de9a62f8c7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:34.335299 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42aabe7-f178-4b95-aad6-f1de9a62f8c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:10:34.341581 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-b42aabe7-f178-4b95-aad6-f1de9a62f8c7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 12:10:34.341581 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:10:34.341581 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:10:34.341581 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:10:34.341581 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:10:34.341581 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:10:34.341581 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:10:34.341581 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:10:34.341581 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:10:34.341581 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:10:34.341581 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:10:34.341581 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:10:34.341581 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:10:34.341581 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:10:34.341581 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:10:34.341581 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:10:34.342486 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:10:34.342486 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:10:34.342486 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:10:34.342486 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:10:34.342486 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:10:34.342486 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:10:34.342486 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:10:34.342486 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:10:34.342486 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:10:34.342486 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:10:34.342486 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:10:34.342486 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:10:34.342486 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:10:34.342486 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:10:34.342486 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:10:34.342486 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:10:34.343296 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:10:34.343296 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:10:34.343296 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:10:34.343296 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:10:34.343296 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:10:34.343296 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:10:34.343296 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:10:34.343296 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:10:34.343296 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:10:34.343296 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:10:34.343296 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 12:10:34.343296 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:10:34.343296 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 119/227] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Sep 15 12:10:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:10:34.351296 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42aabe7-f178-4b95-aad6-f1de9a62f8c7 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:34.425027 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b95eec7-dddc-4aaf-8615-0363eb319755 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:34.479065 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:34.497727 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42aabe7-f178-4b95-aad6-f1de9a62f8c7 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:34.533328 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd831d0-e1b4-452c-b480-a841db7584d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:34.534028 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd831d0-e1b4-452c-b480-a841db7584d5 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:34.534404 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd831d0-e1b4-452c-b480-a841db7584d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:34.534831 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd831d0-e1b4-452c-b480-a841db7584d5 None admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:34.535705 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd831d0-e1b4-452c-b480-a841db7584d5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:10:34.536109 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd831d0-e1b4-452c-b480-a841db7584d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:34.537589 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd831d0-e1b4-452c-b480-a841db7584d5 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:34.550762 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 120/228] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 15 12:10:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:34.552085 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd831d0-e1b4-452c-b480-a841db7584d5 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:34.555445 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb1e0f7-b161-43d0-8bea-0362544b900a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:34.557934 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb1e0f7-b161-43d0-8bea-0362544b900a None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:34.557934 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb1e0f7-b161-43d0-8bea-0362544b900a None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:34.557934 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb1e0f7-b161-43d0-8bea-0362544b900a None admin] PATH_INFO: `/v3/users/ef54996bfb7d4e548ec01a8948ea49b8` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:34.564498 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb1e0f7-b161-43d0-8bea-0362544b900a None admin] RBAC: Authorizing `identity:get_user(user_id=ef54996bfb7d4e548ec01a8948ea49b8)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:34.567323 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb1e0f7-b161-43d0-8bea-0362544b900a None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:34.569174 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 109/229] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 15 12:10:34 2022] GET /identity/v3/users/ef54996bfb7d4e548ec01a8948ea49b8 => generated 283 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:34.577149 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb1e0f7-b161-43d0-8bea-0362544b900a None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:34.686543 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:34.729486 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd831d0-e1b4-452c-b480-a841db7584d5 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:34.768417 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586acd00-b39b-4982-878c-ea331dbbf765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:34.769053 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586acd00-b39b-4982-878c-ea331dbbf765 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:34.769333 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586acd00-b39b-4982-878c-ea331dbbf765 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:34.769608 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586acd00-b39b-4982-878c-ea331dbbf765 None admin] PATH_INFO: `/v3/users/ef54996bfb7d4e548ec01a8948ea49b8` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:34.770875 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586acd00-b39b-4982-878c-ea331dbbf765 None admin] RBAC: Authorizing `identity:get_user(user_id=ef54996bfb7d4e548ec01a8948ea49b8)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:34.773345 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb1e0f7-b161-43d0-8bea-0362544b900a None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:34.776371 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586acd00-b39b-4982-878c-ea331dbbf765 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:34.777979 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 121/230] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 15 12:10:34 2022] GET /identity/v3/users/ef54996bfb7d4e548ec01a8948ea49b8 => generated 283 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:10:34.790079 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586acd00-b39b-4982-878c-ea331dbbf765 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:34.801579 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:34.838821 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704880d5-587b-4711-902e-8c9af30fc9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:34.839659 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704880d5-587b-4711-902e-8c9af30fc9fa None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:34.839939 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704880d5-587b-4711-902e-8c9af30fc9fa None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:34.840208 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704880d5-587b-4711-902e-8c9af30fc9fa None admin] PATH_INFO: `/v3/projects/dd97fe3d09654c728d99e82d47ef59a5` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:34.843095 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704880d5-587b-4711-902e-8c9af30fc9fa None admin] RBAC: Authorizing `identity:get_project(project_id=dd97fe3d09654c728d99e82d47ef59a5)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:34.845965 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704880d5-587b-4711-902e-8c9af30fc9fa None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:34.849579 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 110/231] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 15 12:10:34 2022] GET /identity/v3/projects/dd97fe3d09654c728d99e82d47ef59a5 => generated 302 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:10:34.856470 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704880d5-587b-4711-902e-8c9af30fc9fa None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:34.970106 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586acd00-b39b-4982-878c-ea331dbbf765 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:35.034268 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2230805-45a0-4977-9667-cb34a043e854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:35.034946 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2230805-45a0-4977-9667-cb34a043e854 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:35.035225 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2230805-45a0-4977-9667-cb34a043e854 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:35.035494 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2230805-45a0-4977-9667-cb34a043e854 None admin] PATH_INFO: `/v3/projects/dd97fe3d09654c728d99e82d47ef59a5` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:35.036609 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2230805-45a0-4977-9667-cb34a043e854 None admin] RBAC: Authorizing `identity:get_project(project_id=dd97fe3d09654c728d99e82d47ef59a5)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:35.038034 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2230805-45a0-4977-9667-cb34a043e854 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:35.039678 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 122/232] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 15 12:10:34 2022] GET /identity/v3/projects/dd97fe3d09654c728d99e82d47ef59a5 => generated 302 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:35.045316 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2230805-45a0-4977-9667-cb34a043e854 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:35.048091 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704880d5-587b-4711-902e-8c9af30fc9fa None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:35.097343 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:35.123965 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:35.134259 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553a3ff6-a7b9-473c-9d92-a21580829025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:35.134961 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a3ff6-a7b9-473c-9d92-a21580829025 None admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:35.135243 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a3ff6-a7b9-473c-9d92-a21580829025 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:35.135518 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a3ff6-a7b9-473c-9d92-a21580829025 None admin] PATH_INFO: `/v3/projects/dd97fe3d09654c728d99e82d47ef59a5/users/ef54996bfb7d4e548ec01a8948ea49b8/roles/7f53f1c823b746529ba5057bf21b2477` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:35.140302 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553a3ff6-a7b9-473c-9d92-a21580829025 None admin] RBAC: Authorizing `identity:create_grant(project_id=dd97fe3d09654c728d99e82d47ef59a5, user_id=ef54996bfb7d4e548ec01a8948ea49b8, role_id=7f53f1c823b746529ba5057bf21b2477)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:35.141876 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553a3ff6-a7b9-473c-9d92-a21580829025 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:35.152268 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2230805-45a0-4977-9667-cb34a043e854 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:35.172313 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 111/233] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Sep 15 12:10:34 2022] PUT /identity/v3/projects/dd97fe3d09654c728d99e82d47ef59a5/users/ef54996bfb7d4e548ec01a8948ea49b8/roles/7f53f1c823b746529ba5057bf21b2477 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:10:35.205490 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a004891-78e8-42e8-b182-3322bb88198f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:35.206168 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a004891-78e8-42e8-b182-3322bb88198f None admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:35.206442 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a004891-78e8-42e8-b182-3322bb88198f None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:35.206730 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a004891-78e8-42e8-b182-3322bb88198f None admin] PATH_INFO: `/v3/projects/dd97fe3d09654c728d99e82d47ef59a5/users/ef54996bfb7d4e548ec01a8948ea49b8/roles/19ee0f56c10b47628ba0b1c3deee4448` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:35.208986 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a004891-78e8-42e8-b182-3322bb88198f None admin] RBAC: Authorizing `identity:create_grant(project_id=dd97fe3d09654c728d99e82d47ef59a5, user_id=ef54996bfb7d4e548ec01a8948ea49b8, role_id=19ee0f56c10b47628ba0b1c3deee4448)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:35.210478 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a004891-78e8-42e8-b182-3322bb88198f None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:35.229709 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 123/234] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Sep 15 12:10:35 2022] PUT /identity/v3/projects/dd97fe3d09654c728d99e82d47ef59a5/users/ef54996bfb7d4e548ec01a8948ea49b8/roles/19ee0f56c10b47628ba0b1c3deee4448 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:10:35.720819 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afa933b-d01f-4542-ba0d-68333074d09f None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:35.721838 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afa933b-d01f-4542-ba0d-68333074d09f None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:35.722343 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afa933b-d01f-4542-ba0d-68333074d09f None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:35.724192 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 112/235] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:10:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:10:35.729878 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ed394-2f51-43de-ab96-96a06bac1f93 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:35.730818 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ed394-2f51-43de-ab96-96a06bac1f93 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:35.731291 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ed394-2f51-43de-ab96-96a06bac1f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:35.756067 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-d49ed394-2f51-43de-ab96-96a06bac1f93 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:10:35.757590 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-d49ed394-2f51-43de-ab96-96a06bac1f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:10:35.849804 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 124/236] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:10:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:10:35.943191 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d87156-8414-4090-b8e5-92e2f91615df None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:35.943810 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d87156-8414-4090-b8e5-92e2f91615df None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:35.944409 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d87156-8414-4090-b8e5-92e2f91615df None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:35.946073 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 113/237] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:10:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:10:35.951679 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ba41b-0460-4a78-886b-0dddfc07ff72 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:35.952203 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ba41b-0460-4a78-886b-0dddfc07ff72 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:35.952674 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ba41b-0460-4a78-886b-0dddfc07ff72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:35.979142 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-d13ba41b-0460-4a78-886b-0dddfc07ff72 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:10:35.980650 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-d13ba41b-0460-4a78-886b-0dddfc07ff72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:10:36.057528 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:36.067346 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 125/238] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:10:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:10:36.303342 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d87156-8414-4090-b8e5-92e2f91615df None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:36.435499 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d87156-8414-4090-b8e5-92e2f91615df None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:36.481219 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cbeaf4-903c-4445-ab21-da1b027934df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:36.482188 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cbeaf4-903c-4445-ab21-da1b027934df None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:36.482715 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cbeaf4-903c-4445-ab21-da1b027934df None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:36.483190 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cbeaf4-903c-4445-ab21-da1b027934df None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:36.492042 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13ba41b-0460-4a78-886b-0dddfc07ff72 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:36.505660 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cbeaf4-903c-4445-ab21-da1b027934df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:10:36.511740 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-62cbeaf4-903c-4445-ab21-da1b027934df None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 12:10:36.511740 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:10:36.511740 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:10:36.511740 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:10:36.511740 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:10:36.511740 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:10:36.511740 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:10:36.511740 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:10:36.511740 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:10:36.511740 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:10:36.511740 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:10:36.511740 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:10:36.511740 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:10:36.511740 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:10:36.511740 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:10:36.511740 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:10:36.512608 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:10:36.512608 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:10:36.512608 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:10:36.512608 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:10:36.512608 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:10:36.512608 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:10:36.512608 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:10:36.512608 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:10:36.512608 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:10:36.512608 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:10:36.512608 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:10:36.512608 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:10:36.512608 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:10:36.512608 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:10:36.512608 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:10:36.512608 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:10:36.513409 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:10:36.513409 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:10:36.513409 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:10:36.513409 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:10:36.513409 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:10:36.513409 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:10:36.513409 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:10:36.513409 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:10:36.513409 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:10:36.513409 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:10:36.513409 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 12:10:36.513409 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:10:36.521122 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 114/239] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 15 12:10:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:10:36.531679 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cbeaf4-903c-4445-ab21-da1b027934df None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:36.619063 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:36.680269 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13ba41b-0460-4a78-886b-0dddfc07ff72 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:36.707219 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cbeaf4-903c-4445-ab21-da1b027934df None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:36.725983 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f721f3-6670-445d-a97d-89423a1089ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:36.727151 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f721f3-6670-445d-a97d-89423a1089ff None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:36.727639 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f721f3-6670-445d-a97d-89423a1089ff None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:36.728418 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f721f3-6670-445d-a97d-89423a1089ff None admin] PATH_INFO: `/v3/domains/default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:36.729791 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f721f3-6670-445d-a97d-89423a1089ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:36.732070 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f721f3-6670-445d-a97d-89423a1089ff None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:36.734950 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 126/240] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:10:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:10:36.737058 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65a5d71-cb77-41e3-994c-b2a4cbfe0b4f None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:36.737884 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65a5d71-cb77-41e3-994c-b2a4cbfe0b4f None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:36.738168 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65a5d71-cb77-41e3-994c-b2a4cbfe0b4f None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:36.740060 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 127/241] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:10:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:10:36.743040 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65a5d71-cb77-41e3-994c-b2a4cbfe0b4f None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:36.755285 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff18654-79ef-4dfe-858c-ba2cef2dd7b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:36.755956 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff18654-79ef-4dfe-858c-ba2cef2dd7b2 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:36.756334 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff18654-79ef-4dfe-858c-ba2cef2dd7b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:36.756612 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff18654-79ef-4dfe-858c-ba2cef2dd7b2 None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:36.757335 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff18654-79ef-4dfe-858c-ba2cef2dd7b2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:10:36.757643 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff18654-79ef-4dfe-858c-ba2cef2dd7b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:36.759241 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff18654-79ef-4dfe-858c-ba2cef2dd7b2 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:36.769570 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 115/242] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Sep 15 12:10:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:10:36.775756 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f54e8f-03b9-4dc9-8d79-e1b41e28f83b None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:36.776046 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f54e8f-03b9-4dc9-8d79-e1b41e28f83b None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:36.776322 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f54e8f-03b9-4dc9-8d79-e1b41e28f83b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:36.795727 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-88f54e8f-03b9-4dc9-8d79-e1b41e28f83b None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:10:36.797060 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-88f54e8f-03b9-4dc9-8d79-e1b41e28f83b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:10:36.807735 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:36.848322 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65a5d71-cb77-41e3-994c-b2a4cbfe0b4f None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:36.879260 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 116/243] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:10:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:10:36.880601 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f54e8f-03b9-4dc9-8d79-e1b41e28f83b None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:36.882369 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c7f2a3-bf11-4b83-bdfa-a09b81924d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:36.883010 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c7f2a3-bf11-4b83-bdfa-a09b81924d6c None admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:36.883274 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c7f2a3-bf11-4b83-bdfa-a09b81924d6c None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:36.883620 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c7f2a3-bf11-4b83-bdfa-a09b81924d6c None admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:36.884182 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c7f2a3-bf11-4b83-bdfa-a09b81924d6c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:36.885662 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c7f2a3-bf11-4b83-bdfa-a09b81924d6c None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:36.933861 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 128/244] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Sep 15 12:10:36 2022] POST /identity/v3/users => generated 293 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:10:36.949467 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:37.053461 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f54e8f-03b9-4dc9-8d79-e1b41e28f83b None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:37.113059 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e64737b-506d-4aa7-a228-e79b7a94a079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:37.113723 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e64737b-506d-4aa7-a228-e79b7a94a079 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:37.114000 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e64737b-506d-4aa7-a228-e79b7a94a079 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:37.114271 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e64737b-506d-4aa7-a228-e79b7a94a079 None admin] PATH_INFO: `/v3/users/04cd3fb911214c7380642bcbe272ff03` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:37.135941 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e64737b-506d-4aa7-a228-e79b7a94a079 None admin] RBAC: Authorizing `identity:get_user(user_id=04cd3fb911214c7380642bcbe272ff03)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:37.137340 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e64737b-506d-4aa7-a228-e79b7a94a079 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:37.139063 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 117/245] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 15 12:10:36 2022] GET /identity/v3/users/04cd3fb911214c7380642bcbe272ff03 => generated 297 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:37.144777 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c7f2a3-bf11-4b83-bdfa-a09b81924d6c None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:37.222873 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e64737b-506d-4aa7-a228-e79b7a94a079 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:37.268343 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c7f2a3-bf11-4b83-bdfa-a09b81924d6c None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:37.287690 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:37.307990 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8b9cde-ae66-4591-a8a6-01eb9218f8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:37.308669 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b9cde-ae66-4591-a8a6-01eb9218f8bd None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:37.308953 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b9cde-ae66-4591-a8a6-01eb9218f8bd None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:37.309225 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b9cde-ae66-4591-a8a6-01eb9218f8bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:37.340919 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:37.354078 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e64737b-506d-4aa7-a228-e79b7a94a079 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:37.394866 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae8125b-08fd-426d-8cf6-4dd95d4c15f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:37.395067 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8b9cde-ae66-4591-a8a6-01eb9218f8bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:37.395944 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8125b-08fd-426d-8cf6-4dd95d4c15f4 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:37.396267 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8b9cde-ae66-4591-a8a6-01eb9218f8bd None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:37.396658 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8125b-08fd-426d-8cf6-4dd95d4c15f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:37.397110 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8125b-08fd-426d-8cf6-4dd95d4c15f4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:37.411940 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae8125b-08fd-426d-8cf6-4dd95d4c15f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:10:37.419262 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-dae8125b-08fd-426d-8cf6-4dd95d4c15f4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 12:10:37.419262 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:10:37.419262 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:10:37.419262 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:10:37.419262 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:10:37.419262 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:10:37.419262 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:10:37.419262 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:10:37.419262 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:10:37.419262 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:10:37.419262 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:10:37.419262 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:10:37.419262 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:10:37.419262 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:10:37.419262 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:10:37.419262 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:10:37.420210 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:10:37.420210 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:10:37.420210 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:10:37.420210 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:10:37.420210 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:10:37.420210 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:10:37.420210 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:10:37.420210 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:10:37.420210 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:10:37.420210 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:10:37.420210 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:10:37.420210 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:10:37.420210 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:10:37.420210 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:10:37.420210 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:10:37.420210 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:10:37.420985 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:10:37.420985 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:10:37.420985 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:10:37.420985 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:10:37.420985 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:10:37.420985 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:10:37.420985 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:10:37.420985 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:10:37.420985 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:10:37.420985 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:10:37.420985 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 12:10:37.420985 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:10:37.424237 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 118/246] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 15 12:10:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:10:37.432350 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae8125b-08fd-426d-8cf6-4dd95d4c15f4 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:37.535637 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 129/247] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 15 12:10:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 12:10:37.542404 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8b9cde-ae66-4591-a8a6-01eb9218f8bd None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:37.566374 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:37.573520 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae8125b-08fd-426d-8cf6-4dd95d4c15f4 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:37.629097 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3d9072-962b-4b62-9380-43edd3245436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:37.629769 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d9072-962b-4b62-9380-43edd3245436 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:37.630052 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d9072-962b-4b62-9380-43edd3245436 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:37.630325 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d9072-962b-4b62-9380-43edd3245436 None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:37.631040 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3d9072-962b-4b62-9380-43edd3245436 None admin] RBAC: Adding query filter params (name=member) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:10:37.631344 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3d9072-962b-4b62-9380-43edd3245436 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:37.633057 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3d9072-962b-4b62-9380-43edd3245436 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:37.646522 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 119/248] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Sep 15 12:10:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:10:37.652377 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3d9072-962b-4b62-9380-43edd3245436 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:37.678316 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:37.685130 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8b9cde-ae66-4591-a8a6-01eb9218f8bd None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:37.738965 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb25ea2-a726-4485-bfb7-7133e982dea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:37.740569 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb25ea2-a726-4485-bfb7-7133e982dea0 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:37.741111 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb25ea2-a726-4485-bfb7-7133e982dea0 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:37.741586 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb25ea2-a726-4485-bfb7-7133e982dea0 None admin] PATH_INFO: `/v3/projects/dd97fe3d09654c728d99e82d47ef59a5` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:37.743910 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb25ea2-a726-4485-bfb7-7133e982dea0 None admin] RBAC: Authorizing `identity:get_project(project_id=dd97fe3d09654c728d99e82d47ef59a5)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:37.746085 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb25ea2-a726-4485-bfb7-7133e982dea0 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:37.748548 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 130/249] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 15 12:10:37 2022] GET /identity/v3/projects/dd97fe3d09654c728d99e82d47ef59a5 => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:10:37.755377 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb25ea2-a726-4485-bfb7-7133e982dea0 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:37.809035 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3d9072-962b-4b62-9380-43edd3245436 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:37.855132 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918e6052-9288-411d-a51a-7db9af65f967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:37.856506 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918e6052-9288-411d-a51a-7db9af65f967 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:37.857512 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918e6052-9288-411d-a51a-7db9af65f967 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:37.857995 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918e6052-9288-411d-a51a-7db9af65f967 None admin] PATH_INFO: `/v3/users/ed3b2819298a4d2f8a4d571594754f38` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:37.860180 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918e6052-9288-411d-a51a-7db9af65f967 None admin] RBAC: Authorizing `identity:get_user(user_id=ed3b2819298a4d2f8a4d571594754f38)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:37.861037 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:37.863434 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918e6052-9288-411d-a51a-7db9af65f967 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:37.866708 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 120/250] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 15 12:10:37 2022] GET /identity/v3/users/ed3b2819298a4d2f8a4d571594754f38 => generated 297 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:37.869489 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba58054-f95d-41d4-9813-e41006c371e5 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:37.870202 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba58054-f95d-41d4-9813-e41006c371e5 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:37.870622 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba58054-f95d-41d4-9813-e41006c371e5 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:37.872795 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 121/251] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:10:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:10:37.874179 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4fc3f7-23c1-4d33-9485-b94efc3a8620 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:37.874618 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4fc3f7-23c1-4d33-9485-b94efc3a8620 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:37.875196 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4fc3f7-23c1-4d33-9485-b94efc3a8620 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:37.877131 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 122/252] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:10:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:10:37.878322 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4fc3f7-23c1-4d33-9485-b94efc3a8620 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:37.882194 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb25ea2-a726-4485-bfb7-7133e982dea0 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:37.925209 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f4e17f-9c74-4c82-b151-d7124bd16cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:37.925732 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f4e17f-9c74-4c82-b151-d7124bd16cf2 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:37.926011 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f4e17f-9c74-4c82-b151-d7124bd16cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:37.926285 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f4e17f-9c74-4c82-b151-d7124bd16cf2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:37.927053 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f4e17f-9c74-4c82-b151-d7124bd16cf2 None admin] RBAC: Adding query filter params (role.id=da591cd17baa4d009b74f6facf2a6688, scope.project.id=dd97fe3d09654c728d99e82d47ef59a5, user.id=04cd3fb911214c7380642bcbe272ff03) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:10:37.927364 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f4e17f-9c74-4c82-b151-d7124bd16cf2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:37.928806 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f4e17f-9c74-4c82-b151-d7124bd16cf2 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:37.934933 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 131/253] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 15 12:10:37 2022] GET /identity/v3/role_assignments?user.id=04cd3fb911214c7380642bcbe272ff03&scope.project.id=dd97fe3d09654c728d99e82d47ef59a5&role.id=da591cd17baa4d009b74f6facf2a6688 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:37.936139 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae85ba4-cc69-4f5f-9f3a-499fe5d92007 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:37.936422 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae85ba4-cc69-4f5f-9f3a-499fe5d92007 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:37.936695 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae85ba4-cc69-4f5f-9f3a-499fe5d92007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:37.993536 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-eae85ba4-cc69-4f5f-9f3a-499fe5d92007 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:10:38.000362 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-eae85ba4-cc69-4f5f-9f3a-499fe5d92007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:10:38.019342 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:38.075509 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4fc3f7-23c1-4d33-9485-b94efc3a8620 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:38.095998 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 132/254] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:10:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:10:38.097672 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a7526-2f3e-4220-92a8-f31451364ba0 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:38.098211 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a7526-2f3e-4220-92a8-f31451364ba0 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:38.098869 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a7526-2f3e-4220-92a8-f31451364ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:38.128101 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-3f1a7526-2f3e-4220-92a8-f31451364ba0 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:10:38.131195 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-3f1a7526-2f3e-4220-92a8-f31451364ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:10:38.143699 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a319e217-4381-4728-929c-eaf57a36bb7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:38.145276 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319e217-4381-4728-929c-eaf57a36bb7f None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:38.145757 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319e217-4381-4728-929c-eaf57a36bb7f None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:38.146271 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319e217-4381-4728-929c-eaf57a36bb7f None admin] PATH_INFO: `/v3/projects/dd97fe3d09654c728d99e82d47ef59a5` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:38.147669 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a319e217-4381-4728-929c-eaf57a36bb7f None admin] RBAC: Authorizing `identity:get_project(project_id=dd97fe3d09654c728d99e82d47ef59a5)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:38.150328 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a319e217-4381-4728-929c-eaf57a36bb7f None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:38.157709 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 123/255] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 15 12:10:37 2022] GET /identity/v3/projects/dd97fe3d09654c728d99e82d47ef59a5 => generated 302 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:38.159196 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a319e217-4381-4728-929c-eaf57a36bb7f None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:38.290329 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a319e217-4381-4728-929c-eaf57a36bb7f None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:38.331706 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 133/256] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:10:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:10:38.335577 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c5d0cc-5359-4f8e-8446-34e086380045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:38.336478 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c5d0cc-5359-4f8e-8446-34e086380045 None admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:38.336952 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c5d0cc-5359-4f8e-8446-34e086380045 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:38.337417 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c5d0cc-5359-4f8e-8446-34e086380045 None admin] PATH_INFO: `/v3/projects/dd97fe3d09654c728d99e82d47ef59a5/users/ed3b2819298a4d2f8a4d571594754f38/roles/9371e5bbc55848949eb951a815f817f2` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:38.343996 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c5d0cc-5359-4f8e-8446-34e086380045 None admin] RBAC: Authorizing `identity:create_grant(project_id=dd97fe3d09654c728d99e82d47ef59a5, user_id=ed3b2819298a4d2f8a4d571594754f38, role_id=9371e5bbc55848949eb951a815f817f2)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:38.345724 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c5d0cc-5359-4f8e-8446-34e086380045 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:38.368922 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 124/257] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Sep 15 12:10:38 2022] PUT /identity/v3/projects/dd97fe3d09654c728d99e82d47ef59a5/users/ed3b2819298a4d2f8a4d571594754f38/roles/9371e5bbc55848949eb951a815f817f2 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:10:38.471964 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a7526-2f3e-4220-92a8-f31451364ba0 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:38.484711 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:38.603541 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a7526-2f3e-4220-92a8-f31451364ba0 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:38.649632 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f50a7c-fae6-4a21-ab82-9925af566f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:38.650679 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f50a7c-fae6-4a21-ab82-9925af566f8b None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:38.651306 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f50a7c-fae6-4a21-ab82-9925af566f8b None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:38.651776 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f50a7c-fae6-4a21-ab82-9925af566f8b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:38.665313 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f50a7c-fae6-4a21-ab82-9925af566f8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:10:38.670589 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-f8f50a7c-fae6-4a21-ab82-9925af566f8b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 12:10:38.670589 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:10:38.670589 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:10:38.670589 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:10:38.670589 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:10:38.670589 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:10:38.670589 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:10:38.670589 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:10:38.670589 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:10:38.670589 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:10:38.670589 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:10:38.670589 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:10:38.670589 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:10:38.670589 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:10:38.670589 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:10:38.670589 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:10:38.671684 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:10:38.671684 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:10:38.671684 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:10:38.671684 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:10:38.671684 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:10:38.671684 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:10:38.671684 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:10:38.671684 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:10:38.671684 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:10:38.671684 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:10:38.671684 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:10:38.671684 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:10:38.671684 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:10:38.671684 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:10:38.671684 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:10:38.671684 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:10:38.672737 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:10:38.672737 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:10:38.672737 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:10:38.672737 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:10:38.672737 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:10:38.672737 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:10:38.672737 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:10:38.672737 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:10:38.672737 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:10:38.672737 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:10:38.672737 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 12:10:38.672737 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:10:38.674472 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c5d0cc-5359-4f8e-8446-34e086380045 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:38.674966 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 134/258] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Sep 15 12:10:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:10:38.687756 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f50a7c-fae6-4a21-ab82-9925af566f8b None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:38.695886 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:38.817916 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:38.871396 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f50a7c-fae6-4a21-ab82-9925af566f8b None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:38.880176 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c5d0cc-5359-4f8e-8446-34e086380045 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:38.928294 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d9e2f1-cf1d-4efb-81fc-d0e8efb59d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:38.929189 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d9e2f1-cf1d-4efb-81fc-d0e8efb59d1e None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:38.929611 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d9e2f1-cf1d-4efb-81fc-d0e8efb59d1e None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:38.930022 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d9e2f1-cf1d-4efb-81fc-d0e8efb59d1e None admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:38.930930 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d9e2f1-cf1d-4efb-81fc-d0e8efb59d1e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:10:38.931492 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d9e2f1-cf1d-4efb-81fc-d0e8efb59d1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:38.933213 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d9e2f1-cf1d-4efb-81fc-d0e8efb59d1e None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:38.946136 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 135/259] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 15 12:10:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:38.951641 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d9e2f1-cf1d-4efb-81fc-d0e8efb59d1e None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:38.975620 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8608fd7-8784-4ea2-a153-252f8618c88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:38.976119 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8608fd7-8784-4ea2-a153-252f8618c88d None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:38.976948 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8608fd7-8784-4ea2-a153-252f8618c88d None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:38.976948 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8608fd7-8784-4ea2-a153-252f8618c88d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:39.006747 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8608fd7-8784-4ea2-a153-252f8618c88d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:10:39.015028 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-c8608fd7-8784-4ea2-a153-252f8618c88d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:10:39.015028 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:10:39.015028 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:10:39.015028 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:10:39.015028 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:10:39.015028 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:10:39.015028 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:10:39.015028 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:10:39.015028 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:10:39.015028 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:10:39.015028 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:10:39.015028 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:10:39.015028 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:10:39.015028 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:10:39.015028 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:10:39.015028 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:10:39.016011 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:10:39.016011 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:10:39.016011 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:10:39.016011 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:10:39.016011 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:10:39.016011 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:10:39.016011 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:10:39.016011 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:10:39.016011 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:10:39.016011 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:10:39.016011 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:10:39.016011 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:10:39.016011 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:10:39.016011 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:10:39.016011 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:10:39.016011 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:10:39.017488 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:10:39.017488 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:10:39.017488 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:10:39.017488 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:10:39.017488 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:10:39.017488 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:10:39.017488 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:10:39.017488 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:10:39.017488 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:10:39.017488 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:10:39.017488 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:10:39.017488 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:10:39.019798 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 125/260] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Sep 15 12:10:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:10:39.029011 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8608fd7-8784-4ea2-a153-252f8618c88d None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:39.150037 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d9e2f1-cf1d-4efb-81fc-d0e8efb59d1e None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:39.196580 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:39.211655 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:39.220225 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db1796a-651c-4d6c-80f8-a598fd958caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:39.221030 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db1796a-651c-4d6c-80f8-a598fd958caf None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:39.221314 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db1796a-651c-4d6c-80f8-a598fd958caf None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:39.221582 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db1796a-651c-4d6c-80f8-a598fd958caf None admin] PATH_INFO: `/v3/users/ef54996bfb7d4e548ec01a8948ea49b8` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:39.222720 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db1796a-651c-4d6c-80f8-a598fd958caf None admin] RBAC: Authorizing `identity:get_user(user_id=ef54996bfb7d4e548ec01a8948ea49b8)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:39.224692 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db1796a-651c-4d6c-80f8-a598fd958caf None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:39.226724 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 136/261] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 15 12:10:38 2022] GET /identity/v3/users/ef54996bfb7d4e548ec01a8948ea49b8 => generated 283 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:10:39.236529 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db1796a-651c-4d6c-80f8-a598fd958caf None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:39.261400 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8608fd7-8784-4ea2-a153-252f8618c88d None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:39.327230 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037f97d5-0572-4677-8f05-e5186028ce98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:39.328274 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f97d5-0572-4677-8f05-e5186028ce98 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:39.329260 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f97d5-0572-4677-8f05-e5186028ce98 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:39.329731 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f97d5-0572-4677-8f05-e5186028ce98 None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:39.330565 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037f97d5-0572-4677-8f05-e5186028ce98 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:10:39.331067 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037f97d5-0572-4677-8f05-e5186028ce98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:39.332612 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037f97d5-0572-4677-8f05-e5186028ce98 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:39.347646 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 126/262] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 15 12:10:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:39.352807 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037f97d5-0572-4677-8f05-e5186028ce98 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:39.411156 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db1796a-651c-4d6c-80f8-a598fd958caf None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:39.478716 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea7abe1-98b5-4c92-a643-5d0875c41774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:39.478716 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea7abe1-98b5-4c92-a643-5d0875c41774 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:39.478716 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea7abe1-98b5-4c92-a643-5d0875c41774 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:39.478716 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea7abe1-98b5-4c92-a643-5d0875c41774 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:39.565580 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037f97d5-0572-4677-8f05-e5186028ce98 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:39.620242 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:39.633506 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f8910a-910c-4947-b408-f382d00abc55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:39.634406 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f8910a-910c-4947-b408-f382d00abc55 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:39.634950 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f8910a-910c-4947-b408-f382d00abc55 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:39.635371 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f8910a-910c-4947-b408-f382d00abc55 None admin] PATH_INFO: `/v3/users/ef54996bfb7d4e548ec01a8948ea49b8` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:39.638104 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f8910a-910c-4947-b408-f382d00abc55 None admin] RBAC: Authorizing `identity:get_user(user_id=ef54996bfb7d4e548ec01a8948ea49b8)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:39.639924 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:39.641707 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f8910a-910c-4947-b408-f382d00abc55 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:39.645105 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea7abe1-98b5-4c92-a643-5d0875c41774 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:39.646579 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 127/263] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 15 12:10:39 2022] GET /identity/v3/users/ef54996bfb7d4e548ec01a8948ea49b8 => generated 283 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:39.650737 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea7abe1-98b5-4c92-a643-5d0875c41774 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:39.654178 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f8910a-910c-4947-b408-f382d00abc55 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:39.858271 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 137/264] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 15 12:10:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 622 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 15 12:10:39.867216 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea7abe1-98b5-4c92-a643-5d0875c41774 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:39.869540 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f8910a-910c-4947-b408-f382d00abc55 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:39.955928 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b63deeb-dc14-4435-b0d0-f68c0a416e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:39.956595 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b63deeb-dc14-4435-b0d0-f68c0a416e76 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:39.956818 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b63deeb-dc14-4435-b0d0-f68c0a416e76 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:39.957085 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b63deeb-dc14-4435-b0d0-f68c0a416e76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:40.008348 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:40.011752 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea7abe1-98b5-4c92-a643-5d0875c41774 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:40.070358 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20810338-ed03-4050-8538-4a761826d08f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:40.071279 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20810338-ed03-4050-8538-4a761826d08f None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:40.071711 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20810338-ed03-4050-8538-4a761826d08f None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:40.072124 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20810338-ed03-4050-8538-4a761826d08f None admin] PATH_INFO: `/v3/projects/dd97fe3d09654c728d99e82d47ef59a5` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:40.079917 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20810338-ed03-4050-8538-4a761826d08f None admin] RBAC: Authorizing `identity:get_project(project_id=dd97fe3d09654c728d99e82d47ef59a5)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:40.081553 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20810338-ed03-4050-8538-4a761826d08f None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:40.083430 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 138/265] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 15 12:10:39 2022] GET /identity/v3/projects/dd97fe3d09654c728d99e82d47ef59a5 => generated 302 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:40.091803 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20810338-ed03-4050-8538-4a761826d08f None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:40.109438 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:40.113764 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b63deeb-dc14-4435-b0d0-f68c0a416e76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:40.115292 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b63deeb-dc14-4435-b0d0-f68c0a416e76 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:40.208781 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20810338-ed03-4050-8538-4a761826d08f None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:40.292751 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67f6a34-f653-4889-a96b-b8204a32aa08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:40.293382 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f6a34-f653-4889-a96b-b8204a32aa08 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:40.293720 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f6a34-f653-4889-a96b-b8204a32aa08 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:40.293992 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f6a34-f653-4889-a96b-b8204a32aa08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:40.294800 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67f6a34-f653-4889-a96b-b8204a32aa08 None admin] RBAC: Adding query filter params (role.id=19ee0f56c10b47628ba0b1c3deee4448, scope.project.id=dd97fe3d09654c728d99e82d47ef59a5, user.id=ef54996bfb7d4e548ec01a8948ea49b8) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:10:40.295108 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67f6a34-f653-4889-a96b-b8204a32aa08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:40.296540 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67f6a34-f653-4889-a96b-b8204a32aa08 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:40.308852 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 128/266] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 15 12:10:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 655 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 12:10:40.309469 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 139/267] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 15 12:10:40 2022] GET /identity/v3/role_assignments?user.id=ef54996bfb7d4e548ec01a8948ea49b8&scope.project.id=dd97fe3d09654c728d99e82d47ef59a5&role.id=19ee0f56c10b47628ba0b1c3deee4448 => generated 608 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:40.314201 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b63deeb-dc14-4435-b0d0-f68c0a416e76 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:40.463360 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:40.466900 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b63deeb-dc14-4435-b0d0-f68c0a416e76 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:40.507659 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593d5367-d319-40a0-af4b-8d6a0104c869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:40.508720 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d5367-d319-40a0-af4b-8d6a0104c869 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:40.509228 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d5367-d319-40a0-af4b-8d6a0104c869 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:40.509707 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d5367-d319-40a0-af4b-8d6a0104c869 None admin] PATH_INFO: `/v3/projects/dd97fe3d09654c728d99e82d47ef59a5` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:40.515436 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593d5367-d319-40a0-af4b-8d6a0104c869 None admin] RBAC: Authorizing `identity:get_project(project_id=dd97fe3d09654c728d99e82d47ef59a5)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:40.517730 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593d5367-d319-40a0-af4b-8d6a0104c869 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:40.519676 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 129/268] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 15 12:10:40 2022] GET /identity/v3/projects/dd97fe3d09654c728d99e82d47ef59a5 => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:40.525615 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67f6a34-f653-4889-a96b-b8204a32aa08 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:40.582358 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:40.679585 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67f6a34-f653-4889-a96b-b8204a32aa08 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:40.734991 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f82ca2-18c1-4d78-aee9-61ae6e57a59f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:40.735538 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f82ca2-18c1-4d78-aee9-61ae6e57a59f None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:40.735823 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f82ca2-18c1-4d78-aee9-61ae6e57a59f None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:40.736262 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f82ca2-18c1-4d78-aee9-61ae6e57a59f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:40.737004 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f82ca2-18c1-4d78-aee9-61ae6e57a59f None admin] RBAC: Adding query filter params (role.id=7f53f1c823b746529ba5057bf21b2477, scope.project.id=dd97fe3d09654c728d99e82d47ef59a5, user.id=ef54996bfb7d4e548ec01a8948ea49b8) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:10:40.737311 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f82ca2-18c1-4d78-aee9-61ae6e57a59f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:40.738854 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f82ca2-18c1-4d78-aee9-61ae6e57a59f None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:40.751892 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 140/269] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 15 12:10:40 2022] GET /identity/v3/role_assignments?user.id=ef54996bfb7d4e548ec01a8948ea49b8&scope.project.id=dd97fe3d09654c728d99e82d47ef59a5&role.id=7f53f1c823b746529ba5057bf21b2477 => generated 608 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:40.836542 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3928e29-6ddd-4521-8437-1e93edd19a80 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:40.836542 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3928e29-6ddd-4521-8437-1e93edd19a80 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:40.836542 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3928e29-6ddd-4521-8437-1e93edd19a80 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:40.836542 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 130/270] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:10:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:10:40.842057 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d172f192-a50c-4820-be7f-4244d27cb54e None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:40.842328 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d172f192-a50c-4820-be7f-4244d27cb54e None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:40.842605 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d172f192-a50c-4820-be7f-4244d27cb54e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:40.866922 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-d172f192-a50c-4820-be7f-4244d27cb54e None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:10:40.868139 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-d172f192-a50c-4820-be7f-4244d27cb54e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:10:40.958725 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc21e6b-ac34-4887-99bc-66ec50f1529f None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:40.958725 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc21e6b-ac34-4887-99bc-66ec50f1529f None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:40.958725 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc21e6b-ac34-4887-99bc-66ec50f1529f None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:40.960619 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 131/271] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:10:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 12:10:40.967693 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce2c3e6-29cc-4814-8819-87f70a25e817 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:40.968392 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce2c3e6-29cc-4814-8819-87f70a25e817 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:40.968869 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce2c3e6-29cc-4814-8819-87f70a25e817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:40.990165 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 141/272] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:10:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:10:41.001504 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-8ce2c3e6-29cc-4814-8819-87f70a25e817 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:10:41.002734 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-8ce2c3e6-29cc-4814-8819-87f70a25e817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:10:41.092621 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 132/273] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:10:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 12:10:41.205919 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3768f7e0-ca6c-4b00-8746-de8936fede6b None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:41.206885 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3768f7e0-ca6c-4b00-8746-de8936fede6b None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:41.207702 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3768f7e0-ca6c-4b00-8746-de8936fede6b None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:41.210589 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 142/274] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:10:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:10:41.215780 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ec29a8-4c17-4b56-8164-388c022a9973 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:41.216310 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ec29a8-4c17-4b56-8164-388c022a9973 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:41.216783 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ec29a8-4c17-4b56-8164-388c022a9973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:41.240908 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-e4ec29a8-4c17-4b56-8164-388c022a9973 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:10:41.242408 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-e4ec29a8-4c17-4b56-8164-388c022a9973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:10:41.248025 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107cbc75-b350-41d5-8edd-3857f6175b25 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:41.248567 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107cbc75-b350-41d5-8edd-3857f6175b25 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:41.249038 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107cbc75-b350-41d5-8edd-3857f6175b25 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:41.250661 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 143/275] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:10:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:10:41.262449 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41794a0-082e-48d2-a0f2-1a903d3decfc None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:41.263047 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41794a0-082e-48d2-a0f2-1a903d3decfc None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:41.263521 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41794a0-082e-48d2-a0f2-1a903d3decfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:41.287056 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-e41794a0-082e-48d2-a0f2-1a903d3decfc None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:10:41.288575 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-e41794a0-082e-48d2-a0f2-1a903d3decfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:10:41.311651 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:41.326869 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 133/276] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:10:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:10:41.326869 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ec29a8-4c17-4b56-8164-388c022a9973 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:41.370871 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 144/277] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:10:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:10:41.371427 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:41.386434 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41794a0-082e-48d2-a0f2-1a903d3decfc None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:41.456365 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ec29a8-4c17-4b56-8164-388c022a9973 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:41.491522 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5489d7c-2398-4307-926a-a8d6a78e8fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:41.492158 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5489d7c-2398-4307-926a-a8d6a78e8fc0 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:41.492630 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5489d7c-2398-4307-926a-a8d6a78e8fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:41.493075 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5489d7c-2398-4307-926a-a8d6a78e8fc0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:41.497033 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41794a0-082e-48d2-a0f2-1a903d3decfc None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:41.503919 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5489d7c-2398-4307-926a-a8d6a78e8fc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:10:41.508935 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-a5489d7c-2398-4307-926a-a8d6a78e8fc0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 12:10:41.508935 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:10:41.508935 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:10:41.508935 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:10:41.508935 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:10:41.508935 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:10:41.508935 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:10:41.508935 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:10:41.508935 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:10:41.508935 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:10:41.508935 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:10:41.508935 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:10:41.508935 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:10:41.508935 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:10:41.508935 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:10:41.508935 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:10:41.509865 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:10:41.509865 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:10:41.509865 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:10:41.509865 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:10:41.509865 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:10:41.509865 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:10:41.509865 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:10:41.509865 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:10:41.509865 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:10:41.509865 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:10:41.509865 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:10:41.509865 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:10:41.509865 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:10:41.509865 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:10:41.509865 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:10:41.509865 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:10:41.510648 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:10:41.510648 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:10:41.510648 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:10:41.510648 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:10:41.510648 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:10:41.510648 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:10:41.510648 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:10:41.510648 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:10:41.510648 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:10:41.510648 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:10:41.510648 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 12:10:41.510648 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:10:41.512982 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 134/278] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 15 12:10:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:10:41.518894 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5489d7c-2398-4307-926a-a8d6a78e8fc0 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:41.535466 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e83d74-46ba-4a54-9605-7e3e75f77def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:41.536101 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e83d74-46ba-4a54-9605-7e3e75f77def None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:41.536440 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e83d74-46ba-4a54-9605-7e3e75f77def None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:41.536758 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e83d74-46ba-4a54-9605-7e3e75f77def None admin] PATH_INFO: `/v3/domains/default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:41.537893 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e83d74-46ba-4a54-9605-7e3e75f77def None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:41.539682 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e83d74-46ba-4a54-9605-7e3e75f77def None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:41.541666 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 145/279] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:10:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:10:41.546805 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e83d74-46ba-4a54-9605-7e3e75f77def None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:41.583011 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:41.615060 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:41.628635 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5489d7c-2398-4307-926a-a8d6a78e8fc0 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:41.663513 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4895a2-2934-42f7-a6e9-0393bcaf66d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:41.664114 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4895a2-2934-42f7-a6e9-0393bcaf66d0 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:41.664388 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4895a2-2934-42f7-a6e9-0393bcaf66d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:41.664652 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4895a2-2934-42f7-a6e9-0393bcaf66d0 None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:41.665300 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4895a2-2934-42f7-a6e9-0393bcaf66d0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:10:41.665597 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4895a2-2934-42f7-a6e9-0393bcaf66d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:41.665905 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e83d74-46ba-4a54-9605-7e3e75f77def None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:41.666992 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4895a2-2934-42f7-a6e9-0393bcaf66d0 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:41.674923 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 135/280] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Sep 15 12:10:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:10:41.674923 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4895a2-2934-42f7-a6e9-0393bcaf66d0 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:41.700342 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb5d98c-5339-4f80-a1c8-3cea5c398191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:41.700934 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb5d98c-5339-4f80-a1c8-3cea5c398191 None admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:41.701204 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb5d98c-5339-4f80-a1c8-3cea5c398191 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:41.701470 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb5d98c-5339-4f80-a1c8-3cea5c398191 None admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:41.702113 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb5d98c-5339-4f80-a1c8-3cea5c398191 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:41.703561 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb5d98c-5339-4f80-a1c8-3cea5c398191 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:41.726234 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 146/281] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Sep 15 12:10:41 2022] POST /identity/v3/users => generated 293 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:10:41.727287 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb5d98c-5339-4f80-a1c8-3cea5c398191 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:41.785216 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4895a2-2934-42f7-a6e9-0393bcaf66d0 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:41.822387 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f205dbbd-5c59-45d5-9599-ef008e882b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:41.823069 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f205dbbd-5c59-45d5-9599-ef008e882b3d None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:41.823269 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:41.823380 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f205dbbd-5c59-45d5-9599-ef008e882b3d None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:41.823601 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f205dbbd-5c59-45d5-9599-ef008e882b3d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:41.835998 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f205dbbd-5c59-45d5-9599-ef008e882b3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:10:41.840979 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-f205dbbd-5c59-45d5-9599-ef008e882b3d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 12:10:41.840979 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:10:41.840979 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:10:41.840979 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:10:41.840979 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:10:41.840979 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:10:41.840979 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:10:41.840979 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:10:41.840979 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:10:41.840979 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:10:41.840979 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:10:41.840979 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:10:41.840979 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:10:41.840979 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:10:41.840979 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:10:41.840979 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:10:41.841862 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:10:41.841862 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:10:41.841862 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:10:41.841862 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:10:41.841862 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:10:41.841862 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:10:41.841862 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:10:41.841862 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:10:41.841862 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:10:41.841862 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:10:41.841862 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:10:41.841862 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:10:41.841862 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:10:41.841862 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:10:41.841862 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:10:41.841862 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:10:41.842723 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:10:41.842723 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:10:41.842723 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:10:41.842723 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:10:41.842723 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:10:41.842723 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:10:41.842723 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:10:41.842723 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:10:41.842723 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:10:41.842723 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:10:41.842723 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 12:10:41.842723 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:10:41.842723 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 136/282] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 15 12:10:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:10:41.843371 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f205dbbd-5c59-45d5-9599-ef008e882b3d None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:41.856287 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb5d98c-5339-4f80-a1c8-3cea5c398191 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:41.861350 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:41.895649 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb538a6f-d667-4b67-8b1f-7d796f3fe097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:41.896523 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb538a6f-d667-4b67-8b1f-7d796f3fe097 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:41.896523 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb538a6f-d667-4b67-8b1f-7d796f3fe097 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:41.896807 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb538a6f-d667-4b67-8b1f-7d796f3fe097 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:41.909628 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb538a6f-d667-4b67-8b1f-7d796f3fe097 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:10:41.915137 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-cb538a6f-d667-4b67-8b1f-7d796f3fe097 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 12:10:41.915137 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:10:41.915137 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:10:41.915137 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:10:41.915137 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:10:41.915137 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:10:41.915137 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:10:41.915137 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:10:41.915137 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:10:41.915137 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:10:41.915137 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:10:41.915137 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:10:41.915137 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:10:41.915137 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:10:41.915137 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:10:41.915137 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:10:41.915988 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:10:41.915988 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:10:41.915988 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:10:41.915988 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:10:41.915988 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:10:41.915988 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:10:41.915988 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:10:41.915988 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:10:41.915988 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:10:41.915988 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:10:41.915988 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:10:41.915988 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:10:41.915988 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:10:41.915988 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:10:41.915988 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:10:41.915988 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:10:41.916776 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:10:41.916776 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:10:41.916776 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:10:41.916776 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:10:41.916776 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:10:41.916776 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:10:41.916776 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:10:41.916776 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:10:41.916776 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:10:41.916776 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:10:41.916776 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 12:10:41.916776 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:10:41.916776 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 147/283] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 15 12:10:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:10:41.918915 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb538a6f-d667-4b67-8b1f-7d796f3fe097 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:41.968658 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f205dbbd-5c59-45d5-9599-ef008e882b3d None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:42.013300 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c86e22-b77a-41cf-8229-93f996551686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:42.013949 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c86e22-b77a-41cf-8229-93f996551686 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:42.014228 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c86e22-b77a-41cf-8229-93f996551686 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:42.014499 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c86e22-b77a-41cf-8229-93f996551686 None admin] PATH_INFO: `/v3/users/30ca657152554a85b8bfe82347327b0f` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:42.037772 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c86e22-b77a-41cf-8229-93f996551686 None admin] RBAC: Authorizing `identity:get_user(user_id=30ca657152554a85b8bfe82347327b0f)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:42.039393 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c86e22-b77a-41cf-8229-93f996551686 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:42.040071 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb538a6f-d667-4b67-8b1f-7d796f3fe097 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:42.041072 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 137/284] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 15 12:10:41 2022] GET /identity/v3/users/30ca657152554a85b8bfe82347327b0f => generated 293 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:42.043111 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c86e22-b77a-41cf-8229-93f996551686 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:42.081272 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50914b61-45d5-421c-87cc-c74b5d1b3307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:42.082786 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50914b61-45d5-421c-87cc-c74b5d1b3307 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:42.083072 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50914b61-45d5-421c-87cc-c74b5d1b3307 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:42.085513 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50914b61-45d5-421c-87cc-c74b5d1b3307 None admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:42.085513 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50914b61-45d5-421c-87cc-c74b5d1b3307 None admin] RBAC: Adding query filter params (name=member) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:10:42.085513 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50914b61-45d5-421c-87cc-c74b5d1b3307 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:42.085764 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50914b61-45d5-421c-87cc-c74b5d1b3307 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:42.096672 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 148/285] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Sep 15 12:10:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:42.097327 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50914b61-45d5-421c-87cc-c74b5d1b3307 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:42.102553 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:42.116934 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:42.160628 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c86e22-b77a-41cf-8229-93f996551686 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:42.211414 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab327c1b-06cf-4509-9ae9-85e4db618d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:42.212445 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab327c1b-06cf-4509-9ae9-85e4db618d9a None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:42.212974 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab327c1b-06cf-4509-9ae9-85e4db618d9a None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:42.213264 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab327c1b-06cf-4509-9ae9-85e4db618d9a None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:42.213951 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab327c1b-06cf-4509-9ae9-85e4db618d9a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:10:42.214544 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab327c1b-06cf-4509-9ae9-85e4db618d9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:42.216669 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab327c1b-06cf-4509-9ae9-85e4db618d9a None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:42.220850 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50914b61-45d5-421c-87cc-c74b5d1b3307 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:42.227895 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 138/286] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Sep 15 12:10:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:42.229246 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab327c1b-06cf-4509-9ae9-85e4db618d9a None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:42.257518 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059e0a9a-5da8-4ea5-8aa8-9704624c8c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:42.258203 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e0a9a-5da8-4ea5-8aa8-9704624c8c0f None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:42.258621 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e0a9a-5da8-4ea5-8aa8-9704624c8c0f None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:42.258984 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e0a9a-5da8-4ea5-8aa8-9704624c8c0f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:42.259768 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059e0a9a-5da8-4ea5-8aa8-9704624c8c0f None admin] RBAC: Adding query filter params (role.id=9371e5bbc55848949eb951a815f817f2, user.id=30ca657152554a85b8bfe82347327b0f, scope.system=all) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:10:42.260135 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059e0a9a-5da8-4ea5-8aa8-9704624c8c0f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:42.261856 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059e0a9a-5da8-4ea5-8aa8-9704624c8c0f None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:42.274994 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 149/287] 10.222.0.16 () {56 vars in 1308 bytes} [Thu Sep 15 12:10:42 2022] GET /identity/v3/role_assignments?user.id=30ca657152554a85b8bfe82347327b0f&scope.system=all&role.id=9371e5bbc55848949eb951a815f817f2 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:42.276118 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059e0a9a-5da8-4ea5-8aa8-9704624c8c0f None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:42.360312 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab327c1b-06cf-4509-9ae9-85e4db618d9a None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:42.406761 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:42.411930 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7acb442-5b53-4d60-b473-204c1c247eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:42.413301 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7acb442-5b53-4d60-b473-204c1c247eb9 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:42.413782 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7acb442-5b53-4d60-b473-204c1c247eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:42.415386 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7acb442-5b53-4d60-b473-204c1c247eb9 None admin] PATH_INFO: `/v3/users/ed3b2819298a4d2f8a4d571594754f38` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:42.419076 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7acb442-5b53-4d60-b473-204c1c247eb9 None admin] RBAC: Authorizing `identity:get_user(user_id=ed3b2819298a4d2f8a4d571594754f38)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:42.422206 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7acb442-5b53-4d60-b473-204c1c247eb9 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:42.429632 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 139/288] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 15 12:10:42 2022] GET /identity/v3/users/ed3b2819298a4d2f8a4d571594754f38 => generated 297 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:42.432790 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:42.439150 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7acb442-5b53-4d60-b473-204c1c247eb9 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:42.523325 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059e0a9a-5da8-4ea5-8aa8-9704624c8c0f None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:42.564873 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d781c305-c442-4f10-8034-0f0876008dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:42.565517 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d781c305-c442-4f10-8034-0f0876008dc0 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:42.565797 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d781c305-c442-4f10-8034-0f0876008dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:42.566086 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d781c305-c442-4f10-8034-0f0876008dc0 None admin] PATH_INFO: `/v3/users/04cd3fb911214c7380642bcbe272ff03` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:42.567478 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d781c305-c442-4f10-8034-0f0876008dc0 None admin] RBAC: Authorizing `identity:get_user(user_id=04cd3fb911214c7380642bcbe272ff03)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:42.568934 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d781c305-c442-4f10-8034-0f0876008dc0 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:42.570540 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 150/289] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 15 12:10:42 2022] GET /identity/v3/users/04cd3fb911214c7380642bcbe272ff03 => generated 297 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:42.576813 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d781c305-c442-4f10-8034-0f0876008dc0 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:42.652934 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7acb442-5b53-4d60-b473-204c1c247eb9 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:42.690668 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d781c305-c442-4f10-8034-0f0876008dc0 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:42.728908 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b7ddd2-81cd-49be-ba17-fc5e38d72168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:42.729548 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b7ddd2-81cd-49be-ba17-fc5e38d72168 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:42.729827 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b7ddd2-81cd-49be-ba17-fc5e38d72168 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:42.730100 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b7ddd2-81cd-49be-ba17-fc5e38d72168 None admin] PATH_INFO: `/v3/projects/dd97fe3d09654c728d99e82d47ef59a5` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:42.731374 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b7ddd2-81cd-49be-ba17-fc5e38d72168 None admin] RBAC: Authorizing `identity:get_project(project_id=dd97fe3d09654c728d99e82d47ef59a5)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:42.732716 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c97a12-b964-437e-8f82-ee5315da2707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:42.733038 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b7ddd2-81cd-49be-ba17-fc5e38d72168 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:42.733328 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c97a12-b964-437e-8f82-ee5315da2707 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:42.733601 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c97a12-b964-437e-8f82-ee5315da2707 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:42.733867 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c97a12-b964-437e-8f82-ee5315da2707 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:42.740227 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 151/290] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 15 12:10:42 2022] GET /identity/v3/projects/dd97fe3d09654c728d99e82d47ef59a5 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:10:42.741597 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b7ddd2-81cd-49be-ba17-fc5e38d72168 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:42.744528 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:42.859415 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b7ddd2-81cd-49be-ba17-fc5e38d72168 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:42.890145 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:42.898571 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d9ccdb-41d0-43ab-92f3-25469598c934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:42.899098 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c97a12-b964-437e-8f82-ee5315da2707 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:42.899976 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d9ccdb-41d0-43ab-92f3-25469598c934 None admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:42.900324 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c97a12-b964-437e-8f82-ee5315da2707 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:42.900705 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d9ccdb-41d0-43ab-92f3-25469598c934 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:42.901172 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d9ccdb-41d0-43ab-92f3-25469598c934 None admin] PATH_INFO: `/v3/projects/dd97fe3d09654c728d99e82d47ef59a5/users/04cd3fb911214c7380642bcbe272ff03/roles/da591cd17baa4d009b74f6facf2a6688` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:42.903539 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d9ccdb-41d0-43ab-92f3-25469598c934 None admin] RBAC: Authorizing `identity:create_grant(project_id=dd97fe3d09654c728d99e82d47ef59a5, user_id=04cd3fb911214c7380642bcbe272ff03, role_id=da591cd17baa4d009b74f6facf2a6688)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:42.905158 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d9ccdb-41d0-43ab-92f3-25469598c934 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:42.924459 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 152/291] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Sep 15 12:10:42 2022] PUT /identity/v3/projects/dd97fe3d09654c728d99e82d47ef59a5/users/04cd3fb911214c7380642bcbe272ff03/roles/da591cd17baa4d009b74f6facf2a6688 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:10:43.095644 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 140/292] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 15 12:10:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 657 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 12:10:43.101517 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d9ccdb-41d0-43ab-92f3-25469598c934 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:43.187862 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:43.230380 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d9ccdb-41d0-43ab-92f3-25469598c934 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:43.267549 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dd17f0-23ad-4ec8-8e01-5304de06e0fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:43.268434 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dd17f0-23ad-4ec8-8e01-5304de06e0fc None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:43.268907 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dd17f0-23ad-4ec8-8e01-5304de06e0fc None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:43.269314 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dd17f0-23ad-4ec8-8e01-5304de06e0fc None admin] PATH_INFO: `/v3/projects/dd97fe3d09654c728d99e82d47ef59a5` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:43.270644 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dd17f0-23ad-4ec8-8e01-5304de06e0fc None admin] RBAC: Authorizing `identity:get_project(project_id=dd97fe3d09654c728d99e82d47ef59a5)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:43.272220 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dd17f0-23ad-4ec8-8e01-5304de06e0fc None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:43.274272 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 153/293] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 15 12:10:43 2022] GET /identity/v3/projects/dd97fe3d09654c728d99e82d47ef59a5 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:43.280107 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c97a12-b964-437e-8f82-ee5315da2707 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:43.413905 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:43.417792 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c97a12-b964-437e-8f82-ee5315da2707 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:43.459542 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb1cb7c-8f68-44c5-a1a2-be4ee3a0338a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:43.460108 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb1cb7c-8f68-44c5-a1a2-be4ee3a0338a None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:43.460380 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb1cb7c-8f68-44c5-a1a2-be4ee3a0338a None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:43.460681 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb1cb7c-8f68-44c5-a1a2-be4ee3a0338a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:43.461408 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb1cb7c-8f68-44c5-a1a2-be4ee3a0338a None admin] RBAC: Adding query filter params (role.id=9371e5bbc55848949eb951a815f817f2, scope.project.id=dd97fe3d09654c728d99e82d47ef59a5, user.id=ed3b2819298a4d2f8a4d571594754f38) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:10:43.461751 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb1cb7c-8f68-44c5-a1a2-be4ee3a0338a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:43.463574 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb1cb7c-8f68-44c5-a1a2-be4ee3a0338a None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:43.470421 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 141/294] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 15 12:10:43 2022] GET /identity/v3/role_assignments?user.id=ed3b2819298a4d2f8a4d571594754f38&scope.project.id=dd97fe3d09654c728d99e82d47ef59a5&role.id=9371e5bbc55848949eb951a815f817f2 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:44.142826 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9af6cf-a167-4e8d-a290-a6dc3b6817ee None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:44.143745 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9af6cf-a167-4e8d-a290-a6dc3b6817ee None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:44.144188 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9af6cf-a167-4e8d-a290-a6dc3b6817ee None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:44.145708 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 154/295] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:10:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:10:44.152594 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24750d94-07cd-4715-b086-e3f4679b8442 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:44.153193 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24750d94-07cd-4715-b086-e3f4679b8442 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:44.153750 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24750d94-07cd-4715-b086-e3f4679b8442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:44.176804 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-24750d94-07cd-4715-b086-e3f4679b8442 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:10:44.178225 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-24750d94-07cd-4715-b086-e3f4679b8442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:10:44.266869 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 142/296] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:10:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 12:10:44.520875 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d770a90-e86f-45db-b51f-c179c88b3344 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:44.521544 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d770a90-e86f-45db-b51f-c179c88b3344 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:44.522023 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d770a90-e86f-45db-b51f-c179c88b3344 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:44.523852 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 155/297] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:10:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:10:44.529233 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7040bf-20d3-41b9-a8b5-e8a8655408b7 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:44.529520 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7040bf-20d3-41b9-a8b5-e8a8655408b7 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:44.529794 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7040bf-20d3-41b9-a8b5-e8a8655408b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:44.545925 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d770a90-e86f-45db-b51f-c179c88b3344 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:44.555566 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-de7040bf-20d3-41b9-a8b5-e8a8655408b7 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:10:44.556754 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-de7040bf-20d3-41b9-a8b5-e8a8655408b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:10:44.650742 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 143/298] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:10:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 12:10:44.677287 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d770a90-e86f-45db-b51f-c179c88b3344 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:44.706336 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:44.712783 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a019a9-790d-468b-9254-f7054bdc4089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:44.713682 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a019a9-790d-468b-9254-f7054bdc4089 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:44.714151 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a019a9-790d-468b-9254-f7054bdc4089 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:44.714676 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a019a9-790d-468b-9254-f7054bdc4089 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:44.726381 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a019a9-790d-468b-9254-f7054bdc4089 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:10:44.731450 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-d2a019a9-790d-468b-9254-f7054bdc4089 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 12:10:44.731450 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:10:44.731450 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:10:44.731450 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:10:44.731450 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:10:44.731450 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:10:44.731450 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:10:44.731450 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:10:44.731450 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:10:44.731450 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:10:44.731450 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:10:44.731450 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:10:44.731450 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:10:44.731450 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:10:44.731450 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:10:44.731450 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:10:44.732310 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:10:44.732310 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:10:44.732310 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:10:44.732310 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:10:44.732310 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:10:44.732310 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:10:44.732310 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:10:44.732310 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:10:44.732310 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:10:44.732310 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:10:44.732310 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:10:44.732310 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:10:44.732310 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:10:44.732310 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:10:44.732310 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:10:44.732310 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:10:44.733107 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:10:44.733107 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:10:44.733107 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:10:44.733107 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:10:44.733107 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:10:44.733107 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:10:44.733107 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:10:44.733107 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:10:44.733107 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:10:44.733107 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:10:44.733107 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 12:10:44.733107 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:10:44.735699 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 156/299] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 15 12:10:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:10:44.742730 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7040bf-20d3-41b9-a8b5-e8a8655408b7 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:44.766550 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:44.851707 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7040bf-20d3-41b9-a8b5-e8a8655408b7 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:44.891223 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a5ee7-1a0a-4381-8ae3-b60297175e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:44.892266 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a5ee7-1a0a-4381-8ae3-b60297175e29 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:44.892769 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a5ee7-1a0a-4381-8ae3-b60297175e29 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:44.893248 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a5ee7-1a0a-4381-8ae3-b60297175e29 None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:44.894465 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746a5ee7-1a0a-4381-8ae3-b60297175e29 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:10:44.895348 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746a5ee7-1a0a-4381-8ae3-b60297175e29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:44.896867 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746a5ee7-1a0a-4381-8ae3-b60297175e29 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:44.906550 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 144/300] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Sep 15 12:10:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:44.912956 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a019a9-790d-468b-9254-f7054bdc4089 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:44.954345 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb24ad5-4cc3-4944-ae20-239a1bc10e91 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:44.954666 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb24ad5-4cc3-4944-ae20-239a1bc10e91 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:44.954919 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb24ad5-4cc3-4944-ae20-239a1bc10e91 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:44.956503 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 145/301] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:10:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:10:44.963788 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5287b046-4de5-4b52-aa25-9957f402fb30 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:44.964164 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5287b046-4de5-4b52-aa25-9957f402fb30 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:44.964568 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5287b046-4de5-4b52-aa25-9957f402fb30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:44.988467 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-5287b046-4de5-4b52-aa25-9957f402fb30 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:10:44.989652 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-5287b046-4de5-4b52-aa25-9957f402fb30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:10:45.023018 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a019a9-790d-468b-9254-f7054bdc4089 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:45.057780 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f532de-2fa4-4aa1-84c6-5ca8e08ebd70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:45.058399 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f532de-2fa4-4aa1-84c6-5ca8e08ebd70 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:45.058673 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f532de-2fa4-4aa1-84c6-5ca8e08ebd70 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:45.058969 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f532de-2fa4-4aa1-84c6-5ca8e08ebd70 None admin] PATH_INFO: `/v3/users/f53bc0b7d24c43e48b6b162a92cc18d8` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:45.066983 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 146/302] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:10:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 12:10:45.067724 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5287b046-4de5-4b52-aa25-9957f402fb30 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:45.075124 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f532de-2fa4-4aa1-84c6-5ca8e08ebd70 None admin] RBAC: Authorizing `identity:get_user(user_id=f53bc0b7d24c43e48b6b162a92cc18d8)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:45.077038 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f532de-2fa4-4aa1-84c6-5ca8e08ebd70 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:45.078705 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 157/303] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 15 12:10:44 2022] GET /identity/v3/users/f53bc0b7d24c43e48b6b162a92cc18d8 => generated 293 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:45.084077 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f532de-2fa4-4aa1-84c6-5ca8e08ebd70 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:45.087654 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:45.138762 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:45.183713 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5287b046-4de5-4b52-aa25-9957f402fb30 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:45.193211 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f532de-2fa4-4aa1-84c6-5ca8e08ebd70 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:45.222143 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feb30cf-655e-4864-8891-f073df82ae91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:45.223380 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feb30cf-655e-4864-8891-f073df82ae91 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:45.223803 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feb30cf-655e-4864-8891-f073df82ae91 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:45.224721 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feb30cf-655e-4864-8891-f073df82ae91 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:45.227127 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feb30cf-655e-4864-8891-f073df82ae91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:45.230041 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feb30cf-655e-4864-8891-f073df82ae91 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:45.238159 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933dc3ac-a411-4483-bc25-ce25366a87c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:45.238159 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933dc3ac-a411-4483-bc25-ce25366a87c4 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:45.238159 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933dc3ac-a411-4483-bc25-ce25366a87c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:45.238159 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933dc3ac-a411-4483-bc25-ce25366a87c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:45.238551 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933dc3ac-a411-4483-bc25-ce25366a87c4 None admin] RBAC: Adding query filter params (role.id=da591cd17baa4d009b74f6facf2a6688, user.id=f53bc0b7d24c43e48b6b162a92cc18d8, scope.system=all) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:10:45.238551 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933dc3ac-a411-4483-bc25-ce25366a87c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:45.238875 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933dc3ac-a411-4483-bc25-ce25366a87c4 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:45.239333 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 147/304] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:10:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:45.241403 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feb30cf-655e-4864-8891-f073df82ae91 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:45.251120 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 158/305] 10.222.0.16 () {56 vars in 1308 bytes} [Thu Sep 15 12:10:45 2022] GET /identity/v3/role_assignments?user.id=f53bc0b7d24c43e48b6b162a92cc18d8&scope.system=all&role.id=da591cd17baa4d009b74f6facf2a6688 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:10:45.333967 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933dc3ac-a411-4483-bc25-ce25366a87c4 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:45.339103 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:45.365845 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feb30cf-655e-4864-8891-f073df82ae91 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:45.417876 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50962e5e-c745-4635-9804-c1744a9f6c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:45.418683 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50962e5e-c745-4635-9804-c1744a9f6c7a None admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:45.418987 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50962e5e-c745-4635-9804-c1744a9f6c7a None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:45.419297 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50962e5e-c745-4635-9804-c1744a9f6c7a None admin] PATH_INFO: `/v3/groups` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:45.420556 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50962e5e-c745-4635-9804-c1744a9f6c7a None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:45.422218 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50962e5e-c745-4635-9804-c1744a9f6c7a None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:45.449249 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 148/306] 10.222.0.16 () {60 vars in 1134 bytes} [Thu Sep 15 12:10:45 2022] POST /identity/v3/groups => generated 229 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:10:45.465425 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933dc3ac-a411-4483-bc25-ce25366a87c4 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:45.481209 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ce68a5-ee1d-43b5-ae18-62c3591c5275 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:45.481524 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ce68a5-ee1d-43b5-ae18-62c3591c5275 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:45.481770 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ce68a5-ee1d-43b5-ae18-62c3591c5275 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:45.482617 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:45.483250 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 149/307] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:10:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 12:10:45.489450 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e1bf58-b9c7-4892-bf2e-c713f6c7e8dc None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:45.489751 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e1bf58-b9c7-4892-bf2e-c713f6c7e8dc None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:45.490009 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e1bf58-b9c7-4892-bf2e-c713f6c7e8dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:45.506772 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061cc9fa-84fc-4c79-b7b5-f15ae7e56150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:45.507551 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061cc9fa-84fc-4c79-b7b5-f15ae7e56150 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:45.507827 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061cc9fa-84fc-4c79-b7b5-f15ae7e56150 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:45.508094 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061cc9fa-84fc-4c79-b7b5-f15ae7e56150 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:45.510156 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-c2e1bf58-b9c7-4892-bf2e-c713f6c7e8dc None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:10:45.511563 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-c2e1bf58-b9c7-4892-bf2e-c713f6c7e8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:10:45.521144 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061cc9fa-84fc-4c79-b7b5-f15ae7e56150 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:10:45.528688 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-061cc9fa-84fc-4c79-b7b5-f15ae7e56150 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 12:10:45.528688 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:10:45.528688 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:10:45.528688 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:10:45.528688 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:10:45.528688 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:10:45.528688 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:10:45.528688 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:10:45.528688 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:10:45.528688 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:10:45.528688 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:10:45.528688 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:10:45.528688 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:10:45.528688 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:10:45.528688 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:10:45.528688 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:10:45.529624 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:10:45.529624 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:10:45.529624 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:10:45.529624 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:10:45.529624 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:10:45.529624 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:10:45.529624 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:10:45.529624 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:10:45.529624 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:10:45.529624 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:10:45.529624 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:10:45.529624 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:10:45.529624 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:10:45.529624 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:10:45.529624 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:10:45.529624 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:10:45.530396 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:10:45.530396 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:10:45.530396 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:10:45.530396 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:10:45.530396 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:10:45.530396 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:10:45.530396 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:10:45.530396 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:10:45.530396 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:10:45.530396 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:10:45.530396 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 12:10:45.530396 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:10:45.533370 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 159/308] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 15 12:10:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:10:45.539471 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061cc9fa-84fc-4c79-b7b5-f15ae7e56150 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:45.615250 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 150/309] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:10:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 12:10:45.654750 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061cc9fa-84fc-4c79-b7b5-f15ae7e56150 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:45.690833 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8562eabb-0ea2-489b-ae21-599c9728119b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:45.691442 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8562eabb-0ea2-489b-ae21-599c9728119b None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:45.691721 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8562eabb-0ea2-489b-ae21-599c9728119b None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:45.691992 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8562eabb-0ea2-489b-ae21-599c9728119b None admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:45.692659 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8562eabb-0ea2-489b-ae21-599c9728119b None admin] RBAC: Adding query filter params (name=member) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:10:45.692960 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8562eabb-0ea2-489b-ae21-599c9728119b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:45.694326 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8562eabb-0ea2-489b-ae21-599c9728119b None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:45.703042 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 160/310] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Sep 15 12:10:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:10:45.709068 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e1bf58-b9c7-4892-bf2e-c713f6c7e8dc None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:45.781030 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:45.814349 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e1bf58-b9c7-4892-bf2e-c713f6c7e8dc None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:45.852942 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f927a4-5580-45cc-ac7c-bb52a5b5706d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:45.853635 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f927a4-5580-45cc-ac7c-bb52a5b5706d None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:45.853916 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f927a4-5580-45cc-ac7c-bb52a5b5706d None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:45.854193 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f927a4-5580-45cc-ac7c-bb52a5b5706d None admin] PATH_INFO: `/v3/users/30ca657152554a85b8bfe82347327b0f` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:45.855360 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f927a4-5580-45cc-ac7c-bb52a5b5706d None admin] RBAC: Authorizing `identity:get_user(user_id=30ca657152554a85b8bfe82347327b0f)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:45.856806 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f927a4-5580-45cc-ac7c-bb52a5b5706d None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:45.858784 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 151/311] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 15 12:10:45 2022] GET /identity/v3/users/30ca657152554a85b8bfe82347327b0f => generated 293 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:45.864256 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8562eabb-0ea2-489b-ae21-599c9728119b None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:45.900428 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:45.903828 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f927a4-5580-45cc-ac7c-bb52a5b5706d None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:45.999590 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8562eabb-0ea2-489b-ae21-599c9728119b None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:46.028622 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f927a4-5580-45cc-ac7c-bb52a5b5706d None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:46.050434 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b083c0-4815-4439-9410-c9ac9cfa8658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:46.051786 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b083c0-4815-4439-9410-c9ac9cfa8658 None admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:46.052264 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b083c0-4815-4439-9410-c9ac9cfa8658 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:46.052982 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b083c0-4815-4439-9410-c9ac9cfa8658 None admin] PATH_INFO: `/v3/system/users/30ca657152554a85b8bfe82347327b0f/roles/9371e5bbc55848949eb951a815f817f2` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:46.055304 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b083c0-4815-4439-9410-c9ac9cfa8658 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=30ca657152554a85b8bfe82347327b0f, role_id=9371e5bbc55848949eb951a815f817f2)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:46.057839 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b083c0-4815-4439-9410-c9ac9cfa8658 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:46.068712 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6ddf8a-00a8-46ac-8eb8-d9f0b9cc1011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:46.069581 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6ddf8a-00a8-46ac-8eb8-d9f0b9cc1011 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:46.070010 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6ddf8a-00a8-46ac-8eb8-d9f0b9cc1011 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:46.070376 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6ddf8a-00a8-46ac-8eb8-d9f0b9cc1011 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:46.078947 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 161/312] 10.222.0.16 () {58 vars in 1334 bytes} [Thu Sep 15 12:10:45 2022] PUT /identity/v3/system/users/30ca657152554a85b8bfe82347327b0f/roles/9371e5bbc55848949eb951a815f817f2 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:10:46.082022 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:46.086806 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6ddf8a-00a8-46ac-8eb8-d9f0b9cc1011 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:10:46.092570 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-0a6ddf8a-00a8-46ac-8eb8-d9f0b9cc1011 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 12:10:46.092570 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:10:46.092570 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:10:46.092570 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:10:46.092570 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:10:46.092570 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:10:46.092570 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:10:46.092570 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:10:46.092570 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:10:46.092570 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:10:46.092570 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:10:46.092570 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:10:46.092570 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:10:46.092570 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:10:46.092570 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:10:46.092570 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:10:46.093517 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:10:46.093517 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:10:46.093517 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:10:46.093517 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:10:46.093517 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:10:46.093517 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:10:46.093517 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:10:46.093517 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:10:46.093517 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:10:46.093517 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:10:46.093517 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:10:46.093517 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:10:46.093517 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:10:46.093517 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:10:46.093517 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:10:46.093517 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:10:46.094324 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:10:46.094324 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:10:46.094324 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:10:46.094324 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:10:46.094324 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:10:46.094324 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:10:46.094324 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:10:46.094324 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:10:46.094324 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:10:46.094324 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:10:46.094324 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 12:10:46.094324 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:10:46.094324 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 152/313] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 15 12:10:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:10:46.100155 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b083c0-4815-4439-9410-c9ac9cfa8658 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:46.229604 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:46.233966 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b083c0-4815-4439-9410-c9ac9cfa8658 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:46.274259 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74af0c2-0229-41b0-983a-52393c9c5590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:46.274911 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74af0c2-0229-41b0-983a-52393c9c5590 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:46.275189 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74af0c2-0229-41b0-983a-52393c9c5590 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:46.275453 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74af0c2-0229-41b0-983a-52393c9c5590 None admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:46.276114 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74af0c2-0229-41b0-983a-52393c9c5590 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:10:46.276413 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74af0c2-0229-41b0-983a-52393c9c5590 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:46.277769 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74af0c2-0229-41b0-983a-52393c9c5590 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:46.286453 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 162/314] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Sep 15 12:10:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:46.292241 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6ddf8a-00a8-46ac-8eb8-d9f0b9cc1011 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:46.396771 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6ddf8a-00a8-46ac-8eb8-d9f0b9cc1011 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:46.435802 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dcdcb9-a38a-4adb-a782-c9ac07c7f97e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:46.436441 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dcdcb9-a38a-4adb-a782-c9ac07c7f97e None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:46.436718 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dcdcb9-a38a-4adb-a782-c9ac07c7f97e None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:46.436988 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dcdcb9-a38a-4adb-a782-c9ac07c7f97e None admin] PATH_INFO: `/v3/users/04cd3fb911214c7380642bcbe272ff03` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:46.438660 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dcdcb9-a38a-4adb-a782-c9ac07c7f97e None admin] RBAC: Authorizing `identity:get_user(user_id=04cd3fb911214c7380642bcbe272ff03)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:46.440112 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dcdcb9-a38a-4adb-a782-c9ac07c7f97e None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:46.441979 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 153/315] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 15 12:10:46 2022] GET /identity/v3/users/04cd3fb911214c7380642bcbe272ff03 => generated 297 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:46.449154 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74af0c2-0229-41b0-983a-52393c9c5590 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:46.551310 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74af0c2-0229-41b0-983a-52393c9c5590 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:46.585978 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee38d71-1874-4599-93c4-4ce71d97d874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:46.586800 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee38d71-1874-4599-93c4-4ce71d97d874 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:46.587076 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee38d71-1874-4599-93c4-4ce71d97d874 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:46.587341 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee38d71-1874-4599-93c4-4ce71d97d874 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:46.619208 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:46.658880 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee38d71-1874-4599-93c4-4ce71d97d874 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:46.660339 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee38d71-1874-4599-93c4-4ce71d97d874 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:46.760801 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 163/316] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 15 12:10:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 12:10:46.766367 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dcdcb9-a38a-4adb-a782-c9ac07c7f97e None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:46.835774 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:46.871344 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dcdcb9-a38a-4adb-a782-c9ac07c7f97e None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:46.906072 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8692231d-2c7e-430c-be6b-35dae8eaac6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:46.907344 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692231d-2c7e-430c-be6b-35dae8eaac6f None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:46.907630 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692231d-2c7e-430c-be6b-35dae8eaac6f None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:46.907901 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692231d-2c7e-430c-be6b-35dae8eaac6f None admin] PATH_INFO: `/v3/projects/dd97fe3d09654c728d99e82d47ef59a5` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:46.909033 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8692231d-2c7e-430c-be6b-35dae8eaac6f None admin] RBAC: Authorizing `identity:get_project(project_id=dd97fe3d09654c728d99e82d47ef59a5)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:46.910462 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8692231d-2c7e-430c-be6b-35dae8eaac6f None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:46.912528 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 154/317] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 15 12:10:46 2022] GET /identity/v3/projects/dd97fe3d09654c728d99e82d47ef59a5 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:46.918003 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee38d71-1874-4599-93c4-4ce71d97d874 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:46.986875 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:47.029803 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee38d71-1874-4599-93c4-4ce71d97d874 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:47.066524 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f09355-7692-4b6b-ae27-286016c78429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:47.067153 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f09355-7692-4b6b-ae27-286016c78429 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:47.067491 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f09355-7692-4b6b-ae27-286016c78429 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:47.067795 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f09355-7692-4b6b-ae27-286016c78429 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:47.068510 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f09355-7692-4b6b-ae27-286016c78429 None admin] RBAC: Adding query filter params (role.id=da591cd17baa4d009b74f6facf2a6688, scope.project.id=dd97fe3d09654c728d99e82d47ef59a5, user.id=04cd3fb911214c7380642bcbe272ff03) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:10:47.068814 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f09355-7692-4b6b-ae27-286016c78429 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:47.070218 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f09355-7692-4b6b-ae27-286016c78429 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:47.076308 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 164/318] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 15 12:10:46 2022] GET /identity/v3/role_assignments?user.id=04cd3fb911214c7380642bcbe272ff03&scope.project.id=dd97fe3d09654c728d99e82d47ef59a5&role.id=da591cd17baa4d009b74f6facf2a6688 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:47.571371 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65bcb4d-09fa-4169-a091-61a099fb112d None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:47.571879 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65bcb4d-09fa-4169-a091-61a099fb112d None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:47.571953 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65bcb4d-09fa-4169-a091-61a099fb112d None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:47.573407 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 155/319] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:10:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:10:47.578303 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc431cd5-61bb-4864-9871-53aadb0af7c6 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:47.579586 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc431cd5-61bb-4864-9871-53aadb0af7c6 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:47.580045 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc431cd5-61bb-4864-9871-53aadb0af7c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:47.599118 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-cc431cd5-61bb-4864-9871-53aadb0af7c6 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:10:47.600682 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-cc431cd5-61bb-4864-9871-53aadb0af7c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:10:47.673721 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 165/320] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:10:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:10:47.733404 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abb7e6e-ebba-47c2-92ec-7b8396107274 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:47.733773 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abb7e6e-ebba-47c2-92ec-7b8396107274 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:47.734120 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abb7e6e-ebba-47c2-92ec-7b8396107274 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:47.736036 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 156/321] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:10:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:10:47.741309 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec96f7-549d-4392-b9b2-7cef2908b35b None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:47.741586 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec96f7-549d-4392-b9b2-7cef2908b35b None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:47.741850 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec96f7-549d-4392-b9b2-7cef2908b35b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:47.761058 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-a8ec96f7-549d-4392-b9b2-7cef2908b35b None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:10:47.762236 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-a8ec96f7-549d-4392-b9b2-7cef2908b35b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:10:47.812604 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:47.832186 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 166/322] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:10:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 12:10:47.942781 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abb7e6e-ebba-47c2-92ec-7b8396107274 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:48.053283 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abb7e6e-ebba-47c2-92ec-7b8396107274 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:48.087221 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d925e8a5-fd1c-48c6-ae18-3675879f3e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:48.088151 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d925e8a5-fd1c-48c6-ae18-3675879f3e70 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:48.088622 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d925e8a5-fd1c-48c6-ae18-3675879f3e70 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:48.089099 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d925e8a5-fd1c-48c6-ae18-3675879f3e70 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:48.091920 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:48.102007 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d925e8a5-fd1c-48c6-ae18-3675879f3e70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:10:48.102472 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec96f7-549d-4392-b9b2-7cef2908b35b None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:48.108893 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-d925e8a5-fd1c-48c6-ae18-3675879f3e70 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 12:10:48.108893 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:10:48.108893 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:10:48.108893 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:10:48.108893 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:10:48.108893 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:10:48.108893 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:10:48.108893 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:10:48.108893 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:10:48.108893 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:10:48.108893 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:10:48.108893 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:10:48.108893 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:10:48.108893 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:10:48.108893 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:10:48.108893 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:10:48.110328 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:10:48.110328 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:10:48.110328 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:10:48.110328 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:10:48.110328 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:10:48.110328 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:10:48.110328 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:10:48.110328 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:10:48.110328 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:10:48.110328 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:10:48.110328 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:10:48.110328 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:10:48.110328 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:10:48.110328 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:10:48.110328 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:10:48.110328 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:10:48.111157 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:10:48.111157 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:10:48.111157 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:10:48.111157 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:10:48.111157 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:10:48.111157 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:10:48.111157 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:10:48.111157 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:10:48.111157 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:10:48.111157 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:10:48.111157 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 12:10:48.111157 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:10:48.111739 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 157/323] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 15 12:10:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:10:48.116927 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d925e8a5-fd1c-48c6-ae18-3675879f3e70 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:48.212265 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec96f7-549d-4392-b9b2-7cef2908b35b None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:48.227154 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d925e8a5-fd1c-48c6-ae18-3675879f3e70 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:48.246834 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d202893d-3767-4f0a-b278-3b969a5a870f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:48.247549 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202893d-3767-4f0a-b278-3b969a5a870f None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:48.247831 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202893d-3767-4f0a-b278-3b969a5a870f None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:48.248099 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202893d-3767-4f0a-b278-3b969a5a870f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:48.249190 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d202893d-3767-4f0a-b278-3b969a5a870f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:48.251413 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d202893d-3767-4f0a-b278-3b969a5a870f None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:48.253127 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 167/324] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:10:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:10:48.258776 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d202893d-3767-4f0a-b278-3b969a5a870f None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:48.265126 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3429e4-0756-46b0-9b31-ef3eed0973ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:48.265740 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3429e4-0756-46b0-9b31-ef3eed0973ab None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:48.266624 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3429e4-0756-46b0-9b31-ef3eed0973ab None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:48.266932 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3429e4-0756-46b0-9b31-ef3eed0973ab None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:48.267601 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3429e4-0756-46b0-9b31-ef3eed0973ab None admin] RBAC: Adding query filter params (name=reader) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:10:48.267909 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3429e4-0756-46b0-9b31-ef3eed0973ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:48.269285 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3429e4-0756-46b0-9b31-ef3eed0973ab None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:48.277873 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 158/325] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Sep 15 12:10:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:10:48.283984 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3429e4-0756-46b0-9b31-ef3eed0973ab None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:48.316692 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:48.342895 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:48.364310 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d202893d-3767-4f0a-b278-3b969a5a870f None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:48.384502 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3429e4-0756-46b0-9b31-ef3eed0973ab None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:48.398771 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ea4264-3977-48bb-aaa3-0bea380045f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:48.399334 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea4264-3977-48bb-aaa3-0bea380045f4 None admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:48.399608 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea4264-3977-48bb-aaa3-0bea380045f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:48.399877 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea4264-3977-48bb-aaa3-0bea380045f4 None admin] PATH_INFO: `/v3/groups` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:48.400502 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ea4264-3977-48bb-aaa3-0bea380045f4 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:48.401923 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ea4264-3977-48bb-aaa3-0bea380045f4 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:48.418799 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea0d231-a812-4866-996e-fcfc511584fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:48.419423 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea0d231-a812-4866-996e-fcfc511584fe None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:48.419701 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea0d231-a812-4866-996e-fcfc511584fe None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:48.419975 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea0d231-a812-4866-996e-fcfc511584fe None admin] PATH_INFO: `/v3/users/f53bc0b7d24c43e48b6b162a92cc18d8` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:48.420801 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 168/326] 10.222.0.16 () {60 vars in 1134 bytes} [Thu Sep 15 12:10:48 2022] POST /identity/v3/groups => generated 226 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:10:48.438921 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea0d231-a812-4866-996e-fcfc511584fe None admin] RBAC: Authorizing `identity:get_user(user_id=f53bc0b7d24c43e48b6b162a92cc18d8)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:48.439013 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d4d994-c155-412d-9500-2a8195c96993 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:48.439013 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d4d994-c155-412d-9500-2a8195c96993 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:48.439190 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea0d231-a812-4866-996e-fcfc511584fe None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:48.439269 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d4d994-c155-412d-9500-2a8195c96993 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:48.439269 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 169/327] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:10:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:10:48.439406 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 159/328] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 15 12:10:48 2022] GET /identity/v3/users/f53bc0b7d24c43e48b6b162a92cc18d8 => generated 293 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:10:48.439482 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c169f11c-9fae-4eda-a524-952e61256d34 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:48.439482 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c169f11c-9fae-4eda-a524-952e61256d34 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:48.439482 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c169f11c-9fae-4eda-a524-952e61256d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:48.439691 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea0d231-a812-4866-996e-fcfc511584fe None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:48.452904 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-c169f11c-9fae-4eda-a524-952e61256d34 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:10:48.454716 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-c169f11c-9fae-4eda-a524-952e61256d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:10:48.539365 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 170/329] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:10:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:10:48.545470 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea0d231-a812-4866-996e-fcfc511584fe None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:48.572952 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:48.584742 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d699369-684b-40ee-9b99-47d1d7d7357e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:48.585404 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d699369-684b-40ee-9b99-47d1d7d7357e None admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:48.585684 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d699369-684b-40ee-9b99-47d1d7d7357e None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:48.585957 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d699369-684b-40ee-9b99-47d1d7d7357e None admin] PATH_INFO: `/v3/system/users/f53bc0b7d24c43e48b6b162a92cc18d8/roles/da591cd17baa4d009b74f6facf2a6688` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:48.587380 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d699369-684b-40ee-9b99-47d1d7d7357e None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f53bc0b7d24c43e48b6b162a92cc18d8, role_id=da591cd17baa4d009b74f6facf2a6688)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:48.588784 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d699369-684b-40ee-9b99-47d1d7d7357e None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:48.600490 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 160/330] 10.222.0.16 () {58 vars in 1334 bytes} [Thu Sep 15 12:10:48 2022] PUT /identity/v3/system/users/f53bc0b7d24c43e48b6b162a92cc18d8/roles/da591cd17baa4d009b74f6facf2a6688 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:10:48.810651 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c169f11c-9fae-4eda-a524-952e61256d34 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:48.857177 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:48.921670 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c169f11c-9fae-4eda-a524-952e61256d34 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:48.960542 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bb8907-3174-46b6-8911-80a715ddaf52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:48.961302 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb8907-3174-46b6-8911-80a715ddaf52 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:48.961587 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb8907-3174-46b6-8911-80a715ddaf52 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:48.961862 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb8907-3174-46b6-8911-80a715ddaf52 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:48.976510 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bb8907-3174-46b6-8911-80a715ddaf52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:10:48.981449 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-a8bb8907-3174-46b6-8911-80a715ddaf52 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 12:10:48.981449 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:10:48.981449 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:10:48.981449 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:10:48.981449 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:10:48.981449 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:10:48.981449 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:10:48.981449 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:10:48.981449 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:10:48.981449 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:10:48.981449 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:10:48.981449 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:10:48.981449 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:10:48.981449 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:10:48.981449 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:10:48.981449 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:10:48.982339 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:10:48.982339 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:10:48.982339 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:10:48.982339 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:10:48.982339 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:10:48.982339 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:10:48.982339 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:10:48.982339 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:10:48.982339 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:10:48.982339 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:10:48.982339 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:10:48.982339 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:10:48.982339 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:10:48.982339 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:10:48.982339 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:10:48.982339 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:10:48.983144 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:10:48.983144 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:10:48.983144 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:10:48.983144 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:10:48.983144 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:10:48.983144 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:10:48.983144 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:10:48.983144 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:10:48.983144 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:10:48.983144 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:10:48.983144 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 12:10:48.983144 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:10:48.987009 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 171/331] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 15 12:10:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:10:48.991802 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d699369-684b-40ee-9b99-47d1d7d7357e None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:49.109055 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d699369-684b-40ee-9b99-47d1d7d7357e None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:49.150583 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aecbdf-d5ba-4deb-9f5c-27f93a412f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:49.151235 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aecbdf-d5ba-4deb-9f5c-27f93a412f95 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:49.151520 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aecbdf-d5ba-4deb-9f5c-27f93a412f95 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:49.151795 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aecbdf-d5ba-4deb-9f5c-27f93a412f95 None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:49.152473 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aecbdf-d5ba-4deb-9f5c-27f93a412f95 None admin] RBAC: Adding query filter params (name=member) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:10:49.152781 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aecbdf-d5ba-4deb-9f5c-27f93a412f95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:49.154164 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aecbdf-d5ba-4deb-9f5c-27f93a412f95 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:49.163351 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 161/332] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Sep 15 12:10:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:49.168715 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bb8907-3174-46b6-8911-80a715ddaf52 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:49.298358 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bb8907-3174-46b6-8911-80a715ddaf52 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:49.300235 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:49.340856 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b470eda5-3d97-41c2-bb4a-37871a6e32ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:49.341870 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b470eda5-3d97-41c2-bb4a-37871a6e32ef None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:49.342342 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b470eda5-3d97-41c2-bb4a-37871a6e32ef None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:49.342844 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b470eda5-3d97-41c2-bb4a-37871a6e32ef None admin] PATH_INFO: `/v3/users/30ca657152554a85b8bfe82347327b0f` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:49.346071 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b470eda5-3d97-41c2-bb4a-37871a6e32ef None admin] RBAC: Authorizing `identity:get_user(user_id=30ca657152554a85b8bfe82347327b0f)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:49.347755 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b470eda5-3d97-41c2-bb4a-37871a6e32ef None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:49.349889 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 172/333] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 15 12:10:49 2022] GET /identity/v3/users/30ca657152554a85b8bfe82347327b0f => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:49.355484 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aecbdf-d5ba-4deb-9f5c-27f93a412f95 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:49.411130 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:49.468509 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aecbdf-d5ba-4deb-9f5c-27f93a412f95 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:49.508074 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f3b3a4-c255-4820-91e9-0a8bf03d048e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:49.509116 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f3b3a4-c255-4820-91e9-0a8bf03d048e None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:49.509585 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f3b3a4-c255-4820-91e9-0a8bf03d048e None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:49.510077 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f3b3a4-c255-4820-91e9-0a8bf03d048e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:49.511016 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f3b3a4-c255-4820-91e9-0a8bf03d048e None admin] RBAC: Adding query filter params (role.id=9371e5bbc55848949eb951a815f817f2, user.id=30ca657152554a85b8bfe82347327b0f, scope.system=all) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:10:49.511517 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f3b3a4-c255-4820-91e9-0a8bf03d048e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:49.513142 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f3b3a4-c255-4820-91e9-0a8bf03d048e None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:49.529545 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 162/334] 10.222.0.16 () {56 vars in 1308 bytes} [Thu Sep 15 12:10:49 2022] GET /identity/v3/role_assignments?user.id=30ca657152554a85b8bfe82347327b0f&scope.system=all&role.id=9371e5bbc55848949eb951a815f817f2 => generated 510 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:10:51.055603 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1529bd3a-694a-435a-afc1-d6c1d044a4ec None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:51.056583 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1529bd3a-694a-435a-afc1-d6c1d044a4ec None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:51.057075 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1529bd3a-694a-435a-afc1-d6c1d044a4ec None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:51.059202 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 173/335] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:10:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:10:51.076854 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1921e7b3-a99b-45f2-a1a3-3a213b770473 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:51.077879 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1921e7b3-a99b-45f2-a1a3-3a213b770473 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:51.078347 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1921e7b3-a99b-45f2-a1a3-3a213b770473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:51.103373 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-1921e7b3-a99b-45f2-a1a3-3a213b770473 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:10:51.104890 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-1921e7b3-a99b-45f2-a1a3-3a213b770473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:10:51.176931 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 163/336] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:10:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:10:51.312696 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0c40be-6890-4c03-a250-4e0748497b15 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:51.314176 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0c40be-6890-4c03-a250-4e0748497b15 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:51.314881 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0c40be-6890-4c03-a250-4e0748497b15 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:51.317515 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 174/337] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:10:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:10:51.323210 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff4ae9-a103-4925-8e0a-f7bf8bee55fa None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:51.323939 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff4ae9-a103-4925-8e0a-f7bf8bee55fa None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:51.324618 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff4ae9-a103-4925-8e0a-f7bf8bee55fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:51.347060 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-a0ff4ae9-a103-4925-8e0a-f7bf8bee55fa None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:10:51.348596 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-a0ff4ae9-a103-4925-8e0a-f7bf8bee55fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:10:51.397004 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:51.434723 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 164/338] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:10:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:10:51.663286 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3200f891-9a29-4387-9028-c0c86ede0889 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:51.663482 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3200f891-9a29-4387-9028-c0c86ede0889 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:51.663765 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3200f891-9a29-4387-9028-c0c86ede0889 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:51.665367 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 175/339] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:10:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:10:51.671080 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b6a234-2ff2-4906-890d-bb33a08e4ead None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:51.671470 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b6a234-2ff2-4906-890d-bb33a08e4ead None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:51.671944 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b6a234-2ff2-4906-890d-bb33a08e4ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:51.698958 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-f7b6a234-2ff2-4906-890d-bb33a08e4ead None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:10:51.700242 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-f7b6a234-2ff2-4906-890d-bb33a08e4ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:10:51.714485 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3200f891-9a29-4387-9028-c0c86ede0889 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:51.822408 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 165/340] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:10:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:10:51.872654 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3200f891-9a29-4387-9028-c0c86ede0889 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:51.913373 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ced490a-5978-48d9-b93c-eda3b11541b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:51.913924 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced490a-5978-48d9-b93c-eda3b11541b0 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:51.914200 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced490a-5978-48d9-b93c-eda3b11541b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:51.914488 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced490a-5978-48d9-b93c-eda3b11541b0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:51.927530 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ced490a-5978-48d9-b93c-eda3b11541b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:10:51.932473 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-7ced490a-5978-48d9-b93c-eda3b11541b0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 12:10:51.932473 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:10:51.932473 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:10:51.932473 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:10:51.932473 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:10:51.932473 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:10:51.932473 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:10:51.932473 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:10:51.932473 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:10:51.932473 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:10:51.932473 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:10:51.932473 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:10:51.932473 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:10:51.932473 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:10:51.932473 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:10:51.932473 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:10:51.933323 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:10:51.933323 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:10:51.933323 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:10:51.933323 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:10:51.933323 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:10:51.933323 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:10:51.933323 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:10:51.933323 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:10:51.933323 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:10:51.933323 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:10:51.933323 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:10:51.933323 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:10:51.933323 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:10:51.933323 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:10:51.933323 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:10:51.933323 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:10:51.934138 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:10:51.934138 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:10:51.934138 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:10:51.934138 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:10:51.934138 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:10:51.934138 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:10:51.934138 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:10:51.934138 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:10:51.934138 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:10:51.934138 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:10:51.934138 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 12:10:51.934138 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:10:51.934138 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 176/341] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 15 12:10:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:10:51.940110 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b6a234-2ff2-4906-890d-bb33a08e4ead None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:52.019693 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ced490a-5978-48d9-b93c-eda3b11541b0 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:52.096748 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:52.104085 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:52.110415 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b6a234-2ff2-4906-890d-bb33a08e4ead None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:52.168424 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ced490a-5978-48d9-b93c-eda3b11541b0 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:52.182154 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2dd7b5-812f-49e9-a5ac-c329908ab37c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:52.186826 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2dd7b5-812f-49e9-a5ac-c329908ab37c None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:52.187136 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2dd7b5-812f-49e9-a5ac-c329908ab37c None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:52.187415 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2dd7b5-812f-49e9-a5ac-c329908ab37c None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:52.188665 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2dd7b5-812f-49e9-a5ac-c329908ab37c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:10:52.188977 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2dd7b5-812f-49e9-a5ac-c329908ab37c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:52.190370 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2dd7b5-812f-49e9-a5ac-c329908ab37c None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:52.206810 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 166/342] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Sep 15 12:10:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:52.207722 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2dd7b5-812f-49e9-a5ac-c329908ab37c None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:52.212040 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d01de8-4f7e-4bce-8ac7-16ee7482ffd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:52.212681 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d01de8-4f7e-4bce-8ac7-16ee7482ffd6 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:52.212954 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d01de8-4f7e-4bce-8ac7-16ee7482ffd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:52.213318 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d01de8-4f7e-4bce-8ac7-16ee7482ffd6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:52.232147 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d01de8-4f7e-4bce-8ac7-16ee7482ffd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:10:52.238543 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-a1d01de8-4f7e-4bce-8ac7-16ee7482ffd6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 12:10:52.238543 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:10:52.238543 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:10:52.238543 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:10:52.238543 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:10:52.238543 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:10:52.238543 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:10:52.238543 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:10:52.238543 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:10:52.238543 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:10:52.238543 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:10:52.238543 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:10:52.238543 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:10:52.238543 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:10:52.238543 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:10:52.238543 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:10:52.239457 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:10:52.239457 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:10:52.239457 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:10:52.239457 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:10:52.239457 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:10:52.239457 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:10:52.239457 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:10:52.239457 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:10:52.239457 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:10:52.239457 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:10:52.239457 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:10:52.239457 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:10:52.239457 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:10:52.239457 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:10:52.239457 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:10:52.239457 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:10:52.240223 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:10:52.240223 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:10:52.240223 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:10:52.240223 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:10:52.240223 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:10:52.240223 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:10:52.240223 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:10:52.240223 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:10:52.240223 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:10:52.240223 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:10:52.240223 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 12:10:52.240223 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:10:52.241284 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 177/343] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 15 12:10:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:10:52.241973 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d01de8-4f7e-4bce-8ac7-16ee7482ffd6 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:52.340399 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2dd7b5-812f-49e9-a5ac-c329908ab37c None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:52.355395 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:52.366849 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d01de8-4f7e-4bce-8ac7-16ee7482ffd6 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:52.377074 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254c187e-6069-4e64-ba3a-7b3b9534536c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:52.377719 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c187e-6069-4e64-ba3a-7b3b9534536c None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:52.378274 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c187e-6069-4e64-ba3a-7b3b9534536c None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:52.378274 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c187e-6069-4e64-ba3a-7b3b9534536c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:52.392483 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254c187e-6069-4e64-ba3a-7b3b9534536c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:10:52.397852 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-254c187e-6069-4e64-ba3a-7b3b9534536c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 12:10:52.397852 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:10:52.397852 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:10:52.397852 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:10:52.397852 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:10:52.397852 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:10:52.397852 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:10:52.397852 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:10:52.397852 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:10:52.397852 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:10:52.397852 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:10:52.397852 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:10:52.397852 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:10:52.397852 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:10:52.397852 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:10:52.397852 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:10:52.399770 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:10:52.399770 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:10:52.399770 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:10:52.399770 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:10:52.399770 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:10:52.399770 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:10:52.399770 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:10:52.399770 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:10:52.399770 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:10:52.399770 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:10:52.399770 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:10:52.399770 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:10:52.399770 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:10:52.399770 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:10:52.399770 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:10:52.399770 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:10:52.400627 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:10:52.400627 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:10:52.400627 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:10:52.400627 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:10:52.400627 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:10:52.400627 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:10:52.400627 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:10:52.400627 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:10:52.400627 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:10:52.400627 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:10:52.400627 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 12:10:52.400627 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:10:52.400627 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 167/344] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Sep 15 12:10:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:10:52.400627 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b830dffe-74bc-4040-a5e4-42c1aa499a2b None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:52.401424 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b830dffe-74bc-4040-a5e4-42c1aa499a2b None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:52.401424 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b830dffe-74bc-4040-a5e4-42c1aa499a2b None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:52.402315 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 168/345] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:10:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:10:52.407129 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b830dffe-74bc-4040-a5e4-42c1aa499a2b None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:52.412622 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bd6fcb-a8e6-4fdd-ad5c-111875fb95bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:52.413520 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bd6fcb-a8e6-4fdd-ad5c-111875fb95bd None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:52.414170 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bd6fcb-a8e6-4fdd-ad5c-111875fb95bd None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:52.415334 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bd6fcb-a8e6-4fdd-ad5c-111875fb95bd None admin] PATH_INFO: `/v3/users/f53bc0b7d24c43e48b6b162a92cc18d8` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:52.416866 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bd6fcb-a8e6-4fdd-ad5c-111875fb95bd None admin] RBAC: Authorizing `identity:get_user(user_id=f53bc0b7d24c43e48b6b162a92cc18d8)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:52.423269 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bd6fcb-a8e6-4fdd-ad5c-111875fb95bd None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:52.425629 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 178/346] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 15 12:10:52 2022] GET /identity/v3/users/f53bc0b7d24c43e48b6b162a92cc18d8 => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:52.426903 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bd6fcb-a8e6-4fdd-ad5c-111875fb95bd None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:52.442273 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:52.544201 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b830dffe-74bc-4040-a5e4-42c1aa499a2b None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:52.555149 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bd6fcb-a8e6-4fdd-ad5c-111875fb95bd None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:52.593039 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf6d026-b67a-4cf4-a64f-38eb5d738718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:52.594203 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6d026-b67a-4cf4-a64f-38eb5d738718 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:52.594503 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6d026-b67a-4cf4-a64f-38eb5d738718 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:52.594808 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6d026-b67a-4cf4-a64f-38eb5d738718 None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:52.595650 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf6d026-b67a-4cf4-a64f-38eb5d738718 None admin] RBAC: Adding query filter params (name=member) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:10:52.596059 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf6d026-b67a-4cf4-a64f-38eb5d738718 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:52.597684 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf6d026-b67a-4cf4-a64f-38eb5d738718 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:52.604584 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5903c649-380e-4ffe-9821-16bed6461887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:52.604584 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5903c649-380e-4ffe-9821-16bed6461887 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:52.604584 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5903c649-380e-4ffe-9821-16bed6461887 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:52.604584 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5903c649-380e-4ffe-9821-16bed6461887 None admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:52.605497 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5903c649-380e-4ffe-9821-16bed6461887 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:10:52.605600 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5903c649-380e-4ffe-9821-16bed6461887 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:52.606922 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5903c649-380e-4ffe-9821-16bed6461887 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:52.614155 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 169/347] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Sep 15 12:10:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:52.615718 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38fdf57-d729-4e43-a118-b831b0f11f80 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:52.615826 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 179/348] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 15 12:10:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:52.616342 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38fdf57-d729-4e43-a118-b831b0f11f80 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:52.616649 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5903c649-380e-4ffe-9821-16bed6461887 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:52.617157 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38fdf57-d729-4e43-a118-b831b0f11f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:52.651733 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:52.653552 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-a38fdf57-d729-4e43-a118-b831b0f11f80 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:10:52.654953 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-a38fdf57-d729-4e43-a118-b831b0f11f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:10:52.757597 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 170/349] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:10:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:10:52.764369 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38fdf57-d729-4e43-a118-b831b0f11f80 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:52.769591 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5903c649-380e-4ffe-9821-16bed6461887 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:52.796237 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:52.840603 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e03ec7-cf17-4b2a-b167-37b55fe7819b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:52.841220 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e03ec7-cf17-4b2a-b167-37b55fe7819b None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:52.841501 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e03ec7-cf17-4b2a-b167-37b55fe7819b None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:52.841773 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e03ec7-cf17-4b2a-b167-37b55fe7819b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:52.842559 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e03ec7-cf17-4b2a-b167-37b55fe7819b None admin] RBAC: Adding query filter params (role.id=da591cd17baa4d009b74f6facf2a6688, user.id=f53bc0b7d24c43e48b6b162a92cc18d8, scope.system=all) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:10:52.842898 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e03ec7-cf17-4b2a-b167-37b55fe7819b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:52.846378 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e03ec7-cf17-4b2a-b167-37b55fe7819b None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:52.872512 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 180/350] 10.222.0.16 () {56 vars in 1308 bytes} [Thu Sep 15 12:10:52 2022] GET /identity/v3/role_assignments?user.id=f53bc0b7d24c43e48b6b162a92cc18d8&scope.system=all&role.id=da591cd17baa4d009b74f6facf2a6688 => generated 510 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:52.873880 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e03ec7-cf17-4b2a-b167-37b55fe7819b None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:52.953149 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38fdf57-d729-4e43-a118-b831b0f11f80 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:53.023976 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97248273-bbb1-4d67-806a-b2dc388a1ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:53.024523 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97248273-bbb1-4d67-806a-b2dc388a1ca0 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:53.024800 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97248273-bbb1-4d67-806a-b2dc388a1ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:53.025069 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97248273-bbb1-4d67-806a-b2dc388a1ca0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:53.030677 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:53.079872 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e03ec7-cf17-4b2a-b167-37b55fe7819b None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:53.151174 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeb05eb-9e96-47b1-8330-ba737daafc00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:53.151802 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb05eb-9e96-47b1-8330-ba737daafc00 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:53.152055 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb05eb-9e96-47b1-8330-ba737daafc00 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:53.152320 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb05eb-9e96-47b1-8330-ba737daafc00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:53.179010 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97248273-bbb1-4d67-806a-b2dc388a1ca0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:53.180501 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97248273-bbb1-4d67-806a-b2dc388a1ca0 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:53.208338 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:53.243119 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeb05eb-9e96-47b1-8330-ba737daafc00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:53.244647 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeb05eb-9e96-47b1-8330-ba737daafc00 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:53.327060 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 171/351] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 15 12:10:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 569 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 12:10:53.328143 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97248273-bbb1-4d67-806a-b2dc388a1ca0 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:53.344425 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:53.371137 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 181/352] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 15 12:10:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 12:10:53.372346 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d23eb-e39a-4956-92d4-82ac5122db5e None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:53.372660 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d23eb-e39a-4956-92d4-82ac5122db5e None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:53.372929 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d23eb-e39a-4956-92d4-82ac5122db5e None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:53.374136 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 182/353] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:10:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:10:53.374834 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8d23eb-e39a-4956-92d4-82ac5122db5e None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:53.470372 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97248273-bbb1-4d67-806a-b2dc388a1ca0 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:53.487962 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:53.506445 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8d23eb-e39a-4956-92d4-82ac5122db5e None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:53.513281 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a435cf22-62fb-4c7c-a428-02f7dd10aacc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:53.513922 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a435cf22-62fb-4c7c-a428-02f7dd10aacc None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:53.514195 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a435cf22-62fb-4c7c-a428-02f7dd10aacc None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:53.514450 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a435cf22-62fb-4c7c-a428-02f7dd10aacc None admin] PATH_INFO: `/v3/roles/member` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:53.528399 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a435cf22-62fb-4c7c-a428-02f7dd10aacc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:10:53.533633 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-a435cf22-62fb-4c7c-a428-02f7dd10aacc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 12:10:53.533633 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:10:53.533633 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:10:53.533633 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:10:53.533633 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:10:53.533633 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:10:53.533633 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:10:53.533633 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:10:53.533633 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:10:53.533633 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:10:53.533633 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:10:53.533633 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:10:53.533633 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:10:53.533633 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:10:53.533633 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:10:53.533633 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:10:53.534520 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:10:53.534520 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:10:53.534520 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:10:53.534520 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:10:53.534520 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:10:53.534520 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:10:53.534520 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:10:53.534520 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:10:53.534520 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:10:53.534520 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:10:53.534520 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:10:53.534520 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:10:53.534520 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:10:53.534520 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:10:53.534520 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:10:53.534520 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:10:53.535368 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:10:53.535368 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:10:53.535368 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:10:53.535368 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:10:53.535368 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:10:53.535368 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:10:53.535368 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:10:53.535368 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:10:53.535368 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:10:53.535368 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:10:53.535368 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 12:10:53.535368 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:10:53.535368 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 172/354] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 15 12:10:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:10:53.536045 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a435cf22-62fb-4c7c-a428-02f7dd10aacc None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:53.554019 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f97084-029d-4af9-a97e-8f65f52f171b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:53.555041 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f97084-029d-4af9-a97e-8f65f52f171b None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:53.555531 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f97084-029d-4af9-a97e-8f65f52f171b None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:53.556023 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f97084-029d-4af9-a97e-8f65f52f171b None admin] PATH_INFO: `/v3/projects/23903d1c5f234a8ba964a00b23864453` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:53.557198 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f97084-029d-4af9-a97e-8f65f52f171b None admin] RBAC: Authorizing `identity:get_project(project_id=23903d1c5f234a8ba964a00b23864453)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:53.558621 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f97084-029d-4af9-a97e-8f65f52f171b None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:53.560263 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 183/355] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 15 12:10:53 2022] GET /identity/v3/projects/23903d1c5f234a8ba964a00b23864453 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:53.561362 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da385bca-c432-48b9-9193-ecb0c501241b None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:53.562503 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da385bca-c432-48b9-9193-ecb0c501241b None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:53.566053 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da385bca-c432-48b9-9193-ecb0c501241b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:53.586126 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-da385bca-c432-48b9-9193-ecb0c501241b None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:10:53.587254 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-da385bca-c432-48b9-9193-ecb0c501241b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:10:53.641873 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:53.670979 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a435cf22-62fb-4c7c-a428-02f7dd10aacc None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:53.677627 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 184/356] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:10:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:10:53.678805 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da385bca-c432-48b9-9193-ecb0c501241b None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:53.727013 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055dfe0c-768f-4d44-9d21-0cce7aea807d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:53.727649 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055dfe0c-768f-4d44-9d21-0cce7aea807d None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:53.727923 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055dfe0c-768f-4d44-9d21-0cce7aea807d None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:53.728192 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055dfe0c-768f-4d44-9d21-0cce7aea807d None admin] PATH_INFO: `/v3/projects/23903d1c5f234a8ba964a00b23864453` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:53.730914 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055dfe0c-768f-4d44-9d21-0cce7aea807d None admin] RBAC: Authorizing `identity:get_project(project_id=23903d1c5f234a8ba964a00b23864453)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:53.732385 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055dfe0c-768f-4d44-9d21-0cce7aea807d None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:53.734479 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 173/357] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 15 12:10:53 2022] GET /identity/v3/projects/23903d1c5f234a8ba964a00b23864453 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:53.736205 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055dfe0c-768f-4d44-9d21-0cce7aea807d None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:53.785894 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:53.805997 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da385bca-c432-48b9-9193-ecb0c501241b None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:53.849092 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34773fb-3e82-48bc-b26b-7d05c0537a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:53.850046 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34773fb-3e82-48bc-b26b-7d05c0537a96 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:53.850329 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34773fb-3e82-48bc-b26b-7d05c0537a96 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:53.850602 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34773fb-3e82-48bc-b26b-7d05c0537a96 None admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:53.854329 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34773fb-3e82-48bc-b26b-7d05c0537a96 None admin] RBAC: Adding query filter params (name=member) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:10:53.854447 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055dfe0c-768f-4d44-9d21-0cce7aea807d None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:53.854526 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34773fb-3e82-48bc-b26b-7d05c0537a96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:53.854526 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34773fb-3e82-48bc-b26b-7d05c0537a96 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:53.863702 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 185/358] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Sep 15 12:10:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:53.869841 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e740a843-d40d-42dd-9186-842ba37203b1 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:53.870126 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e740a843-d40d-42dd-9186-842ba37203b1 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:53.870452 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e740a843-d40d-42dd-9186-842ba37203b1 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:53.874737 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 186/359] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:10:53 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:10:53.874737 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e740a843-d40d-42dd-9186-842ba37203b1 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:53.904834 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f46ad3-76a4-425a-882c-09df65703526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:53.904834 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f46ad3-76a4-425a-882c-09df65703526 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:53.904834 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f46ad3-76a4-425a-882c-09df65703526 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:53.904834 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f46ad3-76a4-425a-882c-09df65703526 None admin] PATH_INFO: `/v3/groups/b997011a6594465f95ebd1afb2eaf4ed` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:53.909979 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f46ad3-76a4-425a-882c-09df65703526 None admin] RBAC: Authorizing `identity:get_group(group_id=b997011a6594465f95ebd1afb2eaf4ed)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:53.911550 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f46ad3-76a4-425a-882c-09df65703526 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:53.913212 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 174/360] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Sep 15 12:10:53 2022] GET /identity/v3/groups/b997011a6594465f95ebd1afb2eaf4ed => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:53.913966 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f46ad3-76a4-425a-882c-09df65703526 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:53.928331 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:54.010626 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e740a843-d40d-42dd-9186-842ba37203b1 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:54.044766 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f46ad3-76a4-425a-882c-09df65703526 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:54.051638 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d89277-4d3d-49b2-bd57-9ae0d6bdcf31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:54.052110 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d89277-4d3d-49b2-bd57-9ae0d6bdcf31 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:54.052384 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d89277-4d3d-49b2-bd57-9ae0d6bdcf31 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:54.052659 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d89277-4d3d-49b2-bd57-9ae0d6bdcf31 None admin] PATH_INFO: `/v3/groups/b997011a6594465f95ebd1afb2eaf4ed` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:54.053240 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:54.053753 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d89277-4d3d-49b2-bd57-9ae0d6bdcf31 None admin] RBAC: Authorizing `identity:get_group(group_id=b997011a6594465f95ebd1afb2eaf4ed)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:54.055217 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d89277-4d3d-49b2-bd57-9ae0d6bdcf31 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:54.057090 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 187/361] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Sep 15 12:10:53 2022] GET /identity/v3/groups/b997011a6594465f95ebd1afb2eaf4ed => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:54.058238 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351af10b-bffc-4962-9d3b-39eb1f712ea9 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:54.058516 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351af10b-bffc-4962-9d3b-39eb1f712ea9 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:54.059809 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351af10b-bffc-4962-9d3b-39eb1f712ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:54.078770 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-351af10b-bffc-4962-9d3b-39eb1f712ea9 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:10:54.079954 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-351af10b-bffc-4962-9d3b-39eb1f712ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:10:54.087983 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b646f2bd-34e5-4fd4-ab67-149573e7bd29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:54.088851 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b646f2bd-34e5-4fd4-ab67-149573e7bd29 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:54.089307 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b646f2bd-34e5-4fd4-ab67-149573e7bd29 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:54.089769 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b646f2bd-34e5-4fd4-ab67-149573e7bd29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:54.154281 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 188/362] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:10:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:10:54.155487 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351af10b-bffc-4962-9d3b-39eb1f712ea9 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:54.167780 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b646f2bd-34e5-4fd4-ab67-149573e7bd29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:54.170024 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b646f2bd-34e5-4fd4-ab67-149573e7bd29 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:54.202436 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:54.290913 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351af10b-bffc-4962-9d3b-39eb1f712ea9 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:54.308327 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 175/363] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 15 12:10:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 12:10:54.309167 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b646f2bd-34e5-4fd4-ab67-149573e7bd29 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:54.323022 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:54.339695 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b403a55-fa36-4535-9e1c-71fab00b57ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:54.339695 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b403a55-fa36-4535-9e1c-71fab00b57ef None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:54.339695 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b403a55-fa36-4535-9e1c-71fab00b57ef None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:54.340316 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b403a55-fa36-4535-9e1c-71fab00b57ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:54.341056 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b403a55-fa36-4535-9e1c-71fab00b57ef None admin] RBAC: Adding query filter params (group.id=b997011a6594465f95ebd1afb2eaf4ed, role.id=19ee0f56c10b47628ba0b1c3deee4448, scope.project.id=23903d1c5f234a8ba964a00b23864453) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:10:54.341365 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b403a55-fa36-4535-9e1c-71fab00b57ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:54.343832 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b403a55-fa36-4535-9e1c-71fab00b57ef None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:54.352705 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 189/364] 10.222.0.16 () {56 vars in 1376 bytes} [Thu Sep 15 12:10:54 2022] GET /identity/v3/role_assignments?group.id=b997011a6594465f95ebd1afb2eaf4ed&scope.project.id=23903d1c5f234a8ba964a00b23864453&role.id=19ee0f56c10b47628ba0b1c3deee4448 => generated 260 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:54.353610 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b403a55-fa36-4535-9e1c-71fab00b57ef None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:54.438020 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b646f2bd-34e5-4fd4-ab67-149573e7bd29 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:54.468356 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:54.472375 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b403a55-fa36-4535-9e1c-71fab00b57ef None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:54.489777 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dc8648-981b-4a71-836d-862dbf6cb6ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:54.490733 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc8648-981b-4a71-836d-862dbf6cb6ed None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:54.491214 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc8648-981b-4a71-836d-862dbf6cb6ed None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:54.491658 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc8648-981b-4a71-836d-862dbf6cb6ed None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:54.507466 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dc8648-981b-4a71-836d-862dbf6cb6ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:10:54.512692 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-f1dc8648-981b-4a71-836d-862dbf6cb6ed None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 12:10:54.512692 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:10:54.512692 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:10:54.512692 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:10:54.512692 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:10:54.512692 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:10:54.512692 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:10:54.512692 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:10:54.512692 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:10:54.512692 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:10:54.512692 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:10:54.512692 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:10:54.512692 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:10:54.512692 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:10:54.512692 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:10:54.512692 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:10:54.513696 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:10:54.513696 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:10:54.513696 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:10:54.513696 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:10:54.513696 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:10:54.513696 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:10:54.513696 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:10:54.513696 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:10:54.513696 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:10:54.513696 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:10:54.513696 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:10:54.513696 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:10:54.513696 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:10:54.513696 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:10:54.513696 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:10:54.513696 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:10:54.514524 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:10:54.514524 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:10:54.514524 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:10:54.514524 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:10:54.514524 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:10:54.514524 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:10:54.514524 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:10:54.514524 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:10:54.514524 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:10:54.514524 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:10:54.514524 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 12:10:54.514524 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:10:54.514524 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 176/365] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Sep 15 12:10:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:10:54.515301 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dc8648-981b-4a71-836d-862dbf6cb6ed None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:54.526024 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1c180b-1d51-4659-9a3d-c3eacb4c9989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:54.527646 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c180b-1d51-4659-9a3d-c3eacb4c9989 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:54.528128 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c180b-1d51-4659-9a3d-c3eacb4c9989 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:54.528588 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c180b-1d51-4659-9a3d-c3eacb4c9989 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:54.529912 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1c180b-1d51-4659-9a3d-c3eacb4c9989 None admin] RBAC: Adding query filter params (group.id=b997011a6594465f95ebd1afb2eaf4ed, role.id=9371e5bbc55848949eb951a815f817f2, scope.project.id=23903d1c5f234a8ba964a00b23864453) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:10:54.530226 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1c180b-1d51-4659-9a3d-c3eacb4c9989 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:54.533018 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1c180b-1d51-4659-9a3d-c3eacb4c9989 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:54.539821 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 190/366] 10.222.0.16 () {56 vars in 1376 bytes} [Thu Sep 15 12:10:54 2022] GET /identity/v3/role_assignments?group.id=b997011a6594465f95ebd1afb2eaf4ed&scope.project.id=23903d1c5f234a8ba964a00b23864453&role.id=9371e5bbc55848949eb951a815f817f2 => generated 260 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:54.540479 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1c180b-1d51-4659-9a3d-c3eacb4c9989 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:54.624961 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:54.675971 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dc8648-981b-4a71-836d-862dbf6cb6ed None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:54.677858 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1c180b-1d51-4659-9a3d-c3eacb4c9989 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:54.723124 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5e57fe-3751-48d7-a8f0-4c751d9d50f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:54.724011 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e57fe-3751-48d7-a8f0-4c751d9d50f5 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:54.724436 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e57fe-3751-48d7-a8f0-4c751d9d50f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:54.724849 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e57fe-3751-48d7-a8f0-4c751d9d50f5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:54.724974 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897a5cac-b8a7-4bb2-8ff7-341b1ec6600a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:54.725655 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a5cac-b8a7-4bb2-8ff7-341b1ec6600a None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:54.725934 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a5cac-b8a7-4bb2-8ff7-341b1ec6600a None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:54.726210 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a5cac-b8a7-4bb2-8ff7-341b1ec6600a None admin] PATH_INFO: `/v3/projects/dd97fe3d09654c728d99e82d47ef59a5` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:54.727387 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897a5cac-b8a7-4bb2-8ff7-341b1ec6600a None admin] RBAC: Authorizing `identity:get_project(project_id=dd97fe3d09654c728d99e82d47ef59a5)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:54.729325 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897a5cac-b8a7-4bb2-8ff7-341b1ec6600a None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:54.732051 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 177/367] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 15 12:10:54 2022] GET /identity/v3/projects/dd97fe3d09654c728d99e82d47ef59a5 => generated 302 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:54.732664 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897a5cac-b8a7-4bb2-8ff7-341b1ec6600a None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:54.752745 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5e57fe-3751-48d7-a8f0-4c751d9d50f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:10:54.760664 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-4d5e57fe-3751-48d7-a8f0-4c751d9d50f5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:10:54.760664 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:10:54.760664 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:10:54.760664 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:10:54.760664 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:10:54.760664 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:10:54.760664 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:10:54.760664 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:10:54.760664 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:10:54.760664 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:10:54.760664 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:10:54.760664 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:10:54.760664 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:10:54.760664 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:10:54.760664 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:10:54.760664 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:10:54.761803 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:10:54.761803 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:10:54.761803 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:10:54.761803 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:10:54.761803 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:10:54.761803 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:10:54.761803 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:10:54.761803 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:10:54.761803 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:10:54.761803 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:10:54.761803 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:10:54.761803 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:10:54.761803 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:10:54.761803 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:10:54.761803 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:10:54.761803 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:10:54.762758 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:10:54.762758 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:10:54.762758 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:10:54.762758 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:10:54.762758 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:10:54.762758 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:10:54.762758 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:10:54.762758 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:10:54.762758 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:10:54.762758 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:10:54.762758 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:10:54.762758 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:10:54.764721 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 191/368] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Sep 15 12:10:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:10:54.766546 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5e57fe-3751-48d7-a8f0-4c751d9d50f5 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:54.828407 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:54.863534 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897a5cac-b8a7-4bb2-8ff7-341b1ec6600a None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:54.903380 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747579a4-9353-4c40-8ad4-1659d16ecd56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:54.903993 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747579a4-9353-4c40-8ad4-1659d16ecd56 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:54.904274 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747579a4-9353-4c40-8ad4-1659d16ecd56 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:54.904537 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747579a4-9353-4c40-8ad4-1659d16ecd56 None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:54.905203 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747579a4-9353-4c40-8ad4-1659d16ecd56 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:10:54.905501 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747579a4-9353-4c40-8ad4-1659d16ecd56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:54.906978 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747579a4-9353-4c40-8ad4-1659d16ecd56 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:54.908651 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:54.920964 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 178/369] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 15 12:10:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:54.921325 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5e57fe-3751-48d7-a8f0-4c751d9d50f5 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:54.921799 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747579a4-9353-4c40-8ad4-1659d16ecd56 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:54.984173 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f711e0-33ef-42b3-9563-51506d173684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:54.984751 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f711e0-33ef-42b3-9563-51506d173684 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:54.985031 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f711e0-33ef-42b3-9563-51506d173684 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:54.985303 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f711e0-33ef-42b3-9563-51506d173684 None admin] PATH_INFO: `/v3/groups/b997011a6594465f95ebd1afb2eaf4ed` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:54.986492 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f711e0-33ef-42b3-9563-51506d173684 None admin] RBAC: Authorizing `identity:get_group(group_id=b997011a6594465f95ebd1afb2eaf4ed)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:54.988023 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f711e0-33ef-42b3-9563-51506d173684 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:54.995381 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 192/370] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Sep 15 12:10:54 2022] GET /identity/v3/groups/b997011a6594465f95ebd1afb2eaf4ed => generated 226 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:54.996240 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f711e0-33ef-42b3-9563-51506d173684 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:55.072906 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747579a4-9353-4c40-8ad4-1659d16ecd56 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:55.110155 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:55.114134 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bbaa93-11b2-4932-b586-e1988d6ee8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:55.114973 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bbaa93-11b2-4932-b586-e1988d6ee8bd None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:55.115067 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bbaa93-11b2-4932-b586-e1988d6ee8bd None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:55.115293 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bbaa93-11b2-4932-b586-e1988d6ee8bd None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:55.115965 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bbaa93-11b2-4932-b586-e1988d6ee8bd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:10:55.116304 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bbaa93-11b2-4932-b586-e1988d6ee8bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:55.117704 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bbaa93-11b2-4932-b586-e1988d6ee8bd None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:55.119963 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f711e0-33ef-42b3-9563-51506d173684 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:55.128001 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 179/371] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 15 12:10:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:55.128947 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bbaa93-11b2-4932-b586-e1988d6ee8bd None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:55.169382 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be9ce7c-d7a7-4156-8810-935efc60b56d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:55.170057 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be9ce7c-d7a7-4156-8810-935efc60b56d None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:55.170342 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be9ce7c-d7a7-4156-8810-935efc60b56d None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:55.170616 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be9ce7c-d7a7-4156-8810-935efc60b56d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:55.202105 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:55.260636 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be9ce7c-d7a7-4156-8810-935efc60b56d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:55.262417 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be9ce7c-d7a7-4156-8810-935efc60b56d None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:55.265665 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bbaa93-11b2-4932-b586-e1988d6ee8bd None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:55.304856 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4caab7-931a-4604-b56b-78b37c197a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:55.305471 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4caab7-931a-4604-b56b-78b37c197a51 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:55.305749 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4caab7-931a-4604-b56b-78b37c197a51 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:55.306021 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4caab7-931a-4604-b56b-78b37c197a51 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:55.306777 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4caab7-931a-4604-b56b-78b37c197a51 None admin] RBAC: Adding query filter params (group.id=b997011a6594465f95ebd1afb2eaf4ed, role.id=9371e5bbc55848949eb951a815f817f2, scope.project.id=dd97fe3d09654c728d99e82d47ef59a5) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:10:55.307094 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4caab7-931a-4604-b56b-78b37c197a51 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:55.308552 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4caab7-931a-4604-b56b-78b37c197a51 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:55.315878 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 180/372] 10.222.0.16 () {56 vars in 1376 bytes} [Thu Sep 15 12:10:55 2022] GET /identity/v3/role_assignments?group.id=b997011a6594465f95ebd1afb2eaf4ed&scope.project.id=dd97fe3d09654c728d99e82d47ef59a5&role.id=9371e5bbc55848949eb951a815f817f2 => generated 260 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:55.316742 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4caab7-931a-4604-b56b-78b37c197a51 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:55.424361 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:55.446294 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 193/373] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 15 12:10:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 12:10:55.453871 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be9ce7c-d7a7-4156-8810-935efc60b56d None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:55.454545 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4caab7-931a-4604-b56b-78b37c197a51 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:55.490478 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:55.508187 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fa015e-b6ba-4db7-b486-b07613bdd911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:55.508991 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fa015e-b6ba-4db7-b486-b07613bdd911 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:55.509279 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fa015e-b6ba-4db7-b486-b07613bdd911 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:55.509557 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fa015e-b6ba-4db7-b486-b07613bdd911 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:55.632344 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fa015e-b6ba-4db7-b486-b07613bdd911 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:55.633870 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fa015e-b6ba-4db7-b486-b07613bdd911 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:55.668554 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be9ce7c-d7a7-4156-8810-935efc60b56d None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:55.710150 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e5686c-ddca-4ad8-89e6-df3d8d4fbb61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:55.711173 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e5686c-ddca-4ad8-89e6-df3d8d4fbb61 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:55.711667 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e5686c-ddca-4ad8-89e6-df3d8d4fbb61 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:55.712139 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e5686c-ddca-4ad8-89e6-df3d8d4fbb61 None admin] PATH_INFO: `/v3/projects/dd97fe3d09654c728d99e82d47ef59a5` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:55.713453 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e5686c-ddca-4ad8-89e6-df3d8d4fbb61 None admin] RBAC: Authorizing `identity:get_project(project_id=dd97fe3d09654c728d99e82d47ef59a5)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:55.715721 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e5686c-ddca-4ad8-89e6-df3d8d4fbb61 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:55.718316 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 194/374] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 15 12:10:55 2022] GET /identity/v3/projects/dd97fe3d09654c728d99e82d47ef59a5 => generated 302 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:55.724308 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e5686c-ddca-4ad8-89e6-df3d8d4fbb61 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:55.791200 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:55.838306 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 181/375] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 15 12:10:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 12:10:55.844966 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fa015e-b6ba-4db7-b486-b07613bdd911 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:55.846389 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e5686c-ddca-4ad8-89e6-df3d8d4fbb61 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:55.887902 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa27a9e3-23ee-46b1-9e7e-b167ec1a4507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:55.889448 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa27a9e3-23ee-46b1-9e7e-b167ec1a4507 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:55.890224 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa27a9e3-23ee-46b1-9e7e-b167ec1a4507 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:55.891296 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa27a9e3-23ee-46b1-9e7e-b167ec1a4507 None admin] PATH_INFO: `/v3/groups/b997011a6594465f95ebd1afb2eaf4ed` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:55.893040 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa27a9e3-23ee-46b1-9e7e-b167ec1a4507 None admin] RBAC: Authorizing `identity:get_group(group_id=b997011a6594465f95ebd1afb2eaf4ed)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:55.894713 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa27a9e3-23ee-46b1-9e7e-b167ec1a4507 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:55.897860 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 195/376] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Sep 15 12:10:55 2022] GET /identity/v3/groups/b997011a6594465f95ebd1afb2eaf4ed => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:55.903946 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa27a9e3-23ee-46b1-9e7e-b167ec1a4507 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:55.908891 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:56.039197 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa27a9e3-23ee-46b1-9e7e-b167ec1a4507 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:56.083280 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:56.096108 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc6d2c2-118e-4d64-ada2-f91c875a557b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:56.096728 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6d2c2-118e-4d64-ada2-f91c875a557b None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:56.097003 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6d2c2-118e-4d64-ada2-f91c875a557b None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:56.097274 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6d2c2-118e-4d64-ada2-f91c875a557b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:56.098013 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc6d2c2-118e-4d64-ada2-f91c875a557b None admin] RBAC: Adding query filter params (group.id=b997011a6594465f95ebd1afb2eaf4ed, role.id=19ee0f56c10b47628ba0b1c3deee4448, scope.project.id=dd97fe3d09654c728d99e82d47ef59a5) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:10:56.098320 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc6d2c2-118e-4d64-ada2-f91c875a557b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:56.099772 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc6d2c2-118e-4d64-ada2-f91c875a557b None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:56.103109 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fa015e-b6ba-4db7-b486-b07613bdd911 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:56.116949 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 196/377] 10.222.0.16 () {56 vars in 1376 bytes} [Thu Sep 15 12:10:55 2022] GET /identity/v3/role_assignments?group.id=b997011a6594465f95ebd1afb2eaf4ed&scope.project.id=dd97fe3d09654c728d99e82d47ef59a5&role.id=19ee0f56c10b47628ba0b1c3deee4448 => generated 260 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:56.164812 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b993218-f202-41f4-9413-8ea693400e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:56.165392 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b993218-f202-41f4-9413-8ea693400e2b None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:56.165669 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b993218-f202-41f4-9413-8ea693400e2b None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:56.165936 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b993218-f202-41f4-9413-8ea693400e2b None admin] PATH_INFO: `/v3/projects/d145f986559340aaa64b155220d60d8c` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:56.167114 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b993218-f202-41f4-9413-8ea693400e2b None admin] RBAC: Authorizing `identity:get_project(project_id=d145f986559340aaa64b155220d60d8c)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:56.168595 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b993218-f202-41f4-9413-8ea693400e2b None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:56.170659 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 182/378] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 15 12:10:55 2022] GET /identity/v3/projects/d145f986559340aaa64b155220d60d8c => generated 344 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:56.176735 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc6d2c2-118e-4d64-ada2-f91c875a557b None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:56.293673 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc6d2c2-118e-4d64-ada2-f91c875a557b None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:56.338958 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50913744-b159-421e-9003-f4d7579c3535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:56.339624 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50913744-b159-421e-9003-f4d7579c3535 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:56.339905 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50913744-b159-421e-9003-f4d7579c3535 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:56.340179 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50913744-b159-421e-9003-f4d7579c3535 None admin] PATH_INFO: `/v3/groups/512f85f46ca44fe3861499475eec078a` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:56.347518 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50913744-b159-421e-9003-f4d7579c3535 None admin] RBAC: Authorizing `identity:get_group(group_id=512f85f46ca44fe3861499475eec078a)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:56.348974 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50913744-b159-421e-9003-f4d7579c3535 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:56.350980 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 197/379] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Sep 15 12:10:56 2022] GET /identity/v3/groups/512f85f46ca44fe3861499475eec078a => generated 229 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:56.359868 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b993218-f202-41f4-9413-8ea693400e2b None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:56.497099 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:56.512224 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b993218-f202-41f4-9413-8ea693400e2b None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:56.552334 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db06904-ee55-4f5f-b36d-38c34968a428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:56.553282 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db06904-ee55-4f5f-b36d-38c34968a428 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:56.553759 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db06904-ee55-4f5f-b36d-38c34968a428 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:56.554427 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db06904-ee55-4f5f-b36d-38c34968a428 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:56.555727 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db06904-ee55-4f5f-b36d-38c34968a428 None admin] RBAC: Adding query filter params (group.id=512f85f46ca44fe3861499475eec078a, role.id=7f53f1c823b746529ba5057bf21b2477, scope.project.id=d145f986559340aaa64b155220d60d8c) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:10:56.556202 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db06904-ee55-4f5f-b36d-38c34968a428 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:56.557805 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db06904-ee55-4f5f-b36d-38c34968a428 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:56.564642 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 183/380] 10.222.0.16 () {56 vars in 1376 bytes} [Thu Sep 15 12:10:56 2022] GET /identity/v3/role_assignments?group.id=512f85f46ca44fe3861499475eec078a&scope.project.id=d145f986559340aaa64b155220d60d8c&role.id=7f53f1c823b746529ba5057bf21b2477 => generated 260 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:57.230933 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c085e8-d272-4bce-9924-0580859f26d6 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:57.231436 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c085e8-d272-4bce-9924-0580859f26d6 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:57.231436 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c085e8-d272-4bce-9924-0580859f26d6 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:57.233004 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 198/381] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:10:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:10:57.237830 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce84f1-a4c4-48a4-a2f5-059e26fa2d33 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:57.238116 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce84f1-a4c4-48a4-a2f5-059e26fa2d33 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:57.238389 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce84f1-a4c4-48a4-a2f5-059e26fa2d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:57.269082 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-b8ce84f1-a4c4-48a4-a2f5-059e26fa2d33 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:10:57.270297 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-b8ce84f1-a4c4-48a4-a2f5-059e26fa2d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:10:57.355592 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 184/382] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:10:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:10:57.404257 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e6cb3e-d9a6-4062-b885-e5307421aefb None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:57.404880 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e6cb3e-d9a6-4062-b885-e5307421aefb None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:57.405381 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e6cb3e-d9a6-4062-b885-e5307421aefb None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:57.407265 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 199/383] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:10:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:10:57.412745 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb850a-3d31-4328-852f-f3ee088ed08f None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:57.413608 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb850a-3d31-4328-852f-f3ee088ed08f None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:57.414086 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb850a-3d31-4328-852f-f3ee088ed08f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:57.433686 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-e6fb850a-3d31-4328-852f-f3ee088ed08f None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:10:57.435223 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-e6fb850a-3d31-4328-852f-f3ee088ed08f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:10:57.527723 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 185/384] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:10:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:10:57.692927 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e6cb3e-d9a6-4062-b885-e5307421aefb None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:57.763013 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:57.818256 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e6cb3e-d9a6-4062-b885-e5307421aefb None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:57.826297 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fb850a-3d31-4328-852f-f3ee088ed08f None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:57.842419 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:57.872285 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ad51b0-6171-4360-8295-f440b4e8d6f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:57.872931 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad51b0-6171-4360-8295-f440b4e8d6f2 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:57.873210 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad51b0-6171-4360-8295-f440b4e8d6f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:57.873481 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad51b0-6171-4360-8295-f440b4e8d6f2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:57.896090 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ad51b0-6171-4360-8295-f440b4e8d6f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:10:57.906414 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-e5ad51b0-6171-4360-8295-f440b4e8d6f2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 12:10:57.906414 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:10:57.906414 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:10:57.906414 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:10:57.906414 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:10:57.906414 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:10:57.906414 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:10:57.906414 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:10:57.906414 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:10:57.906414 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:10:57.906414 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:10:57.906414 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:10:57.906414 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:10:57.906414 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:10:57.906414 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:10:57.906414 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:10:57.907482 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:10:57.907482 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:10:57.907482 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:10:57.907482 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:10:57.907482 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:10:57.907482 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:10:57.907482 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:10:57.907482 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:10:57.907482 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:10:57.907482 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:10:57.907482 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:10:57.907482 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:10:57.907482 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:10:57.907482 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:10:57.907482 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:10:57.907482 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:10:57.908413 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:10:57.908413 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:10:57.908413 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:10:57.908413 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:10:57.908413 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:10:57.908413 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:10:57.908413 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:10:57.908413 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:10:57.908413 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:10:57.908413 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:10:57.908413 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 12:10:57.908413 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:10:57.911216 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 200/385] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Sep 15 12:10:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:10:57.917366 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ad51b0-6171-4360-8295-f440b4e8d6f2 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:57.988613 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fb850a-3d31-4328-852f-f3ee088ed08f None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:58.057359 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cffb61d-ac18-4469-a30a-c9aeb0884151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:58.057998 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cffb61d-ac18-4469-a30a-c9aeb0884151 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:58.058273 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cffb61d-ac18-4469-a30a-c9aeb0884151 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:58.058541 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cffb61d-ac18-4469-a30a-c9aeb0884151 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:58.083687 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cffb61d-ac18-4469-a30a-c9aeb0884151 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:10:58.088426 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-1cffb61d-ac18-4469-a30a-c9aeb0884151 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 12:10:58.088426 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:10:58.088426 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:10:58.088426 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:10:58.088426 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:10:58.088426 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:10:58.088426 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:10:58.088426 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:10:58.088426 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:10:58.088426 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:10:58.088426 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:10:58.088426 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:10:58.088426 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:10:58.088426 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:10:58.088426 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:10:58.088426 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:10:58.089304 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:10:58.089304 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:10:58.089304 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:10:58.089304 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:10:58.089304 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:10:58.089304 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:10:58.089304 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:10:58.089304 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:10:58.089304 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:10:58.089304 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:10:58.089304 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:10:58.089304 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:10:58.089304 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:10:58.089304 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:10:58.089304 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:10:58.089304 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:10:58.090089 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:10:58.090089 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:10:58.090089 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:10:58.090089 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:10:58.090089 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:10:58.090089 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:10:58.090089 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:10:58.090089 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:10:58.090089 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:10:58.090089 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:10:58.090089 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 12:10:58.090089 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:10:58.099047 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 186/386] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 15 12:10:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:10:58.107497 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cffb61d-ac18-4469-a30a-c9aeb0884151 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:58.131059 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ad51b0-6171-4360-8295-f440b4e8d6f2 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:58.176433 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:58.218015 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf046c8-c55f-4524-86b9-d19c96f01bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:58.218655 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf046c8-c55f-4524-86b9-d19c96f01bee None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:58.219588 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf046c8-c55f-4524-86b9-d19c96f01bee None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:58.219861 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf046c8-c55f-4524-86b9-d19c96f01bee None admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:58.220529 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf046c8-c55f-4524-86b9-d19c96f01bee None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:10:58.220829 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf046c8-c55f-4524-86b9-d19c96f01bee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:58.221035 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:58.222249 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf046c8-c55f-4524-86b9-d19c96f01bee None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:58.244842 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 201/387] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 15 12:10:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:58.250531 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf046c8-c55f-4524-86b9-d19c96f01bee None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:58.252496 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cffb61d-ac18-4469-a30a-c9aeb0884151 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:58.292357 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa17016c-b12f-4a40-a61c-59ecb4bb8c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:58.293784 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa17016c-b12f-4a40-a61c-59ecb4bb8c2a None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:58.294277 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa17016c-b12f-4a40-a61c-59ecb4bb8c2a None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:58.294766 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa17016c-b12f-4a40-a61c-59ecb4bb8c2a None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:58.295630 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa17016c-b12f-4a40-a61c-59ecb4bb8c2a None admin] RBAC: Adding query filter params (name=member) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:10:58.296710 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa17016c-b12f-4a40-a61c-59ecb4bb8c2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:58.298605 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa17016c-b12f-4a40-a61c-59ecb4bb8c2a None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:58.311793 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 187/388] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Sep 15 12:10:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:58.318019 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce5c82-1776-44c5-bffa-7e99688bcc2b None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:58.318019 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce5c82-1776-44c5-bffa-7e99688bcc2b None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:58.318019 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce5c82-1776-44c5-bffa-7e99688bcc2b None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:58.318769 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 188/389] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:10:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:10:58.319700 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ce5c82-1776-44c5-bffa-7e99688bcc2b None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:58.386110 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf046c8-c55f-4524-86b9-d19c96f01bee None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:58.423826 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf397409-94e3-45f3-89ef-c473b4e49f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:58.424469 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf397409-94e3-45f3-89ef-c473b4e49f0e None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:58.424859 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf397409-94e3-45f3-89ef-c473b4e49f0e None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:58.425208 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf397409-94e3-45f3-89ef-c473b4e49f0e None admin] PATH_INFO: `/v3/groups/b997011a6594465f95ebd1afb2eaf4ed` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:58.426442 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf397409-94e3-45f3-89ef-c473b4e49f0e None admin] RBAC: Authorizing `identity:get_group(group_id=b997011a6594465f95ebd1afb2eaf4ed)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:58.428240 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf397409-94e3-45f3-89ef-c473b4e49f0e None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:58.430282 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 202/390] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Sep 15 12:10:58 2022] GET /identity/v3/groups/b997011a6594465f95ebd1afb2eaf4ed => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:10:58.431576 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a3c611-d531-40e5-9f98-f8233851f198 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:58.431885 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a3c611-d531-40e5-9f98-f8233851f198 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:58.432410 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a3c611-d531-40e5-9f98-f8233851f198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:58.454490 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-27a3c611-d531-40e5-9f98-f8233851f198 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:10:58.456186 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-27a3c611-d531-40e5-9f98-f8233851f198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:10:58.460516 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ce5c82-1776-44c5-bffa-7e99688bcc2b None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:58.509086 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c935ce5-e7ee-4be9-8966-cda60ab73fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:58.510510 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c935ce5-e7ee-4be9-8966-cda60ab73fb9 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:58.510959 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c935ce5-e7ee-4be9-8966-cda60ab73fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:58.511368 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c935ce5-e7ee-4be9-8966-cda60ab73fb9 None admin] PATH_INFO: `/v3/groups/b997011a6594465f95ebd1afb2eaf4ed` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:58.512945 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:58.514047 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c935ce5-e7ee-4be9-8966-cda60ab73fb9 None admin] RBAC: Authorizing `identity:get_group(group_id=b997011a6594465f95ebd1afb2eaf4ed)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:58.517280 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c935ce5-e7ee-4be9-8966-cda60ab73fb9 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:58.519542 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 189/391] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Sep 15 12:10:58 2022] GET /identity/v3/groups/b997011a6594465f95ebd1afb2eaf4ed => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:58.524322 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c935ce5-e7ee-4be9-8966-cda60ab73fb9 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:58.528961 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:58.558782 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 203/392] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:10:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:10:58.560968 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a3c611-d531-40e5-9f98-f8233851f198 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:58.707878 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c935ce5-e7ee-4be9-8966-cda60ab73fb9 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:58.727680 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a3c611-d531-40e5-9f98-f8233851f198 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:58.753896 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c79f81-3fa2-4013-b721-bc5d78c99702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:58.754544 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c79f81-3fa2-4013-b721-bc5d78c99702 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:58.754856 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c79f81-3fa2-4013-b721-bc5d78c99702 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:58.755126 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c79f81-3fa2-4013-b721-bc5d78c99702 None admin] PATH_INFO: `/v3/projects/23903d1c5f234a8ba964a00b23864453` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:58.756806 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c79f81-3fa2-4013-b721-bc5d78c99702 None admin] RBAC: Authorizing `identity:get_project(project_id=23903d1c5f234a8ba964a00b23864453)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:58.758411 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c79f81-3fa2-4013-b721-bc5d78c99702 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:58.762826 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 190/393] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 15 12:10:58 2022] GET /identity/v3/projects/23903d1c5f234a8ba964a00b23864453 => generated 298 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:58.764204 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e57b87-3024-49a1-b9a9-0069eb1acc06 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:58.764694 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e57b87-3024-49a1-b9a9-0069eb1acc06 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:58.765204 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e57b87-3024-49a1-b9a9-0069eb1acc06 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:58.768115 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 191/394] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:10:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:10:58.770135 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e57b87-3024-49a1-b9a9-0069eb1acc06 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:58.778119 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880143f9-aae0-4c73-8a73-a6ad743b2421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:58.778800 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880143f9-aae0-4c73-8a73-a6ad743b2421 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:58.779083 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880143f9-aae0-4c73-8a73-a6ad743b2421 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:58.779358 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880143f9-aae0-4c73-8a73-a6ad743b2421 None admin] PATH_INFO: `/v3/projects/23903d1c5f234a8ba964a00b23864453` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:58.780500 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880143f9-aae0-4c73-8a73-a6ad743b2421 None admin] RBAC: Authorizing `identity:get_project(project_id=23903d1c5f234a8ba964a00b23864453)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:58.781977 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880143f9-aae0-4c73-8a73-a6ad743b2421 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:58.784690 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 204/395] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 15 12:10:58 2022] GET /identity/v3/projects/23903d1c5f234a8ba964a00b23864453 => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:58.789575 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4add4f14-ec2a-4a55-9a67-91a9bddd23d1 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:58.789575 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4add4f14-ec2a-4a55-9a67-91a9bddd23d1 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:58.789575 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4add4f14-ec2a-4a55-9a67-91a9bddd23d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:58.808238 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-4add4f14-ec2a-4a55-9a67-91a9bddd23d1 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:10:58.809825 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-4add4f14-ec2a-4a55-9a67-91a9bddd23d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:10:58.853560 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:58.860715 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:58.892068 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 205/396] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:10:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:10:58.892773 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4add4f14-ec2a-4a55-9a67-91a9bddd23d1 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:58.894656 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e57b87-3024-49a1-b9a9-0069eb1acc06 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:58.933540 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa7c9aa-3c1c-4e9e-9a82-7e07e3f9297d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:58.934194 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7c9aa-3c1c-4e9e-9a82-7e07e3f9297d None admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:58.934474 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7c9aa-3c1c-4e9e-9a82-7e07e3f9297d None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:58.934769 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7c9aa-3c1c-4e9e-9a82-7e07e3f9297d None admin] PATH_INFO: `/v3/projects/23903d1c5f234a8ba964a00b23864453/groups/b997011a6594465f95ebd1afb2eaf4ed/roles/19ee0f56c10b47628ba0b1c3deee4448` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:58.937035 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa7c9aa-3c1c-4e9e-9a82-7e07e3f9297d None admin] RBAC: Authorizing `identity:create_grant(project_id=23903d1c5f234a8ba964a00b23864453, group_id=b997011a6594465f95ebd1afb2eaf4ed, role_id=19ee0f56c10b47628ba0b1c3deee4448)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:58.939146 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa7c9aa-3c1c-4e9e-9a82-7e07e3f9297d None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:58.955060 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 192/397] 10.222.0.16 () {58 vars in 1442 bytes} [Thu Sep 15 12:10:58 2022] PUT /identity/v3/projects/23903d1c5f234a8ba964a00b23864453/groups/b997011a6594465f95ebd1afb2eaf4ed/roles/19ee0f56c10b47628ba0b1c3deee4448 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:10:58.956077 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa7c9aa-3c1c-4e9e-9a82-7e07e3f9297d None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:59.030546 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4add4f14-ec2a-4a55-9a67-91a9bddd23d1 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:59.074419 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fa35d3-c212-4fc9-b973-eb48cae224b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:59.075315 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa35d3-c212-4fc9-b973-eb48cae224b2 None admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:59.075579 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa35d3-c212-4fc9-b973-eb48cae224b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:59.075848 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa35d3-c212-4fc9-b973-eb48cae224b2 None admin] PATH_INFO: `/v3/projects/23903d1c5f234a8ba964a00b23864453/groups/b997011a6594465f95ebd1afb2eaf4ed/roles/9371e5bbc55848949eb951a815f817f2` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:59.077833 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fa35d3-c212-4fc9-b973-eb48cae224b2 None admin] RBAC: Authorizing `identity:create_grant(project_id=23903d1c5f234a8ba964a00b23864453, group_id=b997011a6594465f95ebd1afb2eaf4ed, role_id=9371e5bbc55848949eb951a815f817f2)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:59.079470 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fa35d3-c212-4fc9-b973-eb48cae224b2 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:59.097857 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 206/398] 10.222.0.16 () {58 vars in 1442 bytes} [Thu Sep 15 12:10:58 2022] PUT /identity/v3/projects/23903d1c5f234a8ba964a00b23864453/groups/b997011a6594465f95ebd1afb2eaf4ed/roles/9371e5bbc55848949eb951a815f817f2 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:10:59.157220 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa7c9aa-3c1c-4e9e-9a82-7e07e3f9297d None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:59.192932 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:59.198449 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a333a2c-c6c8-43b2-b81d-594066b7706c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:59.199760 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a333a2c-c6c8-43b2-b81d-594066b7706c None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:59.201991 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a333a2c-c6c8-43b2-b81d-594066b7706c None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:59.201991 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a333a2c-c6c8-43b2-b81d-594066b7706c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:59.216239 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a333a2c-c6c8-43b2-b81d-594066b7706c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:10:59.222671 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-9a333a2c-c6c8-43b2-b81d-594066b7706c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 12:10:59.222671 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:10:59.222671 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:10:59.222671 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:10:59.222671 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:10:59.222671 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:10:59.222671 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:10:59.222671 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:10:59.222671 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:10:59.222671 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:10:59.222671 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:10:59.222671 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:10:59.222671 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:10:59.222671 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:10:59.222671 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:10:59.222671 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:10:59.223633 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:10:59.223633 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:10:59.223633 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:10:59.223633 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:10:59.223633 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:10:59.223633 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:10:59.223633 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:10:59.223633 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:10:59.223633 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:10:59.223633 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:10:59.223633 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:10:59.223633 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:10:59.223633 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:10:59.223633 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:10:59.223633 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:10:59.223633 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:10:59.224420 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:10:59.224420 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:10:59.224420 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:10:59.224420 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:10:59.224420 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:10:59.224420 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:10:59.224420 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:10:59.224420 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:10:59.224420 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:10:59.224420 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:10:59.224420 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 12:10:59.224420 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:10:59.224420 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 193/399] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 15 12:10:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:10:59.231393 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fa35d3-c212-4fc9-b973-eb48cae224b2 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:59.271186 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:59.272715 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a333a2c-c6c8-43b2-b81d-594066b7706c None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:59.367033 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fa35d3-c212-4fc9-b973-eb48cae224b2 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:59.410842 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a333a2c-c6c8-43b2-b81d-594066b7706c None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:59.417654 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1be5e5e-c861-4461-ae2d-00973e2f8166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:59.418271 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1be5e5e-c861-4461-ae2d-00973e2f8166 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:59.418551 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1be5e5e-c861-4461-ae2d-00973e2f8166 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:59.418873 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1be5e5e-c861-4461-ae2d-00973e2f8166 None admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:59.420090 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1be5e5e-c861-4461-ae2d-00973e2f8166 None admin] RBAC: Adding query filter params (name=member) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:10:59.420398 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1be5e5e-c861-4461-ae2d-00973e2f8166 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:59.422914 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1be5e5e-c861-4461-ae2d-00973e2f8166 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:59.435351 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 207/400] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Sep 15 12:10:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:59.437402 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a59a4-0eb8-4dd9-958c-6214bd511ee4 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:59.437689 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a59a4-0eb8-4dd9-958c-6214bd511ee4 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:59.438237 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a59a4-0eb8-4dd9-958c-6214bd511ee4 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:59.439772 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 208/401] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:10:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:10:59.444623 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3a59a4-0eb8-4dd9-958c-6214bd511ee4 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:59.451097 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973bce90-ca41-4c2e-9dff-ce3f3ec592d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:59.451914 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973bce90-ca41-4c2e-9dff-ce3f3ec592d2 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:59.452373 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973bce90-ca41-4c2e-9dff-ce3f3ec592d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:59.452692 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973bce90-ca41-4c2e-9dff-ce3f3ec592d2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:59.464347 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973bce90-ca41-4c2e-9dff-ce3f3ec592d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:10:59.470059 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-973bce90-ca41-4c2e-9dff-ce3f3ec592d2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 12:10:59.470059 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:10:59.470059 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:10:59.470059 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:10:59.470059 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:10:59.470059 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:10:59.470059 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:10:59.470059 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:10:59.470059 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:10:59.470059 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:10:59.470059 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:10:59.470059 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:10:59.470059 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:10:59.470059 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:10:59.470059 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:10:59.470059 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:10:59.470931 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:10:59.470931 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:10:59.470931 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:10:59.470931 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:10:59.470931 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:10:59.470931 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:10:59.470931 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:10:59.470931 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:10:59.470931 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:10:59.470931 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:10:59.470931 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:10:59.470931 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:10:59.470931 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:10:59.470931 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:10:59.470931 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:10:59.470931 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:10:59.471708 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:10:59.471708 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:10:59.471708 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:10:59.471708 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:10:59.471708 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:10:59.471708 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:10:59.471708 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:10:59.471708 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:10:59.471708 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:10:59.471708 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:10:59.471708 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 12:10:59.471708 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:10:59.471708 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 194/402] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Sep 15 12:10:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:10:59.473632 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787da821-7efa-46b4-9c9d-4ce4939f1288 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:59.473632 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787da821-7efa-46b4-9c9d-4ce4939f1288 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:59.473632 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787da821-7efa-46b4-9c9d-4ce4939f1288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:59.493958 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-787da821-7efa-46b4-9c9d-4ce4939f1288 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:10:59.495229 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-787da821-7efa-46b4-9c9d-4ce4939f1288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:10:59.546313 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:59.564281 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:59.572144 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3a59a4-0eb8-4dd9-958c-6214bd511ee4 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:59.578806 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 195/403] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:10:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:10:59.579724 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787da821-7efa-46b4-9c9d-4ce4939f1288 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:59.613070 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965d027a-adaf-4e21-9204-079806fd7514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:59.613850 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965d027a-adaf-4e21-9204-079806fd7514 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:59.614232 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965d027a-adaf-4e21-9204-079806fd7514 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:59.614561 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965d027a-adaf-4e21-9204-079806fd7514 None admin] PATH_INFO: `/v3/groups/b997011a6594465f95ebd1afb2eaf4ed` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:59.615797 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965d027a-adaf-4e21-9204-079806fd7514 None admin] RBAC: Authorizing `identity:get_group(group_id=b997011a6594465f95ebd1afb2eaf4ed)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:59.617289 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965d027a-adaf-4e21-9204-079806fd7514 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:59.620166 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 209/404] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Sep 15 12:10:59 2022] GET /identity/v3/groups/b997011a6594465f95ebd1afb2eaf4ed => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:59.625071 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965d027a-adaf-4e21-9204-079806fd7514 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:59.742501 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787da821-7efa-46b4-9c9d-4ce4939f1288 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:59.780682 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7305c0e-4b8e-4f73-8282-4d3c82b5bafe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:59.780682 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7305c0e-4b8e-4f73-8282-4d3c82b5bafe None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:59.780682 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7305c0e-4b8e-4f73-8282-4d3c82b5bafe None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:59.780682 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7305c0e-4b8e-4f73-8282-4d3c82b5bafe None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:59.781340 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7305c0e-4b8e-4f73-8282-4d3c82b5bafe None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:10:59.781340 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7305c0e-4b8e-4f73-8282-4d3c82b5bafe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:59.782893 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7305c0e-4b8e-4f73-8282-4d3c82b5bafe None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:59.791957 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 196/405] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 15 12:10:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:59.797711 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7305c0e-4b8e-4f73-8282-4d3c82b5bafe None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:59.812489 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965d027a-adaf-4e21-9204-079806fd7514 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:10:59.851742 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40ada72-e923-40fa-bd17-f022354096d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:10:59.852901 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ada72-e923-40fa-bd17-f022354096d4 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:10:59.854013 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ada72-e923-40fa-bd17-f022354096d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:10:59.854634 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ada72-e923-40fa-bd17-f022354096d4 None admin] PATH_INFO: `/v3/projects/dd97fe3d09654c728d99e82d47ef59a5` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:10:59.857023 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40ada72-e923-40fa-bd17-f022354096d4 None admin] RBAC: Authorizing `identity:get_project(project_id=dd97fe3d09654c728d99e82d47ef59a5)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:10:59.859440 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40ada72-e923-40fa-bd17-f022354096d4 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:10:59.863490 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 210/406] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 15 12:10:59 2022] GET /identity/v3/projects/dd97fe3d09654c728d99e82d47ef59a5 => generated 302 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:10:59.870712 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40ada72-e923-40fa-bd17-f022354096d4 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:10:59.886191 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:59.915204 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:10:59.966259 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7305c0e-4b8e-4f73-8282-4d3c82b5bafe None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:00.004753 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40ada72-e923-40fa-bd17-f022354096d4 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:00.011263 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44831eef-a43b-4fc0-9805-5553ae78c027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:00.011902 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44831eef-a43b-4fc0-9805-5553ae78c027 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:00.012174 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44831eef-a43b-4fc0-9805-5553ae78c027 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:00.012441 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44831eef-a43b-4fc0-9805-5553ae78c027 None admin] PATH_INFO: `/v3/groups/b997011a6594465f95ebd1afb2eaf4ed` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:00.014114 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44831eef-a43b-4fc0-9805-5553ae78c027 None admin] RBAC: Authorizing `identity:get_group(group_id=b997011a6594465f95ebd1afb2eaf4ed)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:00.016557 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44831eef-a43b-4fc0-9805-5553ae78c027 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:00.019014 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 197/407] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Sep 15 12:10:59 2022] GET /identity/v3/groups/b997011a6594465f95ebd1afb2eaf4ed => generated 226 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:11:00.019996 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44831eef-a43b-4fc0-9805-5553ae78c027 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:00.043815 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46d2f0f-f2fd-4388-b57f-3fe653cb3e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:00.044867 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d2f0f-f2fd-4388-b57f-3fe653cb3e70 None admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:00.045328 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d2f0f-f2fd-4388-b57f-3fe653cb3e70 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:00.045814 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d2f0f-f2fd-4388-b57f-3fe653cb3e70 None admin] PATH_INFO: `/v3/projects/dd97fe3d09654c728d99e82d47ef59a5/groups/b997011a6594465f95ebd1afb2eaf4ed/roles/9371e5bbc55848949eb951a815f817f2` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:00.048052 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46d2f0f-f2fd-4388-b57f-3fe653cb3e70 None admin] RBAC: Authorizing `identity:create_grant(project_id=dd97fe3d09654c728d99e82d47ef59a5, group_id=b997011a6594465f95ebd1afb2eaf4ed, role_id=9371e5bbc55848949eb951a815f817f2)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:00.049779 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46d2f0f-f2fd-4388-b57f-3fe653cb3e70 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:00.072452 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 211/408] 10.222.0.16 () {58 vars in 1442 bytes} [Thu Sep 15 12:10:59 2022] PUT /identity/v3/projects/dd97fe3d09654c728d99e82d47ef59a5/groups/b997011a6594465f95ebd1afb2eaf4ed/roles/9371e5bbc55848949eb951a815f817f2 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:11:00.073721 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46d2f0f-f2fd-4388-b57f-3fe653cb3e70 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:00.194222 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:00.209947 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46d2f0f-f2fd-4388-b57f-3fe653cb3e70 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:00.218123 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44831eef-a43b-4fc0-9805-5553ae78c027 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:00.253949 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c9ec0c-45cc-403b-9ad4-2a69de5e3c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:00.255299 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c9ec0c-45cc-403b-9ad4-2a69de5e3c30 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:00.255863 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c9ec0c-45cc-403b-9ad4-2a69de5e3c30 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:00.256466 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:00.257312 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c9ec0c-45cc-403b-9ad4-2a69de5e3c30 None admin] PATH_INFO: `/v3/projects/dd97fe3d09654c728d99e82d47ef59a5` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:00.259310 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c9ec0c-45cc-403b-9ad4-2a69de5e3c30 None admin] RBAC: Authorizing `identity:get_project(project_id=dd97fe3d09654c728d99e82d47ef59a5)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:00.261421 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c9ec0c-45cc-403b-9ad4-2a69de5e3c30 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:00.263246 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 212/409] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 15 12:11:00 2022] GET /identity/v3/projects/dd97fe3d09654c728d99e82d47ef59a5 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:00.271727 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c9ec0c-45cc-403b-9ad4-2a69de5e3c30 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:00.305089 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39da266a-5dea-44ee-87c9-9a7e626d507d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:00.305739 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39da266a-5dea-44ee-87c9-9a7e626d507d None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:00.306018 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39da266a-5dea-44ee-87c9-9a7e626d507d None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:00.307682 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39da266a-5dea-44ee-87c9-9a7e626d507d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:00.334938 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39da266a-5dea-44ee-87c9-9a7e626d507d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:11:00.340563 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-39da266a-5dea-44ee-87c9-9a7e626d507d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:11:00.340563 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:00.340563 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:00.340563 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:00.340563 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:00.340563 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:00.340563 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:00.340563 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:00.340563 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:00.340563 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:00.340563 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:00.340563 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:00.340563 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:11:00.340563 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:11:00.340563 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:11:00.340563 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:11:00.341532 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:11:00.341532 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:11:00.341532 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:11:00.341532 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:11:00.341532 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:00.341532 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:00.341532 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:00.341532 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:00.341532 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:00.341532 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:00.341532 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:00.341532 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:00.341532 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:00.341532 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:00.341532 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:00.341532 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:00.342379 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:00.342379 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:00.342379 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:00.342379 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:00.342379 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:11:00.342379 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:11:00.342379 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:11:00.342379 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:11:00.342379 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:11:00.342379 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:11:00.342379 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:11:00.342379 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:00.344401 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 198/410] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Sep 15 12:11:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:00.350841 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39da266a-5dea-44ee-87c9-9a7e626d507d None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:00.431521 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c9ec0c-45cc-403b-9ad4-2a69de5e3c30 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:00.474061 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae0db21-2b55-4675-ab4c-ebe0c5b757e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:00.474752 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae0db21-2b55-4675-ab4c-ebe0c5b757e3 None admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:00.474875 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39da266a-5dea-44ee-87c9-9a7e626d507d None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:00.475278 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae0db21-2b55-4675-ab4c-ebe0c5b757e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:00.475278 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae0db21-2b55-4675-ab4c-ebe0c5b757e3 None admin] PATH_INFO: `/v3/projects/dd97fe3d09654c728d99e82d47ef59a5/groups/b997011a6594465f95ebd1afb2eaf4ed/roles/19ee0f56c10b47628ba0b1c3deee4448` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:00.478616 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae0db21-2b55-4675-ab4c-ebe0c5b757e3 None admin] RBAC: Authorizing `identity:create_grant(project_id=dd97fe3d09654c728d99e82d47ef59a5, group_id=b997011a6594465f95ebd1afb2eaf4ed, role_id=19ee0f56c10b47628ba0b1c3deee4448)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:00.480090 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae0db21-2b55-4675-ab4c-ebe0c5b757e3 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:00.511780 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 213/411] 10.222.0.16 () {58 vars in 1442 bytes} [Thu Sep 15 12:11:00 2022] PUT /identity/v3/projects/dd97fe3d09654c728d99e82d47ef59a5/groups/b997011a6594465f95ebd1afb2eaf4ed/roles/19ee0f56c10b47628ba0b1c3deee4448 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:11:00.537909 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea832c0-f321-418e-a432-97a469d96424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:00.538552 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea832c0-f321-418e-a432-97a469d96424 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:00.538883 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea832c0-f321-418e-a432-97a469d96424 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:00.539161 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea832c0-f321-418e-a432-97a469d96424 None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:00.539842 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea832c0-f321-418e-a432-97a469d96424 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:00.540250 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea832c0-f321-418e-a432-97a469d96424 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:00.541775 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea832c0-f321-418e-a432-97a469d96424 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:00.553537 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 199/412] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 15 12:11:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:00.561841 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae0db21-2b55-4675-ab4c-ebe0c5b757e3 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:00.607142 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:00.726290 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae0db21-2b55-4675-ab4c-ebe0c5b757e3 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:00.769343 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59e8a4d-bfdc-4b1d-b9ba-cd982f0f7d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:00.770380 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59e8a4d-bfdc-4b1d-b9ba-cd982f0f7d2e None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:00.770899 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59e8a4d-bfdc-4b1d-b9ba-cd982f0f7d2e None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:00.771454 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59e8a4d-bfdc-4b1d-b9ba-cd982f0f7d2e None admin] PATH_INFO: `/v3/groups/512f85f46ca44fe3861499475eec078a` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:00.772862 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59e8a4d-bfdc-4b1d-b9ba-cd982f0f7d2e None admin] RBAC: Authorizing `identity:get_group(group_id=512f85f46ca44fe3861499475eec078a)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:00.774502 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59e8a4d-bfdc-4b1d-b9ba-cd982f0f7d2e None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:00.776643 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 214/413] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Sep 15 12:11:00 2022] GET /identity/v3/groups/512f85f46ca44fe3861499475eec078a => generated 229 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:00.782362 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea832c0-f321-418e-a432-97a469d96424 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:00.820179 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:00.914866 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea832c0-f321-418e-a432-97a469d96424 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:00.961302 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac28cb25-5be7-4de4-b485-9dcc9d32afe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:00.962316 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28cb25-5be7-4de4-b485-9dcc9d32afe6 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:00.962857 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28cb25-5be7-4de4-b485-9dcc9d32afe6 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:00.963332 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28cb25-5be7-4de4-b485-9dcc9d32afe6 None admin] PATH_INFO: `/v3/projects/d145f986559340aaa64b155220d60d8c` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:00.964671 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac28cb25-5be7-4de4-b485-9dcc9d32afe6 None admin] RBAC: Authorizing `identity:get_project(project_id=d145f986559340aaa64b155220d60d8c)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:00.966385 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac28cb25-5be7-4de4-b485-9dcc9d32afe6 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:00.968616 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 200/414] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 15 12:11:00 2022] GET /identity/v3/projects/d145f986559340aaa64b155220d60d8c => generated 344 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:00.974508 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59e8a4d-bfdc-4b1d-b9ba-cd982f0f7d2e None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:01.094269 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:01.112037 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59e8a4d-bfdc-4b1d-b9ba-cd982f0f7d2e None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:01.152458 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf86f0bc-4dd5-4882-bda7-e555874ffc7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:01.153540 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf86f0bc-4dd5-4882-bda7-e555874ffc7c None admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:01.154029 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf86f0bc-4dd5-4882-bda7-e555874ffc7c None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:01.154505 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf86f0bc-4dd5-4882-bda7-e555874ffc7c None admin] PATH_INFO: `/v3/projects/d145f986559340aaa64b155220d60d8c/groups/512f85f46ca44fe3861499475eec078a/roles/7f53f1c823b746529ba5057bf21b2477` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:01.157530 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf86f0bc-4dd5-4882-bda7-e555874ffc7c None admin] RBAC: Authorizing `identity:create_grant(project_id=d145f986559340aaa64b155220d60d8c, group_id=512f85f46ca44fe3861499475eec078a, role_id=7f53f1c823b746529ba5057bf21b2477)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:01.159862 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf86f0bc-4dd5-4882-bda7-e555874ffc7c None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:01.179017 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 215/415] 10.222.0.16 () {58 vars in 1442 bytes} [Thu Sep 15 12:11:00 2022] PUT /identity/v3/projects/d145f986559340aaa64b155220d60d8c/groups/512f85f46ca44fe3861499475eec078a/roles/7f53f1c823b746529ba5057bf21b2477 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:11:01.624140 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a041a919-c919-458c-9796-21419d402524 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:01.625205 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a041a919-c919-458c-9796-21419d402524 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:01.625695 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a041a919-c919-458c-9796-21419d402524 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:01.627785 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 201/416] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:11:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:11:01.633810 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df517a8b-d927-4058-a8f9-f74282606b00 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:01.634680 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df517a8b-d927-4058-a8f9-f74282606b00 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:01.635179 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df517a8b-d927-4058-a8f9-f74282606b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:01.662205 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-df517a8b-d927-4058-a8f9-f74282606b00 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:11:01.663796 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-df517a8b-d927-4058-a8f9-f74282606b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:11:01.749305 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 216/417] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:11:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:11:01.898810 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a404e-fe8e-48f2-812f-b787212cc87e None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:01.899410 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a404e-fe8e-48f2-812f-b787212cc87e None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:01.899906 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a404e-fe8e-48f2-812f-b787212cc87e None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:01.901779 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 202/418] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:11:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:11:01.907438 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ba6c6-1a2b-4111-9694-709340aa8094 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:01.907987 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ba6c6-1a2b-4111-9694-709340aa8094 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:01.908466 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ba6c6-1a2b-4111-9694-709340aa8094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:01.932984 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-7f6ba6c6-1a2b-4111-9694-709340aa8094 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:11:01.934474 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-7f6ba6c6-1a2b-4111-9694-709340aa8094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:11:02.014804 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 217/419] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:11:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:11:02.146584 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a404e-fe8e-48f2-812f-b787212cc87e None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:02.280536 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a404e-fe8e-48f2-812f-b787212cc87e None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:02.282604 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:02.331936 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd683a1-569b-46f7-993c-eaf2aad05989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:02.332572 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd683a1-569b-46f7-993c-eaf2aad05989 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:02.332846 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd683a1-569b-46f7-993c-eaf2aad05989 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:02.333112 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd683a1-569b-46f7-993c-eaf2aad05989 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:02.347656 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd683a1-569b-46f7-993c-eaf2aad05989 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:11:02.352485 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-9bd683a1-569b-46f7-993c-eaf2aad05989 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 12:11:02.352485 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:02.352485 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:02.352485 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:02.352485 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:02.352485 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:02.352485 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:02.352485 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:02.352485 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:02.352485 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:02.352485 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:02.352485 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:02.352485 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:11:02.352485 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:11:02.352485 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:11:02.352485 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:11:02.353389 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:11:02.353389 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:11:02.353389 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:11:02.353389 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:11:02.353389 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:02.353389 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:02.353389 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:02.353389 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:02.353389 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:02.353389 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:02.353389 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:02.353389 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:02.353389 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:02.353389 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:02.353389 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:02.353389 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:02.354192 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:02.354192 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:02.354192 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:02.354192 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:02.354192 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:11:02.354192 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:11:02.354192 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:11:02.354192 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:11:02.354192 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:11:02.354192 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:11:02.354192 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 12:11:02.354192 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:02.354192 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 203/420] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Sep 15 12:11:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:02.359634 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6ba6c6-1a2b-4111-9694-709340aa8094 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:02.380798 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:02.469293 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd683a1-569b-46f7-993c-eaf2aad05989 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:02.496461 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6ba6c6-1a2b-4111-9694-709340aa8094 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:02.539126 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b4de9-58b5-4da6-8bdd-5504cba17469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:02.540023 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b4de9-58b5-4da6-8bdd-5504cba17469 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:02.540314 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b4de9-58b5-4da6-8bdd-5504cba17469 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:02.540589 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b4de9-58b5-4da6-8bdd-5504cba17469 None admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:02.541261 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76b4de9-58b5-4da6-8bdd-5504cba17469 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:02.541562 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76b4de9-58b5-4da6-8bdd-5504cba17469 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:02.542963 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76b4de9-58b5-4da6-8bdd-5504cba17469 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:02.552203 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 218/421] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 15 12:11:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:02.560940 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b4de9-58b5-4da6-8bdd-5504cba17469 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:02.670761 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd683a1-569b-46f7-993c-eaf2aad05989 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:02.696546 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:02.734722 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaed636-f071-473a-ac07-88aa8b6d8f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:02.735368 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaed636-f071-473a-ac07-88aa8b6d8f7f None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:02.735639 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaed636-f071-473a-ac07-88aa8b6d8f7f None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:02.735905 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaed636-f071-473a-ac07-88aa8b6d8f7f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:02.748378 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaed636-f071-473a-ac07-88aa8b6d8f7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:11:02.753507 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-adaed636-f071-473a-ac07-88aa8b6d8f7f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 12:11:02.753507 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:02.753507 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:02.753507 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:02.753507 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:02.753507 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:02.753507 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:02.753507 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:02.753507 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:02.753507 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:02.753507 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:02.753507 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:02.753507 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:11:02.753507 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:11:02.753507 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:11:02.753507 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:11:02.754378 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:11:02.754378 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:11:02.754378 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:11:02.754378 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:11:02.754378 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:02.754378 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:02.754378 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:02.754378 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:02.754378 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:02.754378 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:02.754378 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:02.754378 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:02.754378 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:02.754378 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:02.754378 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:02.754378 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:02.755215 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:02.755215 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:02.755215 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:02.755215 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:02.755215 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:11:02.755215 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:11:02.755215 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:11:02.755215 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:11:02.755215 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:11:02.755215 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:11:02.755215 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 12:11:02.755215 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:02.755215 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 204/422] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 15 12:11:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:02.758464 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b4de9-58b5-4da6-8bdd-5504cba17469 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:02.763673 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaed636-f071-473a-ac07-88aa8b6d8f7f None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:02.807159 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:02.813028 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0f699b-d901-4fe3-bac4-a7676fa216d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:02.813902 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0f699b-d901-4fe3-bac4-a7676fa216d9 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:02.814985 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0f699b-d901-4fe3-bac4-a7676fa216d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:02.815640 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0f699b-d901-4fe3-bac4-a7676fa216d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:02.891446 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaed636-f071-473a-ac07-88aa8b6d8f7f None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:02.902004 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0f699b-d901-4fe3-bac4-a7676fa216d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:02.903731 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0f699b-d901-4fe3-bac4-a7676fa216d9 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:02.935810 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9513a635-d473-4f9a-a183-1fc7ca7ba44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:02.936657 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9513a635-d473-4f9a-a183-1fc7ca7ba44a None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:02.936938 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9513a635-d473-4f9a-a183-1fc7ca7ba44a None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:02.938103 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9513a635-d473-4f9a-a183-1fc7ca7ba44a None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:02.939069 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9513a635-d473-4f9a-a183-1fc7ca7ba44a None admin] RBAC: Adding query filter params (name=member) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:02.939374 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9513a635-d473-4f9a-a183-1fc7ca7ba44a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:02.940992 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9513a635-d473-4f9a-a183-1fc7ca7ba44a None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:02.952076 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 205/423] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Sep 15 12:11:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:02.953941 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a0b9c-3787-4e2e-98e4-ecb98d320749 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:02.954249 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a0b9c-3787-4e2e-98e4-ecb98d320749 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:02.954525 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a0b9c-3787-4e2e-98e4-ecb98d320749 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:02.958766 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 206/424] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:11:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:11:02.959720 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22a0b9c-3787-4e2e-98e4-ecb98d320749 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:02.998587 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:03.047100 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 219/425] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 15 12:11:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 12:11:03.048911 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95641f4-5692-47a6-b2dd-30a485ee7d8d None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:03.049423 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95641f4-5692-47a6-b2dd-30a485ee7d8d None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:03.049913 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95641f4-5692-47a6-b2dd-30a485ee7d8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:03.056506 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:03.072797 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-a95641f4-5692-47a6-b2dd-30a485ee7d8d None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:11:03.074491 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-a95641f4-5692-47a6-b2dd-30a485ee7d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:11:03.074597 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22a0b9c-3787-4e2e-98e4-ecb98d320749 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:03.111345 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a742b22-32a3-4e7a-bf81-adf45d2a027d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:03.112055 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a742b22-32a3-4e7a-bf81-adf45d2a027d None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:03.112434 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a742b22-32a3-4e7a-bf81-adf45d2a027d None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:03.112798 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a742b22-32a3-4e7a-bf81-adf45d2a027d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:03.152814 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 220/426] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:11:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:11:03.154003 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95641f4-5692-47a6-b2dd-30a485ee7d8d None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:03.188781 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a742b22-32a3-4e7a-bf81-adf45d2a027d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:03.190374 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a742b22-32a3-4e7a-bf81-adf45d2a027d None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:03.278781 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:03.284283 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95641f4-5692-47a6-b2dd-30a485ee7d8d None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:03.303026 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:03.325666 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 207/427] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 15 12:11:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 12:11:03.329768 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de83bf49-7729-413a-8208-55e4e7a86bd9 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:03.330493 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de83bf49-7729-413a-8208-55e4e7a86bd9 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:03.330806 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de83bf49-7729-413a-8208-55e4e7a86bd9 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:03.332192 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 208/428] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:11:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:11:03.333545 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de83bf49-7729-413a-8208-55e4e7a86bd9 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:03.348763 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4dc818-8fbf-4250-9cae-2d7f39d21d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:03.349851 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4dc818-8fbf-4250-9cae-2d7f39d21d1b None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:03.350333 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4dc818-8fbf-4250-9cae-2d7f39d21d1b None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:03.350840 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4dc818-8fbf-4250-9cae-2d7f39d21d1b None admin] PATH_INFO: `/v3/projects/23903d1c5f234a8ba964a00b23864453` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:03.352304 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4dc818-8fbf-4250-9cae-2d7f39d21d1b None admin] RBAC: Authorizing `identity:get_project(project_id=23903d1c5f234a8ba964a00b23864453)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:03.354073 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4dc818-8fbf-4250-9cae-2d7f39d21d1b None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:03.356483 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 221/429] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 15 12:11:03 2022] GET /identity/v3/projects/23903d1c5f234a8ba964a00b23864453 => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:03.357877 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f358537c-b948-43cf-b876-8cea84c4f73d None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:03.358363 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f358537c-b948-43cf-b876-8cea84c4f73d None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:03.358907 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f358537c-b948-43cf-b876-8cea84c4f73d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:03.379498 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-f358537c-b948-43cf-b876-8cea84c4f73d None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:11:03.381152 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-f358537c-b948-43cf-b876-8cea84c4f73d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:11:03.442824 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de83bf49-7729-413a-8208-55e4e7a86bd9 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:03.454197 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 222/430] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:11:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:11:03.459793 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f358537c-b948-43cf-b876-8cea84c4f73d None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:03.478544 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bb7bb4-3daf-4906-8d2d-0358541553e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:03.479504 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb7bb4-3daf-4906-8d2d-0358541553e8 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:03.479689 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb7bb4-3daf-4906-8d2d-0358541553e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:03.479963 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb7bb4-3daf-4906-8d2d-0358541553e8 None admin] PATH_INFO: `/v3/projects/23903d1c5f234a8ba964a00b23864453` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:03.481211 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bb7bb4-3daf-4906-8d2d-0358541553e8 None admin] RBAC: Authorizing `identity:get_project(project_id=23903d1c5f234a8ba964a00b23864453)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:03.482837 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bb7bb4-3daf-4906-8d2d-0358541553e8 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:03.494779 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 209/431] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 15 12:11:03 2022] GET /identity/v3/projects/23903d1c5f234a8ba964a00b23864453 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:03.495931 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bb7bb4-3daf-4906-8d2d-0358541553e8 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:03.568571 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:03.580980 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:03.585100 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f358537c-b948-43cf-b876-8cea84c4f73d None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:03.621325 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bb7bb4-3daf-4906-8d2d-0358541553e8 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:03.623535 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b53ee9-2b33-44fd-b0db-d4a677a2e8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:03.624573 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b53ee9-2b33-44fd-b0db-d4a677a2e8ea None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:03.624573 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b53ee9-2b33-44fd-b0db-d4a677a2e8ea None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:03.624792 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b53ee9-2b33-44fd-b0db-d4a677a2e8ea None admin] PATH_INFO: `/v3/groups/b997011a6594465f95ebd1afb2eaf4ed` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:03.626787 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b53ee9-2b33-44fd-b0db-d4a677a2e8ea None admin] RBAC: Authorizing `identity:get_group(group_id=b997011a6594465f95ebd1afb2eaf4ed)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:03.628213 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b53ee9-2b33-44fd-b0db-d4a677a2e8ea None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:03.634782 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 223/432] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Sep 15 12:11:03 2022] GET /identity/v3/groups/b997011a6594465f95ebd1afb2eaf4ed => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:03.635586 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b53ee9-2b33-44fd-b0db-d4a677a2e8ea None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:03.658988 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce63a34a-508b-45c9-b7ec-4ef0ba9e55de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:03.659864 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63a34a-508b-45c9-b7ec-4ef0ba9e55de None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:03.660288 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63a34a-508b-45c9-b7ec-4ef0ba9e55de None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:03.660728 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63a34a-508b-45c9-b7ec-4ef0ba9e55de None admin] PATH_INFO: `/v3/groups/b997011a6594465f95ebd1afb2eaf4ed` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:03.662118 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce63a34a-508b-45c9-b7ec-4ef0ba9e55de None admin] RBAC: Authorizing `identity:get_group(group_id=b997011a6594465f95ebd1afb2eaf4ed)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:03.663809 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce63a34a-508b-45c9-b7ec-4ef0ba9e55de None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:03.670656 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 210/433] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Sep 15 12:11:03 2022] GET /identity/v3/groups/b997011a6594465f95ebd1afb2eaf4ed => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:03.672294 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce63a34a-508b-45c9-b7ec-4ef0ba9e55de None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:03.746361 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b53ee9-2b33-44fd-b0db-d4a677a2e8ea None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:03.783652 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce63a34a-508b-45c9-b7ec-4ef0ba9e55de None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:03.784651 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcc512f-dc04-488e-b1e5-39cb0a56f61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:03.785279 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcc512f-dc04-488e-b1e5-39cb0a56f61a None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:03.785554 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcc512f-dc04-488e-b1e5-39cb0a56f61a None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:03.786600 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcc512f-dc04-488e-b1e5-39cb0a56f61a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:03.796710 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcc512f-dc04-488e-b1e5-39cb0a56f61a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:11:03.802596 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-8fcc512f-dc04-488e-b1e5-39cb0a56f61a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 12:11:03.802596 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:03.802596 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:03.802596 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:03.802596 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:03.802596 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:03.802596 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:03.802596 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:03.802596 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:03.802596 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:03.802596 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:03.802596 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:03.802596 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:11:03.802596 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:11:03.802596 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:11:03.802596 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:11:03.803596 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:11:03.803596 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:11:03.803596 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:11:03.803596 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:11:03.803596 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:03.803596 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:03.803596 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:03.803596 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:03.803596 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:03.803596 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:03.803596 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:03.803596 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:03.803596 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:03.803596 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:03.803596 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:03.803596 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:03.804959 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:03.804959 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:03.804959 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:03.804959 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:03.804959 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:11:03.804959 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:11:03.804959 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:11:03.804959 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:11:03.804959 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:11:03.804959 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:11:03.804959 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 12:11:03.804959 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:11:03.804959 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 224/434] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 15 12:11:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:03.804959 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcc512f-dc04-488e-b1e5-39cb0a56f61a None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:03.810358 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:03.825649 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9c667e-c5da-4323-a86e-54c7d2cc1bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:03.826368 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9c667e-c5da-4323-a86e-54c7d2cc1bf5 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:03.826643 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9c667e-c5da-4323-a86e-54c7d2cc1bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:03.826961 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9c667e-c5da-4323-a86e-54c7d2cc1bf5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:03.827677 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9c667e-c5da-4323-a86e-54c7d2cc1bf5 None admin] RBAC: Adding query filter params (group.id=b997011a6594465f95ebd1afb2eaf4ed, role.id=19ee0f56c10b47628ba0b1c3deee4448, scope.project.id=23903d1c5f234a8ba964a00b23864453) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:03.827983 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9c667e-c5da-4323-a86e-54c7d2cc1bf5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:03.829596 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9c667e-c5da-4323-a86e-54c7d2cc1bf5 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:03.834446 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:03.836991 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 211/435] 10.222.0.16 () {56 vars in 1376 bytes} [Thu Sep 15 12:11:03 2022] GET /identity/v3/role_assignments?group.id=b997011a6594465f95ebd1afb2eaf4ed&scope.project.id=23903d1c5f234a8ba964a00b23864453&role.id=19ee0f56c10b47628ba0b1c3deee4448 => generated 611 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:03.839563 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9c667e-c5da-4323-a86e-54c7d2cc1bf5 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:03.924362 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcc512f-dc04-488e-b1e5-39cb0a56f61a None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:03.957827 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9c667e-c5da-4323-a86e-54c7d2cc1bf5 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:03.966498 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e04b95-6c89-4fbb-8238-03166598c764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:03.970254 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e04b95-6c89-4fbb-8238-03166598c764 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:03.970254 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e04b95-6c89-4fbb-8238-03166598c764 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:03.970254 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e04b95-6c89-4fbb-8238-03166598c764 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:03.970254 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e04b95-6c89-4fbb-8238-03166598c764 None admin] RBAC: Adding query filter params (group.id=b997011a6594465f95ebd1afb2eaf4ed, role.id=9371e5bbc55848949eb951a815f817f2, scope.project.id=23903d1c5f234a8ba964a00b23864453) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:03.970596 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e04b95-6c89-4fbb-8238-03166598c764 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:03.971954 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e04b95-6c89-4fbb-8238-03166598c764 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:03.991233 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 225/436] 10.222.0.16 () {56 vars in 1376 bytes} [Thu Sep 15 12:11:03 2022] GET /identity/v3/role_assignments?group.id=b997011a6594465f95ebd1afb2eaf4ed&scope.project.id=23903d1c5f234a8ba964a00b23864453&role.id=9371e5bbc55848949eb951a815f817f2 => generated 611 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:03.991233 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e04b95-6c89-4fbb-8238-03166598c764 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:04.011759 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89dcd97-56a9-4949-bb2f-e910665050b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:04.012431 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89dcd97-56a9-4949-bb2f-e910665050b4 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:04.012715 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89dcd97-56a9-4949-bb2f-e910665050b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:04.012989 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89dcd97-56a9-4949-bb2f-e910665050b4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:04.026052 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89dcd97-56a9-4949-bb2f-e910665050b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:11:04.033793 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-b89dcd97-56a9-4949-bb2f-e910665050b4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 12:11:04.033793 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:04.033793 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:04.033793 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:04.033793 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:04.033793 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:04.033793 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:04.033793 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:04.033793 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:04.033793 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:04.033793 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:04.033793 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:04.033793 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:11:04.033793 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:11:04.033793 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:11:04.033793 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:11:04.034964 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:11:04.034964 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:11:04.034964 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:11:04.034964 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:11:04.034964 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:04.034964 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:04.034964 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:04.034964 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:04.034964 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:04.034964 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:04.034964 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:04.034964 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:04.034964 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:04.034964 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:04.034964 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:04.034964 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:04.035931 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:04.035931 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:04.035931 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:04.035931 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:04.035931 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:11:04.035931 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:11:04.035931 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:11:04.035931 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:11:04.035931 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:11:04.035931 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:11:04.035931 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 12:11:04.035931 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:04.035931 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 212/437] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Sep 15 12:11:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:04.036729 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74107d09-5c83-47a0-9a69-e3f7e63fc23e None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:04.036729 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74107d09-5c83-47a0-9a69-e3f7e63fc23e None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:04.036866 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74107d09-5c83-47a0-9a69-e3f7e63fc23e None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:04.038109 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 213/438] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:11:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:11:04.043181 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74107d09-5c83-47a0-9a69-e3f7e63fc23e None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:04.117683 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:04.130538 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:04.146109 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e04b95-6c89-4fbb-8238-03166598c764 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:04.185055 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74107d09-5c83-47a0-9a69-e3f7e63fc23e None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:04.188214 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3190aa81-d08c-4c45-a3dc-7dd8bc64a82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:04.188994 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3190aa81-d08c-4c45-a3dc-7dd8bc64a82e None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:04.189265 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3190aa81-d08c-4c45-a3dc-7dd8bc64a82e None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:04.189530 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3190aa81-d08c-4c45-a3dc-7dd8bc64a82e None admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:04.190192 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3190aa81-d08c-4c45-a3dc-7dd8bc64a82e None admin] RBAC: Adding query filter params (name=member) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:04.190491 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3190aa81-d08c-4c45-a3dc-7dd8bc64a82e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:04.191874 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3190aa81-d08c-4c45-a3dc-7dd8bc64a82e None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:04.201558 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 226/439] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Sep 15 12:11:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:04.203913 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1743b8-7da7-4e66-b390-5bb596c4b551 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:04.204216 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1743b8-7da7-4e66-b390-5bb596c4b551 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:04.204743 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1743b8-7da7-4e66-b390-5bb596c4b551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:04.225553 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-1b1743b8-7da7-4e66-b390-5bb596c4b551 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:11:04.228119 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-1b1743b8-7da7-4e66-b390-5bb596c4b551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:11:04.228238 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5296d5-90dd-4c23-9d4d-45b967492a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:04.228238 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5296d5-90dd-4c23-9d4d-45b967492a16 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:04.228495 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5296d5-90dd-4c23-9d4d-45b967492a16 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:04.229545 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5296d5-90dd-4c23-9d4d-45b967492a16 None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:04.230492 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5296d5-90dd-4c23-9d4d-45b967492a16 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:04.230861 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5296d5-90dd-4c23-9d4d-45b967492a16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:04.232256 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5296d5-90dd-4c23-9d4d-45b967492a16 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:04.241965 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 214/440] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 15 12:11:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:11:04.242835 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5296d5-90dd-4c23-9d4d-45b967492a16 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:04.305062 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 227/441] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:11:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:11:04.305956 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1743b8-7da7-4e66-b390-5bb596c4b551 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:04.360808 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5296d5-90dd-4c23-9d4d-45b967492a16 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:04.371720 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:04.401928 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13729408-8319-42bd-9553-d1334a493413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:04.402683 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13729408-8319-42bd-9553-d1334a493413 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:04.403078 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13729408-8319-42bd-9553-d1334a493413 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:04.403479 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13729408-8319-42bd-9553-d1334a493413 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:04.423253 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:04.452193 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1743b8-7da7-4e66-b390-5bb596c4b551 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:04.489108 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13729408-8319-42bd-9553-d1334a493413 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:04.491064 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13729408-8319-42bd-9553-d1334a493413 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:04.499412 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2b3035-5ee7-46ec-9822-4e7b0346dd67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:04.500557 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b3035-5ee7-46ec-9822-4e7b0346dd67 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:04.500900 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b3035-5ee7-46ec-9822-4e7b0346dd67 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:04.501425 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b3035-5ee7-46ec-9822-4e7b0346dd67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:04.598516 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2b3035-5ee7-46ec-9822-4e7b0346dd67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:04.600052 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2b3035-5ee7-46ec-9822-4e7b0346dd67 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:04.621039 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 215/442] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 15 12:11:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 12:11:04.622167 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13729408-8319-42bd-9553-d1334a493413 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:04.631010 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:04.686677 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:04.705915 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 228/443] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 15 12:11:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 12:11:04.706760 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2b3035-5ee7-46ec-9822-4e7b0346dd67 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:04.732829 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13729408-8319-42bd-9553-d1334a493413 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:04.766319 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53250f1-aa1f-425b-aa07-4f82c87c68f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:04.766971 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53250f1-aa1f-425b-aa07-4f82c87c68f0 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:04.767252 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53250f1-aa1f-425b-aa07-4f82c87c68f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:04.767529 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53250f1-aa1f-425b-aa07-4f82c87c68f0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:04.777303 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53250f1-aa1f-425b-aa07-4f82c87c68f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:11:04.783167 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-f53250f1-aa1f-425b-aa07-4f82c87c68f0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:11:04.783167 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:04.783167 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:04.783167 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:04.783167 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:04.783167 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:04.783167 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:04.783167 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:04.783167 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:04.783167 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:04.783167 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:04.783167 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:04.783167 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:11:04.783167 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:11:04.783167 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:11:04.783167 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:11:04.784154 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:11:04.784154 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:11:04.784154 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:11:04.784154 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:11:04.784154 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:04.784154 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:04.784154 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:04.784154 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:04.784154 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:04.784154 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:04.784154 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:04.784154 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:04.784154 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:04.784154 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:04.784154 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:04.784154 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:04.784937 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:04.784937 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:04.784937 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:04.784937 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:04.784937 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:11:04.784937 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:11:04.784937 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:11:04.784937 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:11:04.784937 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:11:04.784937 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:11:04.784937 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:11:04.784937 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:04.784937 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 216/444] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Sep 15 12:11:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:04.785591 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53250f1-aa1f-425b-aa07-4f82c87c68f0 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:04.807376 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2b3035-5ee7-46ec-9822-4e7b0346dd67 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:04.840562 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e85a34-815b-416a-bc78-0ee13dcc7c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:04.841177 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e85a34-815b-416a-bc78-0ee13dcc7c77 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:04.841450 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e85a34-815b-416a-bc78-0ee13dcc7c77 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:04.841716 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e85a34-815b-416a-bc78-0ee13dcc7c77 None admin] PATH_INFO: `/v3/projects/dd97fe3d09654c728d99e82d47ef59a5` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:04.842852 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e85a34-815b-416a-bc78-0ee13dcc7c77 None admin] RBAC: Authorizing `identity:get_project(project_id=dd97fe3d09654c728d99e82d47ef59a5)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:04.844836 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e85a34-815b-416a-bc78-0ee13dcc7c77 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:04.846473 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 229/445] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 15 12:11:04 2022] GET /identity/v3/projects/dd97fe3d09654c728d99e82d47ef59a5 => generated 302 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:04.847239 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e85a34-815b-416a-bc78-0ee13dcc7c77 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:04.850495 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:04.886087 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53250f1-aa1f-425b-aa07-4f82c87c68f0 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:04.897407 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:04.919317 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8051943c-e382-46dd-920c-a50c637ba996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:04.919942 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8051943c-e382-46dd-920c-a50c637ba996 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:04.920222 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8051943c-e382-46dd-920c-a50c637ba996 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:04.920495 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8051943c-e382-46dd-920c-a50c637ba996 None admin] PATH_INFO: `/v3/projects/dd97fe3d09654c728d99e82d47ef59a5` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:04.921601 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8051943c-e382-46dd-920c-a50c637ba996 None admin] RBAC: Authorizing `identity:get_project(project_id=dd97fe3d09654c728d99e82d47ef59a5)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:04.923064 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8051943c-e382-46dd-920c-a50c637ba996 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:04.924670 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 217/446] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 15 12:11:04 2022] GET /identity/v3/projects/dd97fe3d09654c728d99e82d47ef59a5 => generated 302 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:04.925421 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8051943c-e382-46dd-920c-a50c637ba996 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:04.946854 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e85a34-815b-416a-bc78-0ee13dcc7c77 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:04.983028 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25332eec-6ccc-49b6-83ab-305e87257499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:04.983636 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25332eec-6ccc-49b6-83ab-305e87257499 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:04.983912 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25332eec-6ccc-49b6-83ab-305e87257499 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:04.984187 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25332eec-6ccc-49b6-83ab-305e87257499 None admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:04.985166 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25332eec-6ccc-49b6-83ab-305e87257499 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:04.985166 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25332eec-6ccc-49b6-83ab-305e87257499 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:04.986529 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25332eec-6ccc-49b6-83ab-305e87257499 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:04.994505 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 230/447] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 15 12:11:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:04.995316 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25332eec-6ccc-49b6-83ab-305e87257499 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:05.025987 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8051943c-e382-46dd-920c-a50c637ba996 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:05.058241 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140b9f00-1a1d-4e5e-91dd-9674bc6a3405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:05.058902 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b9f00-1a1d-4e5e-91dd-9674bc6a3405 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:05.059180 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b9f00-1a1d-4e5e-91dd-9674bc6a3405 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:05.059454 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b9f00-1a1d-4e5e-91dd-9674bc6a3405 None admin] PATH_INFO: `/v3/groups/b997011a6594465f95ebd1afb2eaf4ed` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:05.060556 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140b9f00-1a1d-4e5e-91dd-9674bc6a3405 None admin] RBAC: Authorizing `identity:get_group(group_id=b997011a6594465f95ebd1afb2eaf4ed)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:05.061977 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140b9f00-1a1d-4e5e-91dd-9674bc6a3405 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:05.063567 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 218/448] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Sep 15 12:11:04 2022] GET /identity/v3/groups/b997011a6594465f95ebd1afb2eaf4ed => generated 226 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:05.064309 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140b9f00-1a1d-4e5e-91dd-9674bc6a3405 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:05.066785 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:05.100951 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25332eec-6ccc-49b6-83ab-305e87257499 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:05.113544 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:05.134958 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b22e17f-dd22-41df-9f66-09ff438b3ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:05.135580 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b22e17f-dd22-41df-9f66-09ff438b3ce3 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:05.136017 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b22e17f-dd22-41df-9f66-09ff438b3ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:05.136331 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b22e17f-dd22-41df-9f66-09ff438b3ce3 None admin] PATH_INFO: `/v3/groups/b997011a6594465f95ebd1afb2eaf4ed` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:05.138126 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b22e17f-dd22-41df-9f66-09ff438b3ce3 None admin] RBAC: Authorizing `identity:get_group(group_id=b997011a6594465f95ebd1afb2eaf4ed)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:05.139569 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b22e17f-dd22-41df-9f66-09ff438b3ce3 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:05.141638 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 231/449] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Sep 15 12:11:04 2022] GET /identity/v3/groups/b997011a6594465f95ebd1afb2eaf4ed => generated 226 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:05.142821 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b22e17f-dd22-41df-9f66-09ff438b3ce3 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:05.166528 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140b9f00-1a1d-4e5e-91dd-9674bc6a3405 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:05.198753 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46278ee5-f49a-40f7-b184-076db03073e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:05.199331 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46278ee5-f49a-40f7-b184-076db03073e0 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:05.199608 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46278ee5-f49a-40f7-b184-076db03073e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:05.199877 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46278ee5-f49a-40f7-b184-076db03073e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:05.240645 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b22e17f-dd22-41df-9f66-09ff438b3ce3 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:05.265290 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46278ee5-f49a-40f7-b184-076db03073e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:05.267376 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46278ee5-f49a-40f7-b184-076db03073e0 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:05.269127 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:05.274674 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d837bf5d-10d0-46b7-9a59-4c0f542019ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:05.275314 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d837bf5d-10d0-46b7-9a59-4c0f542019ab None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:05.275590 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d837bf5d-10d0-46b7-9a59-4c0f542019ab None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:05.275866 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d837bf5d-10d0-46b7-9a59-4c0f542019ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:05.276577 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d837bf5d-10d0-46b7-9a59-4c0f542019ab None admin] RBAC: Adding query filter params (group.id=b997011a6594465f95ebd1afb2eaf4ed, role.id=9371e5bbc55848949eb951a815f817f2, scope.project.id=dd97fe3d09654c728d99e82d47ef59a5) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:05.276880 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d837bf5d-10d0-46b7-9a59-4c0f542019ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:05.278266 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d837bf5d-10d0-46b7-9a59-4c0f542019ab None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:05.283803 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 232/450] 10.222.0.16 () {56 vars in 1376 bytes} [Thu Sep 15 12:11:05 2022] GET /identity/v3/role_assignments?group.id=b997011a6594465f95ebd1afb2eaf4ed&scope.project.id=dd97fe3d09654c728d99e82d47ef59a5&role.id=9371e5bbc55848949eb951a815f817f2 => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:05.284555 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d837bf5d-10d0-46b7-9a59-4c0f542019ab None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:05.343853 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:05.379400 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 219/451] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 15 12:11:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 12:11:05.384822 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46278ee5-f49a-40f7-b184-076db03073e0 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:05.410413 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d837bf5d-10d0-46b7-9a59-4c0f542019ab None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:05.449880 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741eabde-2517-42ed-991e-9dea7d2accd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:05.450814 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741eabde-2517-42ed-991e-9dea7d2accd1 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:05.450907 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741eabde-2517-42ed-991e-9dea7d2accd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:05.451141 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741eabde-2517-42ed-991e-9dea7d2accd1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:05.451873 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741eabde-2517-42ed-991e-9dea7d2accd1 None admin] RBAC: Adding query filter params (group.id=b997011a6594465f95ebd1afb2eaf4ed, role.id=19ee0f56c10b47628ba0b1c3deee4448, scope.project.id=dd97fe3d09654c728d99e82d47ef59a5) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:05.452177 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741eabde-2517-42ed-991e-9dea7d2accd1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:05.454385 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741eabde-2517-42ed-991e-9dea7d2accd1 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:05.461980 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 233/452] 10.222.0.16 () {56 vars in 1376 bytes} [Thu Sep 15 12:11:05 2022] GET /identity/v3/role_assignments?group.id=b997011a6594465f95ebd1afb2eaf4ed&scope.project.id=dd97fe3d09654c728d99e82d47ef59a5&role.id=19ee0f56c10b47628ba0b1c3deee4448 => generated 611 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:05.501734 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46278ee5-f49a-40f7-b184-076db03073e0 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:05.503500 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:05.548906 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b56d644-190d-48ec-9034-23fcd8a8b5be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:05.549554 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b56d644-190d-48ec-9034-23fcd8a8b5be None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:05.549834 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b56d644-190d-48ec-9034-23fcd8a8b5be None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:05.550102 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b56d644-190d-48ec-9034-23fcd8a8b5be None admin] PATH_INFO: `/v3/projects/d145f986559340aaa64b155220d60d8c` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:05.551339 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b56d644-190d-48ec-9034-23fcd8a8b5be None admin] RBAC: Authorizing `identity:get_project(project_id=d145f986559340aaa64b155220d60d8c)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:05.552812 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b56d644-190d-48ec-9034-23fcd8a8b5be None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:05.555168 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 220/453] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 15 12:11:05 2022] GET /identity/v3/projects/d145f986559340aaa64b155220d60d8c => generated 344 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:11:05.562187 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741eabde-2517-42ed-991e-9dea7d2accd1 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:05.680867 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741eabde-2517-42ed-991e-9dea7d2accd1 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:05.690405 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:05.716945 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6be8111-381f-4c55-a4e1-97a400cc709c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:05.717930 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be8111-381f-4c55-a4e1-97a400cc709c None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:05.718208 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be8111-381f-4c55-a4e1-97a400cc709c None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:05.718482 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be8111-381f-4c55-a4e1-97a400cc709c None admin] PATH_INFO: `/v3/groups/512f85f46ca44fe3861499475eec078a` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:05.719790 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6be8111-381f-4c55-a4e1-97a400cc709c None admin] RBAC: Authorizing `identity:get_group(group_id=512f85f46ca44fe3861499475eec078a)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:05.721238 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6be8111-381f-4c55-a4e1-97a400cc709c None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:05.722920 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 234/454] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Sep 15 12:11:05 2022] GET /identity/v3/groups/512f85f46ca44fe3861499475eec078a => generated 229 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:05.729134 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b56d644-190d-48ec-9034-23fcd8a8b5be None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:05.834516 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b56d644-190d-48ec-9034-23fcd8a8b5be None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:05.869093 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c814ca-558b-45ee-90ca-de83ccd4b8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:05.869691 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c814ca-558b-45ee-90ca-de83ccd4b8e8 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:05.869970 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c814ca-558b-45ee-90ca-de83ccd4b8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:05.870238 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c814ca-558b-45ee-90ca-de83ccd4b8e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:05.870992 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c814ca-558b-45ee-90ca-de83ccd4b8e8 None admin] RBAC: Adding query filter params (group.id=512f85f46ca44fe3861499475eec078a, role.id=7f53f1c823b746529ba5057bf21b2477, scope.project.id=d145f986559340aaa64b155220d60d8c) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:05.871298 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c814ca-558b-45ee-90ca-de83ccd4b8e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:05.872739 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c814ca-558b-45ee-90ca-de83ccd4b8e8 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:05.879462 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 221/455] 10.222.0.16 () {56 vars in 1376 bytes} [Thu Sep 15 12:11:05 2022] GET /identity/v3/role_assignments?group.id=512f85f46ca44fe3861499475eec078a&scope.project.id=d145f986559340aaa64b155220d60d8c&role.id=7f53f1c823b746529ba5057bf21b2477 => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:08.351458 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11041bb-9a35-453f-8802-2da464a9b2a3 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:08.352411 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11041bb-9a35-453f-8802-2da464a9b2a3 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:08.352902 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11041bb-9a35-453f-8802-2da464a9b2a3 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:08.354637 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 235/456] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:11:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:11:08.360633 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b9941b-8c2c-499c-8f1b-a35e8559b0e7 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:08.361400 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b9941b-8c2c-499c-8f1b-a35e8559b0e7 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:08.361873 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b9941b-8c2c-499c-8f1b-a35e8559b0e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:08.382405 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-a5b9941b-8c2c-499c-8f1b-a35e8559b0e7 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:11:08.383912 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-a5b9941b-8c2c-499c-8f1b-a35e8559b0e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:11:08.411462 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:08.452787 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 222/457] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:11:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:11:08.730587 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11041bb-9a35-453f-8802-2da464a9b2a3 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:08.829651 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335a37b3-b39d-4ec1-8c4a-a4710dd23b9d None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:08.830201 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335a37b3-b39d-4ec1-8c4a-a4710dd23b9d None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:08.830617 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335a37b3-b39d-4ec1-8c4a-a4710dd23b9d None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:08.833580 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 223/458] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:11:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:11:08.837741 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c01ce90-6536-4e9a-a6f9-70e2696c94b3 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:08.838010 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c01ce90-6536-4e9a-a6f9-70e2696c94b3 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:08.838563 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c01ce90-6536-4e9a-a6f9-70e2696c94b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:08.865914 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-3c01ce90-6536-4e9a-a6f9-70e2696c94b3 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:11:08.867119 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-3c01ce90-6536-4e9a-a6f9-70e2696c94b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:11:08.887314 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11041bb-9a35-453f-8802-2da464a9b2a3 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:08.933685 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de8f693-321a-46dd-90bf-5bef010e0fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:08.934316 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de8f693-321a-46dd-90bf-5bef010e0fde None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:08.934590 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de8f693-321a-46dd-90bf-5bef010e0fde None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:08.934887 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de8f693-321a-46dd-90bf-5bef010e0fde None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:08.959944 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de8f693-321a-46dd-90bf-5bef010e0fde None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:08.969987 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de8f693-321a-46dd-90bf-5bef010e0fde None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:09.010613 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-5de8f693-321a-46dd-90bf-5bef010e0fde None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:09.010613 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:09.010613 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:09.010613 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:09.010613 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:09.010613 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:09.010613 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:09.010613 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:09.010613 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:09.010613 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:09.010613 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:09.010613 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:09.010613 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:11:09.010613 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:11:09.010613 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:11:09.010613 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:11:09.011565 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:09.011565 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:09.011565 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:09.011565 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:09.011565 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:09.011565 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:09.011565 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:09.011565 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:09.011565 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:09.011565 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:09.011565 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:09.011565 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:09.011565 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:09.011565 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:09.011565 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:09.011565 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:09.011565 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:11:09.012426 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:11:09.012426 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:09.012426 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:11:09.019792 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 236/459] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:11:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:09.020819 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de8f693-321a-46dd-90bf-5bef010e0fde None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:09.027778 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 224/460] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:11:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 12:11:09.060378 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:09.142026 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de8f693-321a-46dd-90bf-5bef010e0fde None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:09.175570 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b5ee6d-4a74-406a-98bb-ef4d0dbfd190 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:09.176180 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b5ee6d-4a74-406a-98bb-ef4d0dbfd190 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:09.176678 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b5ee6d-4a74-406a-98bb-ef4d0dbfd190 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:09.177878 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777b0f2e-6c15-468f-ab03-add0993bd8b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:09.178494 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b0f2e-6c15-468f-ab03-add0993bd8b8 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:09.181851 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b0f2e-6c15-468f-ab03-add0993bd8b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:09.181851 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b0f2e-6c15-468f-ab03-add0993bd8b8 None admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:09.181851 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777b0f2e-6c15-468f-ab03-add0993bd8b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:09.181851 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777b0f2e-6c15-468f-ab03-add0993bd8b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:09.181851 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777b0f2e-6c15-468f-ab03-add0993bd8b8 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:09.182406 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 225/461] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:11:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:11:09.183708 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a75a40-eab8-46d6-b58f-cd24456d0028 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:09.184203 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a75a40-eab8-46d6-b58f-cd24456d0028 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:09.184666 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a75a40-eab8-46d6-b58f-cd24456d0028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:09.194727 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 237/462] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 15 12:11:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:09.199633 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777b0f2e-6c15-468f-ab03-add0993bd8b8 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:09.213873 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-26a75a40-eab8-46d6-b58f-cd24456d0028 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:11:09.215538 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-26a75a40-eab8-46d6-b58f-cd24456d0028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:11:09.297439 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 226/463] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:11:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:11:09.299266 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:09.300441 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89315c92-f7d0-4466-a3e2-2e748a25ef94 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:09.301141 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89315c92-f7d0-4466-a3e2-2e748a25ef94 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:09.301881 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89315c92-f7d0-4466-a3e2-2e748a25ef94 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:09.303825 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 227/464] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:11:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:11:09.314710 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa7bb6-4d06-42d1-af63-41386756b22d None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:09.315018 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa7bb6-4d06-42d1-af63-41386756b22d None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:09.315360 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa7bb6-4d06-42d1-af63-41386756b22d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:09.325793 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777b0f2e-6c15-468f-ab03-add0993bd8b8 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:09.352403 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-31aa7bb6-4d06-42d1-af63-41386756b22d None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:11:09.354800 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-31aa7bb6-4d06-42d1-af63-41386756b22d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:11:09.389494 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:09.393782 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ab565d-9411-4024-8606-84349b31bfd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:09.394959 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab565d-9411-4024-8606-84349b31bfd0 None admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:09.395541 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab565d-9411-4024-8606-84349b31bfd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:09.396186 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab565d-9411-4024-8606-84349b31bfd0 None admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:09.397381 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ab565d-9411-4024-8606-84349b31bfd0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:09.400072 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ab565d-9411-4024-8606-84349b31bfd0 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:09.428295 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 238/465] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Sep 15 12:11:09 2022] POST /identity/v3/users => generated 246 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:11:09.429395 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ab565d-9411-4024-8606-84349b31bfd0 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:09.453817 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 228/466] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:11:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:11:09.543630 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ab565d-9411-4024-8606-84349b31bfd0 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:09.586478 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ef272f-9867-4268-aad9-99b21c666165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:09.587072 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ef272f-9867-4268-aad9-99b21c666165 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:09.587350 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ef272f-9867-4268-aad9-99b21c666165 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:09.587621 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ef272f-9867-4268-aad9-99b21c666165 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:09.604050 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ef272f-9867-4268-aad9-99b21c666165 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:09.607847 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ef272f-9867-4268-aad9-99b21c666165 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:09.611374 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:09.632106 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-13ef272f-9867-4268-aad9-99b21c666165 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:09.632106 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:09.632106 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:09.632106 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:09.632106 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:09.632106 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:09.632106 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:09.632106 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:09.632106 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:09.632106 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:09.632106 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:09.632106 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:09.632106 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:11:09.632106 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:11:09.632106 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:11:09.632106 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:11:09.633063 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:09.633063 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:09.633063 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:09.633063 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:09.633063 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:09.633063 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:09.633063 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:09.633063 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:09.633063 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:09.633063 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:09.633063 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:09.633063 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:09.633063 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:09.633063 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:09.633063 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:09.633063 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:09.633063 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:11:09.633909 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:11:09.633909 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:09.633909 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:11:09.633909 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 239/467] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:11:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:09.640285 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aa7bb6-4d06-42d1-af63-41386756b22d None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:09.646954 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ef272f-9867-4268-aad9-99b21c666165 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:09.775165 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aa7bb6-4d06-42d1-af63-41386756b22d None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:09.778320 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ef272f-9867-4268-aad9-99b21c666165 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:09.817324 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba987fa2-3a32-4acc-a49d-98419ee1ec52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:09.817940 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba987fa2-3a32-4acc-a49d-98419ee1ec52 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:09.818216 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba987fa2-3a32-4acc-a49d-98419ee1ec52 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:09.818485 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba987fa2-3a32-4acc-a49d-98419ee1ec52 None admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:09.819184 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba987fa2-3a32-4acc-a49d-98419ee1ec52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:09.819312 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f942be-4904-48fb-91f5-c20820242a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:09.819493 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba987fa2-3a32-4acc-a49d-98419ee1ec52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:09.819826 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f942be-4904-48fb-91f5-c20820242a07 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:09.820102 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f942be-4904-48fb-91f5-c20820242a07 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:09.820370 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f942be-4904-48fb-91f5-c20820242a07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:09.820853 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba987fa2-3a32-4acc-a49d-98419ee1ec52 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:09.832650 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f942be-4904-48fb-91f5-c20820242a07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:09.834287 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f942be-4904-48fb-91f5-c20820242a07 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:09.842510 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 229/468] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 15 12:11:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:09.843117 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba987fa2-3a32-4acc-a49d-98419ee1ec52 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:09.850518 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-13f942be-4904-48fb-91f5-c20820242a07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:09.850518 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:09.850518 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:09.850518 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:09.850518 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:09.850518 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:09.850518 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:09.850518 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:09.850518 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:09.850518 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:09.850518 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:09.850518 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:09.850518 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:11:09.850518 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:11:09.850518 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:11:09.850518 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:11:09.851454 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:09.851454 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:09.851454 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:09.851454 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:09.851454 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:09.851454 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:09.851454 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:09.851454 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:09.851454 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:09.851454 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:09.851454 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:09.851454 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:09.851454 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:09.851454 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:09.851454 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:09.851454 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:09.851454 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:11:09.852283 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:11:09.852283 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:09.852283 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:11:09.852283 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 240/469] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:11:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:11:09.852892 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f942be-4904-48fb-91f5-c20820242a07 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:09.864140 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:09.913614 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:09.972910 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba987fa2-3a32-4acc-a49d-98419ee1ec52 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:09.986679 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f942be-4904-48fb-91f5-c20820242a07 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:10.020419 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61de3a61-dd01-4098-8c94-2ae70cdfe321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:10.021200 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de3a61-dd01-4098-8c94-2ae70cdfe321 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:10.021709 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de3a61-dd01-4098-8c94-2ae70cdfe321 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:10.022399 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de3a61-dd01-4098-8c94-2ae70cdfe321 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:10.027236 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3b0299-aed0-49a1-82ed-61d6c857f356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:10.027834 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b0299-aed0-49a1-82ed-61d6c857f356 None admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:10.028110 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b0299-aed0-49a1-82ed-61d6c857f356 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:10.028378 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b0299-aed0-49a1-82ed-61d6c857f356 None admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:10.029020 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3b0299-aed0-49a1-82ed-61d6c857f356 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:10.030659 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3b0299-aed0-49a1-82ed-61d6c857f356 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:10.034276 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61de3a61-dd01-4098-8c94-2ae70cdfe321 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:10.035873 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61de3a61-dd01-4098-8c94-2ae70cdfe321 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:10.054363 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-61de3a61-dd01-4098-8c94-2ae70cdfe321 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:10.054363 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:10.054363 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:10.054363 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:10.054363 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:10.054363 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:10.054363 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:10.054363 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:10.054363 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:10.054363 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:10.054363 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:10.054363 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:10.054363 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:11:10.054363 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:11:10.054363 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:11:10.054363 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:11:10.055370 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:10.055370 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:10.055370 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:10.055370 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:10.055370 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:10.055370 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:10.055370 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:10.055370 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:10.055370 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:10.055370 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:10.055370 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:10.055370 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:10.055370 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:10.055370 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:10.055370 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:10.055370 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:10.055370 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:11:10.056195 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:11:10.056195 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:10.056195 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:10.056195 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 230/470] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:11:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:10.057591 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 241/471] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Sep 15 12:11:09 2022] POST /identity/v3/users => generated 248 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:11:10.057714 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61de3a61-dd01-4098-8c94-2ae70cdfe321 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:10.063747 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3b0299-aed0-49a1-82ed-61d6c857f356 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:10.129615 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:10.171501 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61de3a61-dd01-4098-8c94-2ae70cdfe321 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:10.205116 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3b0299-aed0-49a1-82ed-61d6c857f356 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:10.211238 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64191df8-d606-46ca-bf78-7e41dbb4fb61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:10.211955 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64191df8-d606-46ca-bf78-7e41dbb4fb61 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:10.212302 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64191df8-d606-46ca-bf78-7e41dbb4fb61 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:10.212645 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64191df8-d606-46ca-bf78-7e41dbb4fb61 None admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:10.213367 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64191df8-d606-46ca-bf78-7e41dbb4fb61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:10.213737 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64191df8-d606-46ca-bf78-7e41dbb4fb61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:10.214173 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:10.215851 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64191df8-d606-46ca-bf78-7e41dbb4fb61 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:10.233924 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 231/472] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 15 12:11:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:10.236103 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3feb2f3-e569-4b34-91af-f78eb0f73dd6 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:10.236455 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3feb2f3-e569-4b34-91af-f78eb0f73dd6 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:10.236801 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3feb2f3-e569-4b34-91af-f78eb0f73dd6 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:10.239054 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 232/473] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:11:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:11:10.239914 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3feb2f3-e569-4b34-91af-f78eb0f73dd6 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:10.248353 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4357201d-0167-4c0c-b127-5973458466e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:10.249109 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4357201d-0167-4c0c-b127-5973458466e4 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:10.249392 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4357201d-0167-4c0c-b127-5973458466e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:10.250578 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4357201d-0167-4c0c-b127-5973458466e4 None admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:10.251542 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4357201d-0167-4c0c-b127-5973458466e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:10.251848 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4357201d-0167-4c0c-b127-5973458466e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:10.253701 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4357201d-0167-4c0c-b127-5973458466e4 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:10.268787 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 242/474] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 15 12:11:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:10.270141 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92750794-b901-4301-8313-109aa984407b None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:10.270423 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92750794-b901-4301-8313-109aa984407b None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:10.270722 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92750794-b901-4301-8313-109aa984407b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:10.294338 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-92750794-b901-4301-8313-109aa984407b None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:11:10.295606 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-92750794-b901-4301-8313-109aa984407b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:11:10.363401 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3feb2f3-e569-4b34-91af-f78eb0f73dd6 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:10.382196 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 243/475] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:11:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:11:10.383113 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92750794-b901-4301-8313-109aa984407b None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:10.397113 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:10.401537 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd650dfd-eb1b-4ec4-b53b-9228748b5a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:10.402290 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd650dfd-eb1b-4ec4-b53b-9228748b5a02 None admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:10.402637 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd650dfd-eb1b-4ec4-b53b-9228748b5a02 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:10.402999 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd650dfd-eb1b-4ec4-b53b-9228748b5a02 None admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:10.403878 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd650dfd-eb1b-4ec4-b53b-9228748b5a02 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:10.405732 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd650dfd-eb1b-4ec4-b53b-9228748b5a02 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:10.442770 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 233/476] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Sep 15 12:11:10 2022] POST /identity/v3/users => generated 249 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:11:10.530339 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:10.540426 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92750794-b901-4301-8313-109aa984407b None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:10.592787 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7da5705-b46a-437f-95b8-5568323d7229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:10.593976 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da5705-b46a-437f-95b8-5568323d7229 None admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:10.594299 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da5705-b46a-437f-95b8-5568323d7229 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:10.594643 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da5705-b46a-437f-95b8-5568323d7229 None admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:10.595429 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7da5705-b46a-437f-95b8-5568323d7229 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:10.597018 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7da5705-b46a-437f-95b8-5568323d7229 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:10.634970 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 244/477] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Sep 15 12:11:10 2022] POST /identity/v3/users => generated 248 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:11:10.817878 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd650dfd-eb1b-4ec4-b53b-9228748b5a02 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:10.925202 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd650dfd-eb1b-4ec4-b53b-9228748b5a02 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:10.962991 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c56897b-a05e-432d-b8ae-019c2532f745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:10.963612 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56897b-a05e-432d-b8ae-019c2532f745 None admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:10.963891 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56897b-a05e-432d-b8ae-019c2532f745 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:10.964166 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56897b-a05e-432d-b8ae-019c2532f745 None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:10.964908 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c56897b-a05e-432d-b8ae-019c2532f745 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:10.966410 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c56897b-a05e-432d-b8ae-019c2532f745 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:10.979263 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.sql.core [None req-4c56897b-a05e-432d-b8ae-019c2532f745 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 15 12:11:10.979263 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 15 12:11:10.979263 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [parameters: {'id': 'dbd5589ed5c2400c9e20070217935f0f', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 15 12:11:10.979263 dv-cinder-850836-7-smb devstack@keystone.service[81375]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81375) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 15 12:11:10.997029 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-4c56897b-a05e-432d-b8ae-019c2532f745 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 15 12:11:10.997029 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:10.997029 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 15 12:11:10.997029 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 15 12:11:10.997029 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 15 12:11:10.997029 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 15 12:11:10.997029 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 15 12:11:10.997029 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application result = self._query(query) Sep 15 12:11:10.997029 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 15 12:11:10.997029 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application conn.query(q) Sep 15 12:11:10.997029 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 15 12:11:10.997029 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 15 12:11:10.997029 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 15 12:11:10.997029 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application result.read() Sep 15 12:11:10.997029 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 15 12:11:10.997959 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 15 12:11:10.997959 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 15 12:11:10.997959 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 15 12:11:10.997959 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 15 12:11:10.997959 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 15 12:11:10.997959 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 15 12:11:10.997959 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 15 12:11:10.997959 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 15 12:11:10.997959 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:10.997959 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 15 12:11:10.997959 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:10.997959 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:10.997959 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 15 12:11:10.997959 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 15 12:11:10.997959 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 15 12:11:10.997959 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return ref.to_dict() Sep 15 12:11:10.997959 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 15 12:11:10.997959 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application next(self.gen) Sep 15 12:11:10.998872 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 15 12:11:10.998872 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application yield resource Sep 15 12:11:10.998872 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 15 12:11:10.998872 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application next(self.gen) Sep 15 12:11:10.998872 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 15 12:11:10.998872 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application self.session.rollback() Sep 15 12:11:10.998872 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 15 12:11:10.998872 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application self.force_reraise() Sep 15 12:11:10.998872 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 15 12:11:10.998872 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise self.value Sep 15 12:11:10.998872 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 15 12:11:10.998872 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 15 12:11:10.998872 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 15 12:11:10.998872 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application session.commit() Sep 15 12:11:10.998872 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 15 12:11:10.998872 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 15 12:11:10.998872 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 15 12:11:10.999739 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application self._prepare_impl() Sep 15 12:11:10.999739 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 15 12:11:10.999739 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application self.session.flush() Sep 15 12:11:10.999739 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 15 12:11:10.999739 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application self._flush(objects) Sep 15 12:11:10.999739 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 15 12:11:10.999739 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 15 12:11:10.999739 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 15 12:11:10.999739 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application compat.raise_( Sep 15 12:11:10.999739 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 15 12:11:10.999739 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception Sep 15 12:11:10.999739 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 15 12:11:10.999739 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application flush_context.execute() Sep 15 12:11:10.999739 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 15 12:11:10.999739 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rec.execute(self) Sep 15 12:11:10.999739 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 15 12:11:10.999739 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 15 12:11:11.000599 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 15 12:11:11.000599 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 15 12:11:11.000599 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 15 12:11:11.000599 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 15 12:11:11.000599 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 15 12:11:11.000599 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 15 12:11:11.000599 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 15 12:11:11.000599 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 15 12:11:11.000599 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 15 12:11:11.000599 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 15 12:11:11.000599 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 15 12:11:11.000599 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 15 12:11:11.000599 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 15 12:11:11.000599 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 15 12:11:11.000599 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 15 12:11:11.000599 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception Sep 15 12:11:11.001666 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 15 12:11:11.001666 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 15 12:11:11.001666 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 15 12:11:11.001666 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 15 12:11:11.001666 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 15 12:11:11.001666 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application result = self._query(query) Sep 15 12:11:11.001666 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 15 12:11:11.001666 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application conn.query(q) Sep 15 12:11:11.001666 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 15 12:11:11.001666 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 15 12:11:11.001666 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 15 12:11:11.001666 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application result.read() Sep 15 12:11:11.001666 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 15 12:11:11.001666 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 15 12:11:11.001666 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 15 12:11:11.001666 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 15 12:11:11.002434 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 15 12:11:11.002434 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 15 12:11:11.002434 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 15 12:11:11.002434 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 15 12:11:11.002434 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 15 12:11:11.002434 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 15 12:11:11.002434 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [parameters: {'id': 'dbd5589ed5c2400c9e20070217935f0f', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 15 12:11:11.002434 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 15 12:11:11.002434 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:11.002434 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 12:11:11.002434 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:11.002434 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:11.002434 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:11.002434 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:11.002434 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:11.002434 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:11.008144 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:11.008144 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:11.008144 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:11.008144 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:11.008144 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:11.008144 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:11.008144 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 15 12:11:11.008144 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 15 12:11:11.008144 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:11.008144 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:11.008144 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 15 12:11:11.008144 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 15 12:11:11.008144 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 15 12:11:11.008144 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 15 12:11:11.008144 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 15 12:11:11.008144 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:11.009215 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 234/478] 10.222.0.16 () {60 vars in 1131 bytes} [Thu Sep 15 12:11:10 2022] POST /identity/v3/roles => generated 144 bytes in 181 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:11.009287 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7da5705-b46a-437f-95b8-5568323d7229 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:11.122192 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7da5705-b46a-437f-95b8-5568323d7229 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:11.170357 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27a89bb-aaf9-455b-b9bb-f004c3a17ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:11.171040 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a89bb-aaf9-455b-b9bb-f004c3a17ef3 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:11.171321 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a89bb-aaf9-455b-b9bb-f004c3a17ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:11.171635 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a89bb-aaf9-455b-b9bb-f004c3a17ef3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:11.188366 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27a89bb-aaf9-455b-b9bb-f004c3a17ef3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:11:11.194369 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-c27a89bb-aaf9-455b-b9bb-f004c3a17ef3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 12:11:11.194369 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:11.194369 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:11.194369 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:11.194369 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:11.194369 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:11.194369 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:11.194369 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:11.194369 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:11.194369 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:11.194369 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:11.194369 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:11.194369 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:11:11.194369 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:11:11.194369 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:11:11.194369 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:11:11.195452 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:11:11.195452 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:11:11.195452 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:11:11.195452 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:11:11.195452 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:11.195452 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:11.195452 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:11.195452 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:11.195452 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:11.195452 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:11.195452 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:11.195452 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:11.195452 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:11.195452 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:11.195452 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:11.195452 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:11.196398 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:11.196398 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:11.196398 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:11.196398 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:11.196398 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:11:11.196398 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:11:11.196398 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:11:11.196398 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:11:11.196398 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:11:11.196398 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:11:11.196398 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 12:11:11.196398 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:11:11.197987 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 245/479] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Sep 15 12:11:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:11:11.207761 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c56897b-a05e-432d-b8ae-019c2532f745 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:11.284025 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:11.354876 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c56897b-a05e-432d-b8ae-019c2532f745 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:11.406718 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66313298-2b0f-4ba6-a4df-c076d342976e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:11.406718 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66313298-2b0f-4ba6-a4df-c076d342976e None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:11.406718 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66313298-2b0f-4ba6-a4df-c076d342976e None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:11.406718 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66313298-2b0f-4ba6-a4df-c076d342976e None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:11.407910 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66313298-2b0f-4ba6-a4df-c076d342976e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:11.407910 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66313298-2b0f-4ba6-a4df-c076d342976e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:11.407910 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66313298-2b0f-4ba6-a4df-c076d342976e None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:11.422095 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 235/480] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 15 12:11:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:12.095673 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da7dc6-83aa-4f3a-8d03-4d50e65cfcd5 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:12.096192 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da7dc6-83aa-4f3a-8d03-4d50e65cfcd5 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:12.096192 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da7dc6-83aa-4f3a-8d03-4d50e65cfcd5 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:12.097522 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 246/481] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:11:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:11:12.103995 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f266b9fb-f844-475c-a063-ba019a69d4d6 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:12.104286 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f266b9fb-f844-475c-a063-ba019a69d4d6 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:12.104566 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f266b9fb-f844-475c-a063-ba019a69d4d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:12.131678 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-f266b9fb-f844-475c-a063-ba019a69d4d6 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:11:12.132891 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-f266b9fb-f844-475c-a063-ba019a69d4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:11:12.213811 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 236/482] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:11:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:11:12.586808 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10da7dc6-83aa-4f3a-8d03-4d50e65cfcd5 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:12.600541 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:12.647001 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91114949-6c31-4404-b483-bf61bc52f871 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:12.647979 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91114949-6c31-4404-b483-bf61bc52f871 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:12.648352 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91114949-6c31-4404-b483-bf61bc52f871 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:12.650041 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 237/483] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:11:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:11:12.658101 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86496d7-bff8-48ba-88d6-88e0e303b89e None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:12.658507 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86496d7-bff8-48ba-88d6-88e0e303b89e None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:12.658918 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86496d7-bff8-48ba-88d6-88e0e303b89e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:12.690774 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-f86496d7-bff8-48ba-88d6-88e0e303b89e None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:11:12.692504 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-f86496d7-bff8-48ba-88d6-88e0e303b89e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:11:12.729814 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10da7dc6-83aa-4f3a-8d03-4d50e65cfcd5 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:12.762727 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:12.769275 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5863e533-4f4a-464a-981e-4d44dbf3ebb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:12.769910 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5863e533-4f4a-464a-981e-4d44dbf3ebb3 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:12.770185 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5863e533-4f4a-464a-981e-4d44dbf3ebb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:12.770452 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5863e533-4f4a-464a-981e-4d44dbf3ebb3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:12.783696 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5863e533-4f4a-464a-981e-4d44dbf3ebb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:11:12.789119 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-5863e533-4f4a-464a-981e-4d44dbf3ebb3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 12:11:12.789119 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:12.789119 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:12.789119 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:12.789119 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:12.789119 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:12.789119 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:12.789119 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:12.789119 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:12.789119 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:12.789119 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:12.789119 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:12.789119 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:11:12.789119 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:11:12.789119 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:11:12.789119 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:11:12.790012 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:11:12.790012 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:11:12.790012 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:11:12.790012 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:11:12.790012 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:12.790012 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:12.790012 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:12.790012 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:12.790012 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:12.790012 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:12.790012 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:12.790012 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:12.790012 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:12.790012 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:12.790012 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:12.790012 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:12.790842 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:12.790842 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:12.790842 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:12.790842 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:12.790842 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:11:12.790842 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:11:12.790842 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:11:12.790842 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:11:12.790842 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:11:12.790842 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:11:12.790842 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 12:11:12.790842 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:11:12.790842 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 247/484] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Sep 15 12:11:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:12.799526 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5863e533-4f4a-464a-981e-4d44dbf3ebb3 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:12.839613 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 238/485] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:11:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 12:11:12.909557 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:12.950333 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5863e533-4f4a-464a-981e-4d44dbf3ebb3 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:12.992407 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c356241-7f9e-4fad-a212-f20625f9a770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:12.993010 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c356241-7f9e-4fad-a212-f20625f9a770 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:12.993284 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c356241-7f9e-4fad-a212-f20625f9a770 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:12.993550 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c356241-7f9e-4fad-a212-f20625f9a770 None admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:12.994208 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c356241-7f9e-4fad-a212-f20625f9a770 None admin] RBAC: Adding query filter params (name=service) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:12.994503 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c356241-7f9e-4fad-a212-f20625f9a770 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:12.995883 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c356241-7f9e-4fad-a212-f20625f9a770 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:13.009822 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 248/486] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Sep 15 12:11:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:13.016015 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86496d7-bff8-48ba-88d6-88e0e303b89e None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:13.165939 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86496d7-bff8-48ba-88d6-88e0e303b89e None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:13.175345 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c356241-7f9e-4fad-a212-f20625f9a770 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:13.209240 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1be8e2c-0400-4298-ad1e-0450d1b03664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:13.210319 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1be8e2c-0400-4298-ad1e-0450d1b03664 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:13.210804 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1be8e2c-0400-4298-ad1e-0450d1b03664 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:13.211247 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1be8e2c-0400-4298-ad1e-0450d1b03664 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:13.235269 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1be8e2c-0400-4298-ad1e-0450d1b03664 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:13.237713 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1be8e2c-0400-4298-ad1e-0450d1b03664 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:13.267595 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-a1be8e2c-0400-4298-ad1e-0450d1b03664 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:13.267595 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:13.267595 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:13.267595 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:13.267595 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:13.267595 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:13.267595 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:13.267595 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:13.267595 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:13.267595 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:13.267595 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:13.267595 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:13.267595 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:11:13.267595 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:11:13.267595 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:11:13.267595 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:11:13.268516 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:13.268516 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:13.268516 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:13.268516 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:13.268516 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:13.268516 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:13.268516 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:13.268516 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:13.268516 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:13.268516 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:13.268516 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:13.268516 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:13.268516 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:13.268516 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:13.268516 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:13.268516 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:13.268516 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:11:13.269338 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:11:13.269338 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:13.269338 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:13.276768 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 239/487] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:11:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:13.282433 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1be8e2c-0400-4298-ad1e-0450d1b03664 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:13.321173 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:13.346957 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c356241-7f9e-4fad-a212-f20625f9a770 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:13.382526 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:13.388441 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f169fdd-adc7-4ac7-8c3a-d39512301d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:13.389071 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f169fdd-adc7-4ac7-8c3a-d39512301d9c None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:13.389347 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f169fdd-adc7-4ac7-8c3a-d39512301d9c None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:13.389613 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f169fdd-adc7-4ac7-8c3a-d39512301d9c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:13.400483 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f169fdd-adc7-4ac7-8c3a-d39512301d9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:11:13.405749 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-1f169fdd-adc7-4ac7-8c3a-d39512301d9c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 12:11:13.405749 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:13.405749 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:13.405749 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:13.405749 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:13.405749 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:13.405749 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:13.405749 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:13.405749 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:13.405749 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:13.405749 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:13.405749 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:13.405749 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:11:13.405749 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:11:13.405749 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:11:13.405749 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:11:13.406923 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:11:13.406923 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:11:13.406923 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:11:13.406923 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:11:13.406923 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:13.406923 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:13.406923 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:13.406923 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:13.406923 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:13.406923 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:13.406923 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:13.406923 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:13.406923 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:13.406923 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:13.406923 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:13.406923 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:13.408047 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:13.408047 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:13.408047 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:13.408047 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:13.408047 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:11:13.408047 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:11:13.408047 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:11:13.408047 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:11:13.408047 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:11:13.408047 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:11:13.408047 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 12:11:13.408047 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:11:13.408047 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 249/488] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Sep 15 12:11:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:13.408752 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2016e65-132e-4370-8be7-3a617b7403dc None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:13.408752 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2016e65-132e-4370-8be7-3a617b7403dc None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:13.409275 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2016e65-132e-4370-8be7-3a617b7403dc None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:13.410432 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 250/489] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:11:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:11:13.416891 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ea806-07ce-4127-ba21-5b8832e82f88 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:13.417110 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ea806-07ce-4127-ba21-5b8832e82f88 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:13.417389 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ea806-07ce-4127-ba21-5b8832e82f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:13.419772 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1be8e2c-0400-4298-ad1e-0450d1b03664 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:13.436089 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-599ea806-07ce-4127-ba21-5b8832e82f88 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:11:13.437850 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-599ea806-07ce-4127-ba21-5b8832e82f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:11:13.456733 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c66f840-9819-4ce1-91ea-7c4400d4ce2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:13.457346 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c66f840-9819-4ce1-91ea-7c4400d4ce2b None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:13.457623 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c66f840-9819-4ce1-91ea-7c4400d4ce2b None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:13.457895 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c66f840-9819-4ce1-91ea-7c4400d4ce2b None admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:13.458538 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c66f840-9819-4ce1-91ea-7c4400d4ce2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:13.458869 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c66f840-9819-4ce1-91ea-7c4400d4ce2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:13.460246 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c66f840-9819-4ce1-91ea-7c4400d4ce2b None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:13.474080 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 240/490] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 15 12:11:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:11:13.477204 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c66f840-9819-4ce1-91ea-7c4400d4ce2b None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:13.518780 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 251/491] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:11:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:11:13.518780 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a97e1f-0609-4abe-b315-7542ce24033a None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:13.518780 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a97e1f-0609-4abe-b315-7542ce24033a None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:13.518780 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a97e1f-0609-4abe-b315-7542ce24033a None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:13.518780 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 252/492] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:11:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:11:13.518780 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a97e1f-0609-4abe-b315-7542ce24033a None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:13.567326 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:13.588711 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c66f840-9819-4ce1-91ea-7c4400d4ce2b None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:13.629630 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cc485e-51ee-4765-af50-3f87e3ab7eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:13.630772 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc485e-51ee-4765-af50-3f87e3ab7eba None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:13.631061 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc485e-51ee-4765-af50-3f87e3ab7eba None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:13.631600 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc485e-51ee-4765-af50-3f87e3ab7eba None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:13.632321 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cc485e-51ee-4765-af50-3f87e3ab7eba None admin] RBAC: Adding query filter params (name=service) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:13.632895 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cc485e-51ee-4765-af50-3f87e3ab7eba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:13.634708 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cc485e-51ee-4765-af50-3f87e3ab7eba None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:13.650582 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 241/493] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Sep 15 12:11:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:13.652799 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf64627c-dd98-462b-af7d-c698bd35338e None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:13.653088 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf64627c-dd98-462b-af7d-c698bd35338e None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:13.653369 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf64627c-dd98-462b-af7d-c698bd35338e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:13.655330 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a97e1f-0609-4abe-b315-7542ce24033a None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:13.676012 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-bf64627c-dd98-462b-af7d-c698bd35338e None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:11:13.677525 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-bf64627c-dd98-462b-af7d-c698bd35338e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:11:13.683773 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:13.698323 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea705145-4f18-4891-969b-1e8aec89b443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:13.699113 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea705145-4f18-4891-969b-1e8aec89b443 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:13.699490 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea705145-4f18-4891-969b-1e8aec89b443 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:13.700123 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea705145-4f18-4891-969b-1e8aec89b443 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:13.708898 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea705145-4f18-4891-969b-1e8aec89b443 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:13.710697 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea705145-4f18-4891-969b-1e8aec89b443 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:13.726137 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-ea705145-4f18-4891-969b-1e8aec89b443 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 15 12:11:13.726137 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:13.726137 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:13.726137 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:13.726137 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:13.726137 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:13.726137 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:13.726137 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:13.726137 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:13.726137 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:13.726137 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:13.726137 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:13.726137 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 12:11:13.726137 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 12:11:13.726137 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 12:11:13.726137 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 12:11:13.727647 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:13.727647 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:13.727647 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 12:11:13.727647 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:11:13.727647 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 12:11:13.727647 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:11:13.727647 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:13.727647 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:13.727647 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:13.727647 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:13.727647 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:13.727647 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:13.727647 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:13.727647 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:13.727647 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:13.727647 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:13.727647 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:13.727647 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:13.728738 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:13.728738 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:13.728738 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 12:11:13.728738 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 12:11:13.728738 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 12:11:13.728738 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 12:11:13.728738 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 12:11:13.728738 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 12:11:13.728738 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 15 12:11:13.728738 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:11:13.733615 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 253/494] 10.222.0.16 () {56 vars in 1093 bytes} [Thu Sep 15 12:11:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:13.733615 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea705145-4f18-4891-969b-1e8aec89b443 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:13.766642 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 242/495] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:11:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:11:13.767668 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf64627c-dd98-462b-af7d-c698bd35338e None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:13.866326 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:13.878030 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea705145-4f18-4891-969b-1e8aec89b443 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:13.905989 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf64627c-dd98-462b-af7d-c698bd35338e None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:13.919756 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d8e281-a688-4200-b4f6-882089e5445f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:13.920388 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d8e281-a688-4200-b4f6-882089e5445f None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:13.920666 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d8e281-a688-4200-b4f6-882089e5445f None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:13.920936 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d8e281-a688-4200-b4f6-882089e5445f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:13.934009 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d8e281-a688-4200-b4f6-882089e5445f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:13.935766 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d8e281-a688-4200-b4f6-882089e5445f None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:13.949617 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22238dc4-b9e2-402e-b2f3-7c7294c6f50f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:13.950491 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22238dc4-b9e2-402e-b2f3-7c7294c6f50f None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:13.950990 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22238dc4-b9e2-402e-b2f3-7c7294c6f50f None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:13.951472 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22238dc4-b9e2-402e-b2f3-7c7294c6f50f None admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:13.952018 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-c3d8e281-a688-4200-b4f6-882089e5445f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:13.952018 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:13.952018 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:13.952018 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:13.952018 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:13.952018 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:13.952018 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:13.952018 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:13.952018 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:13.952018 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:13.952018 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:13.952018 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:13.952018 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:11:13.952018 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:11:13.952018 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:11:13.952018 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:11:13.953420 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:13.953420 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:13.953420 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:13.953420 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:13.953420 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:13.953420 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:13.953420 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:13.953420 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:13.953420 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:13.953420 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:13.953420 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:13.953420 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:13.953420 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:13.953420 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:13.953420 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:13.953420 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:13.953420 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:11:13.954254 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:11:13.954254 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:13.954254 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:11:13.955476 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22238dc4-b9e2-402e-b2f3-7c7294c6f50f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:13.955979 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22238dc4-b9e2-402e-b2f3-7c7294c6f50f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:13.957619 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22238dc4-b9e2-402e-b2f3-7c7294c6f50f None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:13.958248 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 254/496] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:11:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:13.959121 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d8e281-a688-4200-b4f6-882089e5445f None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:13.998085 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:14.016555 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 243/497] 10.222.0.16 () {56 vars in 1133 bytes} [Thu Sep 15 12:11:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:14.016555 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22238dc4-b9e2-402e-b2f3-7c7294c6f50f None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:14.077303 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d8e281-a688-4200-b4f6-882089e5445f None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:14.110602 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d10750-5620-4faf-a6b4-84cb4cb747a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:14.111247 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d10750-5620-4faf-a6b4-84cb4cb747a9 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:14.111524 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d10750-5620-4faf-a6b4-84cb4cb747a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:14.111810 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d10750-5620-4faf-a6b4-84cb4cb747a9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:14.121778 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d10750-5620-4faf-a6b4-84cb4cb747a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:11:14.127914 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-e7d10750-5620-4faf-a6b4-84cb4cb747a9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 12:11:14.127914 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:14.127914 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:14.127914 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:14.127914 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:14.127914 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:14.127914 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:14.127914 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:14.127914 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:14.127914 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:14.127914 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:14.127914 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:14.127914 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:11:14.127914 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:11:14.127914 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:11:14.127914 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:11:14.128784 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:11:14.128784 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:11:14.128784 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:11:14.128784 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:11:14.128784 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:14.128784 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:14.128784 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:14.128784 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:14.128784 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:14.128784 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:14.128784 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:14.128784 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:14.128784 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:14.128784 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:14.128784 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:14.128784 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:14.129561 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:14.129561 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:14.129561 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:14.129561 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:14.129561 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:11:14.129561 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:11:14.129561 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:11:14.129561 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:11:14.129561 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:11:14.129561 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:11:14.129561 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 12:11:14.129561 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:11:14.130676 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22238dc4-b9e2-402e-b2f3-7c7294c6f50f None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:14.133838 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 255/498] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Sep 15 12:11:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:14.134488 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d10750-5620-4faf-a6b4-84cb4cb747a9 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:14.166557 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:14.174734 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20b96e0-d50a-4b91-a92e-ed3b60332a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:14.175703 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b96e0-d50a-4b91-a92e-ed3b60332a86 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:14.175990 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b96e0-d50a-4b91-a92e-ed3b60332a86 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:14.176264 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b96e0-d50a-4b91-a92e-ed3b60332a86 None admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:14.177228 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20b96e0-d50a-4b91-a92e-ed3b60332a86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:14.177849 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20b96e0-d50a-4b91-a92e-ed3b60332a86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:14.179438 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20b96e0-d50a-4b91-a92e-ed3b60332a86 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:14.193807 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 244/499] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 15 12:11:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:14.194540 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20b96e0-d50a-4b91-a92e-ed3b60332a86 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:14.230230 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:14.237772 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d10750-5620-4faf-a6b4-84cb4cb747a9 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:14.271203 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099064cb-7425-42a7-bc27-4496552b0a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:14.271806 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099064cb-7425-42a7-bc27-4496552b0a0c None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:14.272086 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099064cb-7425-42a7-bc27-4496552b0a0c None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:14.272357 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099064cb-7425-42a7-bc27-4496552b0a0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:14.305152 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20b96e0-d50a-4b91-a92e-ed3b60332a86 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:14.341328 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f817ca-a2f6-4935-8d24-f35ecd5e9799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:14.342062 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f817ca-a2f6-4935-8d24-f35ecd5e9799 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:14.342405 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f817ca-a2f6-4935-8d24-f35ecd5e9799 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:14.342674 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099064cb-7425-42a7-bc27-4496552b0a0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:14.342829 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f817ca-a2f6-4935-8d24-f35ecd5e9799 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:14.344728 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099064cb-7425-42a7-bc27-4496552b0a0c None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:14.355252 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f817ca-a2f6-4935-8d24-f35ecd5e9799 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:11:14.361480 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-e6f817ca-a2f6-4935-8d24-f35ecd5e9799 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 12:11:14.361480 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:14.361480 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:14.361480 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:14.361480 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:14.361480 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:14.361480 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:14.361480 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:14.361480 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:14.361480 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:14.361480 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:14.361480 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:14.361480 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:11:14.361480 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:11:14.361480 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:11:14.361480 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:11:14.362504 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:11:14.362504 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:11:14.362504 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:11:14.362504 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:11:14.362504 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:14.362504 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:14.362504 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:14.362504 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:14.362504 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:14.362504 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:14.362504 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:14.362504 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:14.362504 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:14.362504 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:14.362504 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:14.362504 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:14.363497 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:14.363497 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:14.363497 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:14.363497 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:14.363497 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:11:14.363497 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:11:14.363497 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:11:14.363497 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:11:14.363497 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:11:14.363497 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:11:14.363497 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 12:11:14.363497 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:14.363497 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 245/500] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Sep 15 12:11:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:14.364272 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f817ca-a2f6-4935-8d24-f35ecd5e9799 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:14.418388 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:14.458894 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:14.467376 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 256/501] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 15 12:11:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 12:11:14.468173 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099064cb-7425-42a7-bc27-4496552b0a0c None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:14.469233 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f817ca-a2f6-4935-8d24-f35ecd5e9799 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:14.502376 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7393cc-6ec0-4086-b9d1-d322c9be1759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:14.502995 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7393cc-6ec0-4086-b9d1-d322c9be1759 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:14.503269 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7393cc-6ec0-4086-b9d1-d322c9be1759 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:14.503543 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7393cc-6ec0-4086-b9d1-d322c9be1759 None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:14.504191 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7393cc-6ec0-4086-b9d1-d322c9be1759 None admin] RBAC: Adding query filter params (name=service) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:14.504485 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7393cc-6ec0-4086-b9d1-d322c9be1759 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:14.505854 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7393cc-6ec0-4086-b9d1-d322c9be1759 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:14.513588 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 246/502] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Sep 15 12:11:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:14.514350 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7393cc-6ec0-4086-b9d1-d322c9be1759 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:14.568079 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099064cb-7425-42a7-bc27-4496552b0a0c None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:14.602699 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97512bb2-1c3c-4cd1-adad-2a6a8f457767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:14.603364 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97512bb2-1c3c-4cd1-adad-2a6a8f457767 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:14.603638 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97512bb2-1c3c-4cd1-adad-2a6a8f457767 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:14.603900 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97512bb2-1c3c-4cd1-adad-2a6a8f457767 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:14.610707 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97512bb2-1c3c-4cd1-adad-2a6a8f457767 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:14.612163 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97512bb2-1c3c-4cd1-adad-2a6a8f457767 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:14.616268 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7393cc-6ec0-4086-b9d1-d322c9be1759 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:14.624244 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-97512bb2-1c3c-4cd1-adad-2a6a8f457767 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 15 12:11:14.624244 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:14.624244 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:14.624244 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:14.624244 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:14.624244 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:14.624244 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:14.624244 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:14.624244 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:14.624244 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:14.624244 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:14.624244 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:14.624244 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 12:11:14.624244 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 12:11:14.624244 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 12:11:14.624244 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 12:11:14.625163 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:14.625163 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:14.625163 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 12:11:14.625163 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:11:14.625163 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 12:11:14.625163 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:11:14.625163 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:14.625163 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:14.625163 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:14.625163 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:14.625163 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:14.625163 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:14.625163 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:14.625163 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:14.625163 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:14.625163 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:14.625163 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:14.625163 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:14.626479 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:14.626479 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:14.626479 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 12:11:14.626479 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 12:11:14.626479 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 12:11:14.626479 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 12:11:14.626479 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 12:11:14.626479 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 12:11:14.626479 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 15 12:11:14.626479 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:11:14.626479 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 257/503] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 15 12:11:14 2022] GET /identity/v3/users/glance => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:14.627151 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b860ffe-81ba-4c94-a682-16d5f0076eb6 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:14.627328 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b860ffe-81ba-4c94-a682-16d5f0076eb6 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:14.627602 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b860ffe-81ba-4c94-a682-16d5f0076eb6 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:14.628817 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 258/504] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:11:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:11:14.629498 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b860ffe-81ba-4c94-a682-16d5f0076eb6 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:14.632621 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:14.653978 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3447c768-61d8-4ab4-a73b-47c6e6c58cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:14.654604 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3447c768-61d8-4ab4-a73b-47c6e6c58cbf None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:14.654883 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3447c768-61d8-4ab4-a73b-47c6e6c58cbf None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:14.655136 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3447c768-61d8-4ab4-a73b-47c6e6c58cbf None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:14.655793 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3447c768-61d8-4ab4-a73b-47c6e6c58cbf None admin] RBAC: Adding query filter params (name=service) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:14.656636 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3447c768-61d8-4ab4-a73b-47c6e6c58cbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:14.658005 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3447c768-61d8-4ab4-a73b-47c6e6c58cbf None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:14.666278 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 247/505] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Sep 15 12:11:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:14.667106 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3447c768-61d8-4ab4-a73b-47c6e6c58cbf None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:14.696933 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:14.741769 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b860ffe-81ba-4c94-a682-16d5f0076eb6 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:14.768624 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3447c768-61d8-4ab4-a73b-47c6e6c58cbf None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:14.774578 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6608e35-b6a7-4248-a644-7ce296aee69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:14.775223 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6608e35-b6a7-4248-a644-7ce296aee69a None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:14.775499 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6608e35-b6a7-4248-a644-7ce296aee69a None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:14.775764 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6608e35-b6a7-4248-a644-7ce296aee69a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:14.786368 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6608e35-b6a7-4248-a644-7ce296aee69a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:14.787835 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6608e35-b6a7-4248-a644-7ce296aee69a None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:14.801327 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-d6608e35-b6a7-4248-a644-7ce296aee69a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:14.801327 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:14.801327 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:14.801327 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:14.801327 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:14.801327 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:14.801327 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:14.801327 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:14.801327 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:14.801327 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:14.801327 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:14.801327 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:14.801327 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:11:14.801327 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:11:14.801327 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:11:14.801327 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:11:14.802383 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:14.802383 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:14.802383 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:14.802383 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:14.802383 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:14.802383 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:14.802383 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:14.802383 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:14.802383 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:14.802383 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:14.802383 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:14.802383 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:14.802383 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:14.802383 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:14.802383 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:14.802383 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:14.802383 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:11:14.803234 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:11:14.803234 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:14.803234 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:11:14.803415 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5544a492-9c38-4f25-a62c-560797f579ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:14.803415 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5544a492-9c38-4f25-a62c-560797f579ab None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:14.803415 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5544a492-9c38-4f25-a62c-560797f579ab None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:14.803600 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 259/506] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:11:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:14.803663 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5544a492-9c38-4f25-a62c-560797f579ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:14.803736 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6608e35-b6a7-4248-a644-7ce296aee69a None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:14.817334 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5544a492-9c38-4f25-a62c-560797f579ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:14.818825 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5544a492-9c38-4f25-a62c-560797f579ab None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:14.833458 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-5544a492-9c38-4f25-a62c-560797f579ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:14.833458 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:14.833458 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:14.833458 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:14.833458 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:14.833458 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:14.833458 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:14.833458 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:14.833458 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:14.833458 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:14.833458 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:14.833458 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:14.833458 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:11:14.833458 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:11:14.833458 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:11:14.833458 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:11:14.834350 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:14.834350 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:14.834350 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:14.834350 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:14.834350 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:14.834350 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:14.834350 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:14.834350 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:14.834350 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:14.834350 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:14.834350 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:14.834350 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:14.834350 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:14.834350 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:14.834350 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:14.834350 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:14.834350 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:11:14.835213 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:11:14.835213 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:14.835213 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:14.835213 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 248/507] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:11:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:14.835941 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b6a7f-e9e5-422f-9090-efad718c7cd2 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:14.836219 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b6a7f-e9e5-422f-9090-efad718c7cd2 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:14.836486 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b6a7f-e9e5-422f-9090-efad718c7cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:14.853992 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-518b6a7f-e9e5-422f-9090-efad718c7cd2 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:11:14.855209 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-518b6a7f-e9e5-422f-9090-efad718c7cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:11:14.877251 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:14.909142 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6608e35-b6a7-4248-a644-7ce296aee69a None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:14.915855 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:14.922541 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 249/508] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:11:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:11:14.923385 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518b6a7f-e9e5-422f-9090-efad718c7cd2 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:14.959154 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355c8da5-be1d-4cfa-a2e8-f114e0fba34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:14.959762 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355c8da5-be1d-4cfa-a2e8-f114e0fba34b None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:14.960048 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355c8da5-be1d-4cfa-a2e8-f114e0fba34b None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:14.960319 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355c8da5-be1d-4cfa-a2e8-f114e0fba34b None admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:14.961059 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355c8da5-be1d-4cfa-a2e8-f114e0fba34b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:14.961373 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355c8da5-be1d-4cfa-a2e8-f114e0fba34b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:14.962818 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355c8da5-be1d-4cfa-a2e8-f114e0fba34b None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:15.011321 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 260/509] 10.222.0.16 () {56 vars in 1137 bytes} [Thu Sep 15 12:11:14 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:15.011321 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355c8da5-be1d-4cfa-a2e8-f114e0fba34b None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:15.040226 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518b6a7f-e9e5-422f-9090-efad718c7cd2 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:15.078273 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619c2a52-ec5c-4992-8bd3-f9173d448247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:15.078928 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c2a52-ec5c-4992-8bd3-f9173d448247 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:15.079207 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c2a52-ec5c-4992-8bd3-f9173d448247 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:15.079478 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c2a52-ec5c-4992-8bd3-f9173d448247 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:15.091190 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619c2a52-ec5c-4992-8bd3-f9173d448247 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:15.092679 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619c2a52-ec5c-4992-8bd3-f9173d448247 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:15.107514 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-619c2a52-ec5c-4992-8bd3-f9173d448247 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:15.107514 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:15.107514 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:15.107514 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:15.107514 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:15.107514 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:15.107514 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:15.107514 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:15.107514 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:15.107514 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:15.107514 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:15.107514 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:15.107514 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:11:15.107514 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:11:15.107514 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:11:15.107514 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:11:15.108585 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:15.108585 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:15.108585 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:15.108585 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:15.108585 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:15.108585 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:15.108585 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:15.108585 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:15.108585 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:15.108585 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:15.108585 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:15.108585 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:15.108585 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:15.108585 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:15.108585 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:15.108585 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:15.108585 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:11:15.110063 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:11:15.110063 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:15.110063 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:15.110063 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 250/510] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:11:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:15.110377 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619c2a52-ec5c-4992-8bd3-f9173d448247 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:15.119741 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355c8da5-be1d-4cfa-a2e8-f114e0fba34b None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:15.122317 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:15.163811 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c382f3e8-91b9-44c3-be7f-8234597c8416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:15.164510 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c382f3e8-91b9-44c3-be7f-8234597c8416 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:15.164787 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c382f3e8-91b9-44c3-be7f-8234597c8416 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:15.165054 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c382f3e8-91b9-44c3-be7f-8234597c8416 None admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:15.165688 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c382f3e8-91b9-44c3-be7f-8234597c8416 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:15.165985 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c382f3e8-91b9-44c3-be7f-8234597c8416 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:15.167382 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c382f3e8-91b9-44c3-be7f-8234597c8416 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:15.179026 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 261/511] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 15 12:11:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:15.179804 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c382f3e8-91b9-44c3-be7f-8234597c8416 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:15.206174 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:15.220605 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619c2a52-ec5c-4992-8bd3-f9173d448247 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:15.254780 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cfd617-8ae2-45f5-9f01-3106c6dda8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:15.255383 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cfd617-8ae2-45f5-9f01-3106c6dda8d0 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:15.255671 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cfd617-8ae2-45f5-9f01-3106c6dda8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:15.255937 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cfd617-8ae2-45f5-9f01-3106c6dda8d0 None admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:15.256581 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cfd617-8ae2-45f5-9f01-3106c6dda8d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:15.256885 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cfd617-8ae2-45f5-9f01-3106c6dda8d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:15.258274 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cfd617-8ae2-45f5-9f01-3106c6dda8d0 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:15.270356 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 251/512] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 15 12:11:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:15.271014 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cfd617-8ae2-45f5-9f01-3106c6dda8d0 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:15.284298 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c382f3e8-91b9-44c3-be7f-8234597c8416 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:15.317399 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a744c1b7-2a39-474f-a12b-e87104626f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:15.318005 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a744c1b7-2a39-474f-a12b-e87104626f66 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:15.318289 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a744c1b7-2a39-474f-a12b-e87104626f66 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:15.318558 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a744c1b7-2a39-474f-a12b-e87104626f66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:15.335774 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:15.372808 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cfd617-8ae2-45f5-9f01-3106c6dda8d0 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:15.391343 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a744c1b7-2a39-474f-a12b-e87104626f66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:15.392786 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a744c1b7-2a39-474f-a12b-e87104626f66 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:15.406572 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ecec89-3cba-4fd2-b9b8-8db41436cf9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:15.407200 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ecec89-3cba-4fd2-b9b8-8db41436cf9a None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:15.407481 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ecec89-3cba-4fd2-b9b8-8db41436cf9a None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:15.407744 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ecec89-3cba-4fd2-b9b8-8db41436cf9a None admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:15.408375 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ecec89-3cba-4fd2-b9b8-8db41436cf9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:15.408673 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ecec89-3cba-4fd2-b9b8-8db41436cf9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:15.410040 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ecec89-3cba-4fd2-b9b8-8db41436cf9a None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:15.416403 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:15.421093 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 252/513] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 15 12:11:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:15.421931 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ecec89-3cba-4fd2-b9b8-8db41436cf9a None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:15.492794 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 262/514] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 15 12:11:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 12:11:15.493785 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a744c1b7-2a39-474f-a12b-e87104626f66 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:15.522079 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ecec89-3cba-4fd2-b9b8-8db41436cf9a None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:15.547894 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:15.556010 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879207e9-3d0e-403e-b9d2-42fe6110774a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:15.556632 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879207e9-3d0e-403e-b9d2-42fe6110774a None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:15.556911 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879207e9-3d0e-403e-b9d2-42fe6110774a None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:15.557179 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879207e9-3d0e-403e-b9d2-42fe6110774a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:15.563740 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879207e9-3d0e-403e-b9d2-42fe6110774a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:15.565187 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879207e9-3d0e-403e-b9d2-42fe6110774a None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:15.577547 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-879207e9-3d0e-403e-b9d2-42fe6110774a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:11:15.577547 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:15.577547 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:15.577547 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:15.577547 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:15.577547 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:15.577547 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:15.577547 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:15.577547 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:15.577547 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:15.577547 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:15.577547 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:15.577547 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 12:11:15.577547 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 12:11:15.577547 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 12:11:15.579063 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 12:11:15.579063 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:15.579063 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:15.579063 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:15.579063 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:15.579063 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:15.579063 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:15.579063 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:15.579063 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:15.579063 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:15.579063 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:15.579063 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:15.579063 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:15.579063 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:15.579063 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:15.579063 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:15.579063 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:15.584663 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 12:11:15.584663 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 12:11:15.584663 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 12:11:15.584663 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 12:11:15.584663 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 12:11:15.584663 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 12:11:15.584663 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:11:15.584663 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:15.584663 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 253/515] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 15 12:11:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:15.584663 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879207e9-3d0e-403e-b9d2-42fe6110774a None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:15.591318 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a744c1b7-2a39-474f-a12b-e87104626f66 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:15.632964 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:15.637340 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d004b359-9971-49e4-bf82-a54668892b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:15.637981 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d004b359-9971-49e4-bf82-a54668892b41 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:15.638406 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d004b359-9971-49e4-bf82-a54668892b41 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:15.638957 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d004b359-9971-49e4-bf82-a54668892b41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:15.649420 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d004b359-9971-49e4-bf82-a54668892b41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:15.650905 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d004b359-9971-49e4-bf82-a54668892b41 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:15.665614 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-d004b359-9971-49e4-bf82-a54668892b41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:15.665614 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:15.665614 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:15.665614 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:15.665614 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:15.665614 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:15.665614 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:15.665614 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:15.665614 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:15.665614 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:15.665614 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:15.665614 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:15.665614 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:11:15.665614 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:11:15.665614 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:11:15.665614 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:11:15.666662 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:15.666662 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:15.666662 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:15.666662 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:15.666662 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:15.666662 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:15.666662 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:15.666662 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:15.666662 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:15.666662 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:15.666662 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:15.666662 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:15.666662 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:15.666662 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:15.666662 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:15.666662 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:15.666662 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:11:15.667546 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:11:15.667546 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:15.667546 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:11:15.667546 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 263/516] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:11:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:15.667796 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d004b359-9971-49e4-bf82-a54668892b41 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:15.690683 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879207e9-3d0e-403e-b9d2-42fe6110774a None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:15.732044 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f99ad61-ea2b-4f07-a22d-0f078bb0ed3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:15.732680 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f99ad61-ea2b-4f07-a22d-0f078bb0ed3d None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:15.732958 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f99ad61-ea2b-4f07-a22d-0f078bb0ed3d None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:15.733239 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f99ad61-ea2b-4f07-a22d-0f078bb0ed3d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:15.740896 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f99ad61-ea2b-4f07-a22d-0f078bb0ed3d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:15.742351 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f99ad61-ea2b-4f07-a22d-0f078bb0ed3d None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:15.758831 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-3f99ad61-ea2b-4f07-a22d-0f078bb0ed3d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 15 12:11:15.758831 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:15.758831 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:15.758831 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:15.758831 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:15.758831 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:15.758831 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:15.758831 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:15.758831 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:15.758831 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:15.758831 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:15.758831 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:15.758831 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 12:11:15.758831 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 12:11:15.758831 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 12:11:15.758831 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 12:11:15.759873 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:15.759873 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:15.759873 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 12:11:15.759873 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:11:15.759873 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 12:11:15.759873 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:11:15.759873 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:15.759873 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:15.759873 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:15.759873 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:15.759873 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:15.759873 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:15.759873 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:15.759873 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:15.759873 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:15.759873 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:15.759873 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:15.759873 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:15.760757 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:15.760757 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:15.760757 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 12:11:15.760757 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 12:11:15.760757 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 12:11:15.760757 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 12:11:15.760757 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 12:11:15.760757 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 12:11:15.760757 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 15 12:11:15.760757 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:15.760757 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 254/517] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Sep 15 12:11:15 2022] GET /identity/v3/users/neutron => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:15.762477 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f99ad61-ea2b-4f07-a22d-0f078bb0ed3d None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:15.771495 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d004b359-9971-49e4-bf82-a54668892b41 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:15.803981 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50466fb8-8ec9-44fc-a5c7-25931dc4b972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:15.804531 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50466fb8-8ec9-44fc-a5c7-25931dc4b972 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:15.804813 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50466fb8-8ec9-44fc-a5c7-25931dc4b972 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:15.805083 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50466fb8-8ec9-44fc-a5c7-25931dc4b972 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:15.810127 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:15.813027 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50466fb8-8ec9-44fc-a5c7-25931dc4b972 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:15.814492 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50466fb8-8ec9-44fc-a5c7-25931dc4b972 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:15.825561 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-50466fb8-8ec9-44fc-a5c7-25931dc4b972 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 15 12:11:15.825561 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:15.825561 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:15.825561 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:15.825561 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:15.825561 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:15.825561 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:15.825561 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:15.825561 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:15.825561 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:15.825561 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:15.825561 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:15.825561 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 12:11:15.825561 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 12:11:15.825561 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 12:11:15.825561 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 12:11:15.826454 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:15.826454 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:15.826454 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 12:11:15.826454 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:11:15.826454 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 12:11:15.826454 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:11:15.826454 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:15.826454 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:15.826454 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:15.826454 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:15.826454 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:15.826454 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:15.826454 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:15.826454 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:15.826454 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:15.826454 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:15.826454 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:15.826454 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:15.827432 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:15.827432 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:15.827432 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 12:11:15.827432 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 12:11:15.827432 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 12:11:15.827432 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 12:11:15.827432 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 12:11:15.827432 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 12:11:15.827432 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 15 12:11:15.827432 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:11:15.827432 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 264/518] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 15 12:11:15 2022] GET /identity/v3/users/cinder => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:15.827432 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50466fb8-8ec9-44fc-a5c7-25931dc4b972 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:15.861876 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f99ad61-ea2b-4f07-a22d-0f078bb0ed3d None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:15.862040 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:15.895816 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd1ac43-972b-4bf4-a32e-c7735a314214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:15.896679 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1ac43-972b-4bf4-a32e-c7735a314214 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:15.896957 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1ac43-972b-4bf4-a32e-c7735a314214 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:15.897233 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1ac43-972b-4bf4-a32e-c7735a314214 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:15.907487 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd1ac43-972b-4bf4-a32e-c7735a314214 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:15.908933 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd1ac43-972b-4bf4-a32e-c7735a314214 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:15.922859 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-2cd1ac43-972b-4bf4-a32e-c7735a314214 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:15.922859 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:15.922859 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:15.922859 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:15.922859 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:15.922859 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:15.922859 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:15.922859 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:15.922859 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:15.922859 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:15.922859 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:15.922859 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:15.922859 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:11:15.922859 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:11:15.922859 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:11:15.922859 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:11:15.923789 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:15.923789 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:15.923789 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:15.923789 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:15.923789 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:15.923789 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:15.923789 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:15.923789 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:15.923789 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:15.923789 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:15.923789 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:15.923789 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:15.923789 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:15.923789 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:15.923789 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:15.923789 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:15.923789 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:11:15.924627 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:11:15.924627 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:15.924627 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:15.924627 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 255/519] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:11:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:15.925221 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd1ac43-972b-4bf4-a32e-c7735a314214 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:15.925418 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50466fb8-8ec9-44fc-a5c7-25931dc4b972 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:15.958935 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ec84fe-ae39-4505-94f2-59ab01871ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:15.959535 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec84fe-ae39-4505-94f2-59ab01871ed3 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:15.959814 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec84fe-ae39-4505-94f2-59ab01871ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:15.960084 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec84fe-ae39-4505-94f2-59ab01871ed3 None admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:15.960765 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ec84fe-ae39-4505-94f2-59ab01871ed3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:15.961068 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ec84fe-ae39-4505-94f2-59ab01871ed3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:15.962471 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ec84fe-ae39-4505-94f2-59ab01871ed3 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:15.979687 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 265/520] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Sep 15 12:11:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:15.980515 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ec84fe-ae39-4505-94f2-59ab01871ed3 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:16.025636 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:16.028986 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd1ac43-972b-4bf4-a32e-c7735a314214 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:16.066408 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c08050-433b-4f30-a8d4-727a141ebb89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:16.066945 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c08050-433b-4f30-a8d4-727a141ebb89 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:16.067227 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c08050-433b-4f30-a8d4-727a141ebb89 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:16.067499 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c08050-433b-4f30-a8d4-727a141ebb89 None admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:16.068140 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c08050-433b-4f30-a8d4-727a141ebb89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:16.068443 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c08050-433b-4f30-a8d4-727a141ebb89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:16.069827 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c08050-433b-4f30-a8d4-727a141ebb89 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:16.084522 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:16.089634 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 256/521] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 15 12:11:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:16.089634 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c08050-433b-4f30-a8d4-727a141ebb89 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:16.091086 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ec84fe-ae39-4505-94f2-59ab01871ed3 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:16.125486 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2a9b1d-c039-49e5-9f58-89f6af145dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:16.126343 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2a9b1d-c039-49e5-9f58-89f6af145dc3 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:16.126618 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2a9b1d-c039-49e5-9f58-89f6af145dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:16.126919 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2a9b1d-c039-49e5-9f58-89f6af145dc3 None admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:16.127631 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2a9b1d-c039-49e5-9f58-89f6af145dc3 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:16.127930 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2a9b1d-c039-49e5-9f58-89f6af145dc3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:16.129385 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2a9b1d-c039-49e5-9f58-89f6af145dc3 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:16.145861 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 266/522] 10.222.0.16 () {56 vars in 1139 bytes} [Thu Sep 15 12:11:15 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:16.146647 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2a9b1d-c039-49e5-9f58-89f6af145dc3 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:16.190237 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c08050-433b-4f30-a8d4-727a141ebb89 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:16.223197 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09907f06-bd1c-40ed-97a9-cadd0ed7bb53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:16.223791 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09907f06-bd1c-40ed-97a9-cadd0ed7bb53 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:16.224066 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09907f06-bd1c-40ed-97a9-cadd0ed7bb53 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:16.224339 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09907f06-bd1c-40ed-97a9-cadd0ed7bb53 None admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:16.225056 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09907f06-bd1c-40ed-97a9-cadd0ed7bb53 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:16.225353 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09907f06-bd1c-40ed-97a9-cadd0ed7bb53 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:16.226823 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09907f06-bd1c-40ed-97a9-cadd0ed7bb53 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:16.242336 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2a9b1d-c039-49e5-9f58-89f6af145dc3 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:16.244295 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 257/523] 10.222.0.16 () {56 vars in 1137 bytes} [Thu Sep 15 12:11:16 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:16.245066 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09907f06-bd1c-40ed-97a9-cadd0ed7bb53 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:16.265605 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:16.282015 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7667652-ed84-47b8-9774-d971521bed78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:16.282608 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7667652-ed84-47b8-9774-d971521bed78 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:16.282908 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7667652-ed84-47b8-9774-d971521bed78 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:16.283173 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7667652-ed84-47b8-9774-d971521bed78 None admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:16.283801 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7667652-ed84-47b8-9774-d971521bed78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:16.284102 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7667652-ed84-47b8-9774-d971521bed78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:16.285439 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7667652-ed84-47b8-9774-d971521bed78 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:16.296292 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 267/524] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 15 12:11:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:16.297529 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7667652-ed84-47b8-9774-d971521bed78 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:16.314678 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:16.346438 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09907f06-bd1c-40ed-97a9-cadd0ed7bb53 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:16.382648 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e61584-831f-4e16-b31c-faf4fec8f729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:16.383272 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e61584-831f-4e16-b31c-faf4fec8f729 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:16.383545 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e61584-831f-4e16-b31c-faf4fec8f729 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:16.383811 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e61584-831f-4e16-b31c-faf4fec8f729 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:16.384535 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e61584-831f-4e16-b31c-faf4fec8f729 None admin] RBAC: Adding query filter params (role.id=9c9f10110e12479bb6b3b630dd6412b8, scope.project.id=cab958c081ad4a92939d4469cf4ce1c6, user.id=9d05c52570474820b4ba0e2cdad5c13f) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:16.384837 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e61584-831f-4e16-b31c-faf4fec8f729 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:16.386261 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e61584-831f-4e16-b31c-faf4fec8f729 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:16.391731 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 258/525] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 15 12:11:16 2022] GET /identity/v3/role_assignments?user.id=9d05c52570474820b4ba0e2cdad5c13f&scope.project.id=cab958c081ad4a92939d4469cf4ce1c6&role.id=9c9f10110e12479bb6b3b630dd6412b8 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:16.392269 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e61584-831f-4e16-b31c-faf4fec8f729 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:16.400517 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7667652-ed84-47b8-9774-d971521bed78 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:16.439630 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7665c165-5065-49e4-87ff-d16f216f726d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:16.440246 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7665c165-5065-49e4-87ff-d16f216f726d None admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:16.440526 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7665c165-5065-49e4-87ff-d16f216f726d None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:16.440799 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7665c165-5065-49e4-87ff-d16f216f726d None admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:16.441462 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7665c165-5065-49e4-87ff-d16f216f726d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:16.442966 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7665c165-5065-49e4-87ff-d16f216f726d None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:16.469388 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 268/526] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Sep 15 12:11:16 2022] POST /identity/v3/users => generated 247 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:11:16.470484 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7665c165-5065-49e4-87ff-d16f216f726d None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:16.507213 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:16.551150 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e61584-831f-4e16-b31c-faf4fec8f729 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:16.569834 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:16.603380 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56866f5-ef8e-4b1e-b2b8-641e44f3db12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:16.604047 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56866f5-ef8e-4b1e-b2b8-641e44f3db12 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:16.604562 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56866f5-ef8e-4b1e-b2b8-641e44f3db12 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:16.604983 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56866f5-ef8e-4b1e-b2b8-641e44f3db12 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:16.621015 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7665c165-5065-49e4-87ff-d16f216f726d None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:16.666393 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1813ef-e03a-4ab9-8035-4365584598d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:16.667280 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1813ef-e03a-4ab9-8035-4365584598d5 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:16.667720 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1813ef-e03a-4ab9-8035-4365584598d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:16.668187 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1813ef-e03a-4ab9-8035-4365584598d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:16.709444 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56866f5-ef8e-4b1e-b2b8-641e44f3db12 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:16.711600 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56866f5-ef8e-4b1e-b2b8-641e44f3db12 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:16.748018 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1813ef-e03a-4ab9-8035-4365584598d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:16.749828 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1813ef-e03a-4ab9-8035-4365584598d5 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:16.808029 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:16.827621 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:16.829545 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 259/527] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 15 12:11:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 12:11:16.830381 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56866f5-ef8e-4b1e-b2b8-641e44f3db12 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:16.866865 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 269/528] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 15 12:11:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 12:11:16.867689 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1813ef-e03a-4ab9-8035-4365584598d5 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:16.963330 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56866f5-ef8e-4b1e-b2b8-641e44f3db12 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:16.991561 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1813ef-e03a-4ab9-8035-4365584598d5 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:17.008503 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2098dd2e-e9c5-44b0-80ca-194b3e9086cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:17.009281 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2098dd2e-e9c5-44b0-80ca-194b3e9086cf None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:17.009566 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2098dd2e-e9c5-44b0-80ca-194b3e9086cf None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:17.010218 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2098dd2e-e9c5-44b0-80ca-194b3e9086cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:17.019356 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2098dd2e-e9c5-44b0-80ca-194b3e9086cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:17.021403 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2098dd2e-e9c5-44b0-80ca-194b3e9086cf None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:17.032199 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e41da9b-e2d5-4ff3-9d7c-b3e1093257eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:17.032969 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41da9b-e2d5-4ff3-9d7c-b3e1093257eb None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:17.033354 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41da9b-e2d5-4ff3-9d7c-b3e1093257eb None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:17.033763 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41da9b-e2d5-4ff3-9d7c-b3e1093257eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:17.034821 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-2098dd2e-e9c5-44b0-80ca-194b3e9086cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:11:17.034821 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:17.034821 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:17.034821 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:17.034821 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:17.034821 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:17.034821 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:17.034821 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:17.034821 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:17.034821 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:17.034821 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:17.034821 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:17.034821 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 12:11:17.034821 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 12:11:17.034821 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 12:11:17.036484 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 12:11:17.036484 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:17.036484 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:17.036484 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:17.036484 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:17.036484 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:17.036484 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:17.036484 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:17.036484 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:17.036484 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:17.036484 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:17.036484 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:17.036484 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:17.036484 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:17.036484 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:17.036484 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:17.036484 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:17.037499 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 12:11:17.037499 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 12:11:17.037499 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 12:11:17.037499 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 12:11:17.037499 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 12:11:17.037499 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 12:11:17.037499 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:11:17.037499 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:17.042711 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 260/529] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 15 12:11:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:17.042711 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2098dd2e-e9c5-44b0-80ca-194b3e9086cf None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:17.049946 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e41da9b-e2d5-4ff3-9d7c-b3e1093257eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:17.051549 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e41da9b-e2d5-4ff3-9d7c-b3e1093257eb None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:17.070620 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-2e41da9b-e2d5-4ff3-9d7c-b3e1093257eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:17.070620 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:17.070620 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:17.070620 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:17.070620 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:17.070620 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:17.070620 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:17.070620 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:17.070620 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:17.070620 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:17.070620 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:17.070620 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:17.070620 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:11:17.070620 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:11:17.070620 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:11:17.070620 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:11:17.071747 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:17.071747 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:17.071747 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:17.071747 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:17.071747 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:17.071747 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:17.071747 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:17.071747 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:17.071747 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:17.071747 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:17.071747 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:17.071747 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:17.071747 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:17.071747 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:17.071747 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:17.071747 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:17.071747 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:11:17.073128 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:11:17.073128 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:17.073128 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:11:17.078430 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 270/530] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:11:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:17.078430 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e41da9b-e2d5-4ff3-9d7c-b3e1093257eb None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:17.098960 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:17.113384 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:17.166371 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2098dd2e-e9c5-44b0-80ca-194b3e9086cf None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:17.203948 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7787973-1b9d-466c-82f3-1f9cab98dc54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:17.204744 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7787973-1b9d-466c-82f3-1f9cab98dc54 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:17.205241 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7787973-1b9d-466c-82f3-1f9cab98dc54 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:17.205632 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7787973-1b9d-466c-82f3-1f9cab98dc54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:17.216933 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7787973-1b9d-466c-82f3-1f9cab98dc54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:17.219297 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7787973-1b9d-466c-82f3-1f9cab98dc54 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:17.220854 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e41da9b-e2d5-4ff3-9d7c-b3e1093257eb None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:17.239588 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-c7787973-1b9d-466c-82f3-1f9cab98dc54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:17.239588 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:17.239588 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:17.239588 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:17.239588 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:17.239588 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:17.239588 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:17.239588 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:17.239588 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:17.239588 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:17.239588 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:17.239588 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:17.239588 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:11:17.239588 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:11:17.239588 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:11:17.239588 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:11:17.240529 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:17.240529 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:17.240529 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:17.240529 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:17.240529 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:17.240529 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:17.240529 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:17.240529 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:17.240529 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:17.240529 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:17.240529 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:17.240529 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:17.240529 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:17.240529 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:17.240529 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:17.240529 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:17.240529 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:11:17.241365 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:11:17.241365 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:17.241365 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:17.243558 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 261/531] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:11:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:17.244632 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7787973-1b9d-466c-82f3-1f9cab98dc54 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:17.259630 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b70f14-9143-45e1-99b3-824f7866a202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:17.260239 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b70f14-9143-45e1-99b3-824f7866a202 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:17.260524 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b70f14-9143-45e1-99b3-824f7866a202 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:17.261175 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b70f14-9143-45e1-99b3-824f7866a202 None admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:17.261781 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b70f14-9143-45e1-99b3-824f7866a202 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:17.262094 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b70f14-9143-45e1-99b3-824f7866a202 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:17.263690 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b70f14-9143-45e1-99b3-824f7866a202 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:17.277511 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 271/532] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Sep 15 12:11:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:17.278364 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b70f14-9143-45e1-99b3-824f7866a202 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:17.374585 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:17.377680 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:17.385451 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7787973-1b9d-466c-82f3-1f9cab98dc54 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:17.397840 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b70f14-9143-45e1-99b3-824f7866a202 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:17.430757 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935b7c19-6c48-47b3-9ad3-175ab8662250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:17.431862 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b7c19-6c48-47b3-9ad3-175ab8662250 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:17.432667 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b7c19-6c48-47b3-9ad3-175ab8662250 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:17.433352 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b7c19-6c48-47b3-9ad3-175ab8662250 None admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:17.434138 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935b7c19-6c48-47b3-9ad3-175ab8662250 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:17.434603 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935b7c19-6c48-47b3-9ad3-175ab8662250 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:17.436182 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935b7c19-6c48-47b3-9ad3-175ab8662250 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:17.437336 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca646fb-7521-4159-ad21-31f802cc07c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:17.438004 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca646fb-7521-4159-ad21-31f802cc07c3 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:17.438353 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca646fb-7521-4159-ad21-31f802cc07c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:17.438722 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca646fb-7521-4159-ad21-31f802cc07c3 None admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:17.439451 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca646fb-7521-4159-ad21-31f802cc07c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:17.439825 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca646fb-7521-4159-ad21-31f802cc07c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:17.441252 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca646fb-7521-4159-ad21-31f802cc07c3 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:17.450202 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 262/533] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 15 12:11:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:17.451134 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935b7c19-6c48-47b3-9ad3-175ab8662250 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:17.461423 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 272/534] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 15 12:11:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:17.462569 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca646fb-7521-4159-ad21-31f802cc07c3 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:17.554665 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935b7c19-6c48-47b3-9ad3-175ab8662250 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:17.575865 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca646fb-7521-4159-ad21-31f802cc07c3 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:17.591269 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48890400-09f3-4109-af10-1ef455a92e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:17.591877 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48890400-09f3-4109-af10-1ef455a92e5b None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:17.592271 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48890400-09f3-4109-af10-1ef455a92e5b None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:17.592508 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48890400-09f3-4109-af10-1ef455a92e5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:17.593338 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48890400-09f3-4109-af10-1ef455a92e5b None admin] RBAC: Adding query filter params (role.id=9c9f10110e12479bb6b3b630dd6412b8, scope.project.id=cab958c081ad4a92939d4469cf4ce1c6, user.id=d057b651769b4ae99c1d4f2b0fc31fb4) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:17.594211 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48890400-09f3-4109-af10-1ef455a92e5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:17.595931 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48890400-09f3-4109-af10-1ef455a92e5b None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:17.610723 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 263/535] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 15 12:11:17 2022] GET /identity/v3/role_assignments?user.id=d057b651769b4ae99c1d4f2b0fc31fb4&scope.project.id=cab958c081ad4a92939d4469cf4ce1c6&role.id=9c9f10110e12479bb6b3b630dd6412b8 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:17.610723 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48890400-09f3-4109-af10-1ef455a92e5b None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:17.631816 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:17.643541 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4f16e8-3a02-4101-ab58-780278428a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:17.644504 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4f16e8-3a02-4101-ab58-780278428a21 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:17.644960 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4f16e8-3a02-4101-ab58-780278428a21 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:17.645403 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4f16e8-3a02-4101-ab58-780278428a21 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:17.659883 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4f16e8-3a02-4101-ab58-780278428a21 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:17.661654 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4f16e8-3a02-4101-ab58-780278428a21 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:17.684858 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-ac4f16e8-3a02-4101-ab58-780278428a21 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:11:17.684858 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:17.684858 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:17.684858 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:17.684858 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:17.684858 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:17.684858 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:17.684858 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:17.684858 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:17.684858 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:17.684858 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:17.684858 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:17.684858 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 12:11:17.684858 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 12:11:17.684858 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 12:11:17.685945 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 12:11:17.685945 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:17.685945 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:17.685945 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:17.685945 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:17.685945 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:17.685945 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:17.685945 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:17.685945 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:17.685945 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:17.685945 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:17.685945 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:17.685945 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:17.685945 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:17.685945 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:17.685945 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:17.685945 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:17.686910 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 12:11:17.686910 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 12:11:17.686910 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 12:11:17.686910 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 12:11:17.686910 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 12:11:17.686910 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 12:11:17.686910 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:11:17.686910 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:11:17.695921 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 273/536] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 15 12:11:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:17.716144 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4f16e8-3a02-4101-ab58-780278428a21 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:17.725752 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:17.746500 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48890400-09f3-4109-af10-1ef455a92e5b None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:17.813351 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dccb3d7-5e34-4c68-bd19-f7a4f7673392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:17.814421 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dccb3d7-5e34-4c68-bd19-f7a4f7673392 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:17.814937 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dccb3d7-5e34-4c68-bd19-f7a4f7673392 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:17.815355 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dccb3d7-5e34-4c68-bd19-f7a4f7673392 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:17.823468 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dccb3d7-5e34-4c68-bd19-f7a4f7673392 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:17.825286 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dccb3d7-5e34-4c68-bd19-f7a4f7673392 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:17.838982 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-6dccb3d7-5e34-4c68-bd19-f7a4f7673392 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:11:17.838982 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:17.838982 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:17.838982 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:17.838982 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:17.838982 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:17.838982 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:17.838982 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:17.838982 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:17.838982 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:17.838982 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:17.838982 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:17.838982 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 12:11:17.838982 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 12:11:17.838982 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 12:11:17.839950 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 12:11:17.839950 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:17.839950 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:17.839950 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:17.839950 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:17.839950 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:17.839950 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:17.839950 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:17.839950 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:17.839950 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:17.839950 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:17.839950 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:17.839950 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:17.839950 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:17.839950 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:17.839950 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:17.839950 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:17.840797 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 12:11:17.840797 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 12:11:17.840797 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 12:11:17.840797 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 12:11:17.840797 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 12:11:17.840797 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 12:11:17.840797 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:11:17.840797 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:17.842780 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 264/537] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 15 12:11:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:17.849540 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dccb3d7-5e34-4c68-bd19-f7a4f7673392 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:17.866478 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4f16e8-3a02-4101-ab58-780278428a21 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:17.909009 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f301d2e-c8d5-422b-97bd-f29b0d773fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:17.910333 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f301d2e-c8d5-422b-97bd-f29b0d773fe5 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:17.910994 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f301d2e-c8d5-422b-97bd-f29b0d773fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:17.911350 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f301d2e-c8d5-422b-97bd-f29b0d773fe5 None admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:17.912079 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f301d2e-c8d5-422b-97bd-f29b0d773fe5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:17.912483 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f301d2e-c8d5-422b-97bd-f29b0d773fe5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:17.914776 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f301d2e-c8d5-422b-97bd-f29b0d773fe5 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:17.930495 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 274/538] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Sep 15 12:11:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:17.938303 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f301d2e-c8d5-422b-97bd-f29b0d773fe5 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:17.948600 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:17.998185 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dccb3d7-5e34-4c68-bd19-f7a4f7673392 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:18.017223 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:18.060045 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f301d2e-c8d5-422b-97bd-f29b0d773fe5 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:18.061817 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9cdbbc-afad-481e-a217-18bbf0a0d1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:18.062963 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9cdbbc-afad-481e-a217-18bbf0a0d1c9 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:18.063250 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9cdbbc-afad-481e-a217-18bbf0a0d1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:18.063524 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9cdbbc-afad-481e-a217-18bbf0a0d1c9 None admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:18.071546 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9cdbbc-afad-481e-a217-18bbf0a0d1c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:18.071856 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9cdbbc-afad-481e-a217-18bbf0a0d1c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:18.073452 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9cdbbc-afad-481e-a217-18bbf0a0d1c9 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:18.100073 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046eade1-20f9-4f6e-86ac-d7e5406c6cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:18.101042 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046eade1-20f9-4f6e-86ac-d7e5406c6cd4 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:18.101518 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046eade1-20f9-4f6e-86ac-d7e5406c6cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:18.101986 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046eade1-20f9-4f6e-86ac-d7e5406c6cd4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:18.102937 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046eade1-20f9-4f6e-86ac-d7e5406c6cd4 None admin] RBAC: Adding query filter params (role.id=9c9f10110e12479bb6b3b630dd6412b8, scope.project.id=cab958c081ad4a92939d4469cf4ce1c6, user.id=4003dbcee8104aa4a7ce90251bab88a2) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:18.103458 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046eade1-20f9-4f6e-86ac-d7e5406c6cd4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:18.105388 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046eade1-20f9-4f6e-86ac-d7e5406c6cd4 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:18.110801 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 265/539] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Sep 15 12:11:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:18.116893 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 275/540] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 15 12:11:17 2022] GET /identity/v3/role_assignments?user.id=4003dbcee8104aa4a7ce90251bab88a2&scope.project.id=cab958c081ad4a92939d4469cf4ce1c6&role.id=9c9f10110e12479bb6b3b630dd6412b8 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:11:18.117975 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9cdbbc-afad-481e-a217-18bbf0a0d1c9 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:18.278383 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9cdbbc-afad-481e-a217-18bbf0a0d1c9 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:18.320274 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441d4a4c-b08a-48da-ad50-cedd809edc69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:18.320897 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d4a4c-b08a-48da-ad50-cedd809edc69 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:18.321179 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d4a4c-b08a-48da-ad50-cedd809edc69 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:18.321454 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d4a4c-b08a-48da-ad50-cedd809edc69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:18.322193 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441d4a4c-b08a-48da-ad50-cedd809edc69 None admin] RBAC: Adding query filter params (role.id=9c9f10110e12479bb6b3b630dd6412b8, scope.project.id=cab958c081ad4a92939d4469cf4ce1c6, user.id=ceafc5e4283841528053f01931f10293) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:18.322502 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441d4a4c-b08a-48da-ad50-cedd809edc69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:18.323978 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441d4a4c-b08a-48da-ad50-cedd809edc69 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:18.331149 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 266/541] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 15 12:11:18 2022] GET /identity/v3/role_assignments?user.id=ceafc5e4283841528053f01931f10293&scope.project.id=cab958c081ad4a92939d4469cf4ce1c6&role.id=9c9f10110e12479bb6b3b630dd6412b8 => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:18.817535 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0c8652-0fb4-4b07-9388-06f24c28349b None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:18.818062 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0c8652-0fb4-4b07-9388-06f24c28349b None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:18.818062 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0c8652-0fb4-4b07-9388-06f24c28349b None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:18.819957 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 276/542] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:11:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:11:18.825315 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f18e16-686f-4f65-9591-a61673bd63a8 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:18.825798 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f18e16-686f-4f65-9591-a61673bd63a8 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:18.825872 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f18e16-686f-4f65-9591-a61673bd63a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:18.832766 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:18.849236 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-e7f18e16-686f-4f65-9591-a61673bd63a8 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:11:18.850457 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-e7f18e16-686f-4f65-9591-a61673bd63a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:11:18.940096 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 267/543] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:11:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:11:18.988407 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27dbe73-f3a9-4225-a34d-0c3d647d944d None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:18.989014 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27dbe73-f3a9-4225-a34d-0c3d647d944d None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:18.989488 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27dbe73-f3a9-4225-a34d-0c3d647d944d None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:18.991307 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 277/544] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:11:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:11:19.004110 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4369fd2a-d90a-4408-88f6-c2c0859358c4 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:19.004392 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4369fd2a-d90a-4408-88f6-c2c0859358c4 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:19.004667 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4369fd2a-d90a-4408-88f6-c2c0859358c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:19.032572 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-4369fd2a-d90a-4408-88f6-c2c0859358c4 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:11:19.033743 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-4369fd2a-d90a-4408-88f6-c2c0859358c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:11:19.122390 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 268/545] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:11:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:11:19.446000 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27dbe73-f3a9-4225-a34d-0c3d647d944d None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:19.553241 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27dbe73-f3a9-4225-a34d-0c3d647d944d None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:19.580802 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:19.590598 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21610c6-3924-438d-b043-d640e66282a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:19.591530 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21610c6-3924-438d-b043-d640e66282a0 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:19.592161 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21610c6-3924-438d-b043-d640e66282a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:19.592635 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21610c6-3924-438d-b043-d640e66282a0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:19.604322 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21610c6-3924-438d-b043-d640e66282a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:11:19.609648 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-b21610c6-3924-438d-b043-d640e66282a0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 12:11:19.609648 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:19.609648 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:19.609648 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:19.609648 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:19.609648 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:19.609648 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:19.609648 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:19.609648 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:19.609648 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:19.609648 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:19.609648 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:19.609648 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:11:19.609648 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:11:19.609648 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:11:19.609648 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:11:19.610515 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:11:19.610515 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:11:19.610515 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:11:19.610515 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:11:19.610515 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:19.610515 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:19.610515 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:19.610515 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:19.610515 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:19.610515 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:19.610515 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:19.610515 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:19.610515 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:19.610515 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:19.610515 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:19.610515 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:19.611392 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:19.611392 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:19.611392 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:19.611392 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:19.611392 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:11:19.611392 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:11:19.611392 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:11:19.611392 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:11:19.611392 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:11:19.611392 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:11:19.611392 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 12:11:19.611392 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:11:19.614086 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 278/546] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Sep 15 12:11:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:19.623721 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21610c6-3924-438d-b043-d640e66282a0 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:19.623889 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4369fd2a-d90a-4408-88f6-c2c0859358c4 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:19.746108 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21610c6-3924-438d-b043-d640e66282a0 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:19.788681 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796f8a56-4611-4f5f-a172-dc80765085aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:19.791022 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796f8a56-4611-4f5f-a172-dc80765085aa None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:19.791722 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796f8a56-4611-4f5f-a172-dc80765085aa None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:19.792354 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796f8a56-4611-4f5f-a172-dc80765085aa None admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:19.793742 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796f8a56-4611-4f5f-a172-dc80765085aa None admin] RBAC: Adding query filter params (name=service) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:19.794571 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796f8a56-4611-4f5f-a172-dc80765085aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:19.798468 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796f8a56-4611-4f5f-a172-dc80765085aa None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:19.813572 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 279/547] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Sep 15 12:11:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:19.822411 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796f8a56-4611-4f5f-a172-dc80765085aa None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:19.852428 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:19.954715 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4369fd2a-d90a-4408-88f6-c2c0859358c4 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:19.985308 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:20.044732 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424e609c-3650-42d7-b5b6-901969b59e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:20.045286 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e609c-3650-42d7-b5b6-901969b59e41 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:20.045679 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e609c-3650-42d7-b5b6-901969b59e41 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:20.045947 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e609c-3650-42d7-b5b6-901969b59e41 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:20.071901 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424e609c-3650-42d7-b5b6-901969b59e41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:11:20.077992 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-424e609c-3650-42d7-b5b6-901969b59e41 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 12:11:20.077992 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:20.077992 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:20.077992 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:20.077992 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:20.077992 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:20.077992 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:20.077992 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:20.077992 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:20.077992 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:20.077992 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:20.077992 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:20.077992 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:11:20.077992 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:11:20.077992 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:11:20.077992 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:11:20.080314 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:11:20.080314 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:11:20.080314 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:11:20.080314 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:11:20.080314 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:20.080314 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:20.080314 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:20.080314 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:20.080314 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:20.080314 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:20.080314 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:20.080314 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:20.080314 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:20.080314 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:20.080314 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:20.080314 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:20.081122 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:20.081122 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:20.081122 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:20.081122 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:20.081122 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:11:20.081122 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:11:20.081122 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:11:20.081122 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:11:20.081122 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:11:20.081122 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:11:20.081122 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 12:11:20.081122 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:20.081122 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 269/548] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Sep 15 12:11:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 456 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:20.084901 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424e609c-3650-42d7-b5b6-901969b59e41 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:20.100849 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796f8a56-4611-4f5f-a172-dc80765085aa None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:20.146538 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93c5df4-7e02-41dd-8e77-a2577ed8546d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:20.148600 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93c5df4-7e02-41dd-8e77-a2577ed8546d None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:20.148874 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93c5df4-7e02-41dd-8e77-a2577ed8546d None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:20.149143 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93c5df4-7e02-41dd-8e77-a2577ed8546d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:20.172752 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93c5df4-7e02-41dd-8e77-a2577ed8546d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:20.174241 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93c5df4-7e02-41dd-8e77-a2577ed8546d None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:20.201625 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-c93c5df4-7e02-41dd-8e77-a2577ed8546d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:20.201625 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:20.201625 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:20.201625 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:20.201625 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:20.201625 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:20.201625 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:20.201625 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:20.201625 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:20.201625 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:20.201625 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:20.201625 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:20.201625 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:11:20.201625 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:11:20.201625 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:11:20.201625 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:11:20.204559 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:20.204559 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:20.204559 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:20.204559 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:20.204559 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:20.204559 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:20.204559 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:20.204559 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:20.204559 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:20.204559 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:20.204559 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:20.204559 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:20.204559 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:20.204559 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:20.204559 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:20.204559 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:20.204559 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:11:20.207105 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:11:20.207105 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:20.207105 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:11:20.207105 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 280/549] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:11:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 382 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:20.208993 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93c5df4-7e02-41dd-8e77-a2577ed8546d None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:20.305842 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424e609c-3650-42d7-b5b6-901969b59e41 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:20.361645 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:20.372239 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:20.376929 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93c5df4-7e02-41dd-8e77-a2577ed8546d None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:20.385735 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dcb743-a9a4-4ed4-86ef-3d7b3b7d4f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:20.386402 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dcb743-a9a4-4ed4-86ef-3d7b3b7d4f7d None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:20.386636 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dcb743-a9a4-4ed4-86ef-3d7b3b7d4f7d None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:20.386923 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dcb743-a9a4-4ed4-86ef-3d7b3b7d4f7d None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:20.387598 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dcb743-a9a4-4ed4-86ef-3d7b3b7d4f7d None admin] RBAC: Adding query filter params (name=service) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:20.387904 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dcb743-a9a4-4ed4-86ef-3d7b3b7d4f7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:20.389299 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dcb743-a9a4-4ed4-86ef-3d7b3b7d4f7d None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:20.398452 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 270/550] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Sep 15 12:11:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:20.399845 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70147fe5-85d4-4a6a-88b9-c3d2f7071fe7 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:20.400136 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70147fe5-85d4-4a6a-88b9-c3d2f7071fe7 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:20.400410 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70147fe5-85d4-4a6a-88b9-c3d2f7071fe7 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:20.401893 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 271/551] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:11:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:11:20.403403 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70147fe5-85d4-4a6a-88b9-c3d2f7071fe7 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:20.428743 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c93ae94-f1ab-46aa-b3d1-7138445d8b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:20.429331 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c93ae94-f1ab-46aa-b3d1-7138445d8b26 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:20.429779 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c93ae94-f1ab-46aa-b3d1-7138445d8b26 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:20.429891 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c93ae94-f1ab-46aa-b3d1-7138445d8b26 None admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:20.430605 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c93ae94-f1ab-46aa-b3d1-7138445d8b26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:20.430960 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c93ae94-f1ab-46aa-b3d1-7138445d8b26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:20.432464 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c93ae94-f1ab-46aa-b3d1-7138445d8b26 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:20.446297 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 281/552] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 15 12:11:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:20.447637 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec4ca5-7cf7-45bc-9470-08ca8f05d353 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:20.447922 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec4ca5-7cf7-45bc-9470-08ca8f05d353 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:20.448194 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec4ca5-7cf7-45bc-9470-08ca8f05d353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:20.467884 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-b9ec4ca5-7cf7-45bc-9470-08ca8f05d353 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:11:20.469139 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-b9ec4ca5-7cf7-45bc-9470-08ca8f05d353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:11:20.518376 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70147fe5-85d4-4a6a-88b9-c3d2f7071fe7 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:20.545152 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 282/553] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:11:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:11:20.552162 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ec4ca5-7cf7-45bc-9470-08ca8f05d353 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:20.572610 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b51e20-62be-4a70-a053-33ad4f329580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:20.573218 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b51e20-62be-4a70-a053-33ad4f329580 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:20.573498 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b51e20-62be-4a70-a053-33ad4f329580 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:20.573769 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b51e20-62be-4a70-a053-33ad4f329580 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:20.597129 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b51e20-62be-4a70-a053-33ad4f329580 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:20.598662 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b51e20-62be-4a70-a053-33ad4f329580 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:20.629492 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-f1b51e20-62be-4a70-a053-33ad4f329580 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:20.629492 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:20.629492 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:20.629492 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:20.629492 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:20.629492 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:20.629492 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:20.629492 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:20.629492 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:20.629492 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:20.629492 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:20.629492 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:20.629492 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:11:20.629492 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:11:20.629492 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:11:20.629492 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:11:20.630583 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:20.630583 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:20.630583 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:20.630583 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:20.630583 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:20.630583 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:20.630583 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:20.630583 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:20.630583 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:20.630583 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:20.630583 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:20.630583 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:20.630583 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:20.630583 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:20.630583 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:20.630583 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:20.630583 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:11:20.631525 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:11:20.631525 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:20.631525 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:20.635598 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 272/554] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:11:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:20.638903 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b51e20-62be-4a70-a053-33ad4f329580 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:20.679224 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:20.747394 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:20.765661 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ec4ca5-7cf7-45bc-9470-08ca8f05d353 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:20.786938 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b51e20-62be-4a70-a053-33ad4f329580 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:20.826495 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94649562-67f3-494d-ba82-d81c17468534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:20.827057 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94649562-67f3-494d-ba82-d81c17468534 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:20.827508 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94649562-67f3-494d-ba82-d81c17468534 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:20.828379 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94649562-67f3-494d-ba82-d81c17468534 None admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:20.829051 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94649562-67f3-494d-ba82-d81c17468534 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:20.829730 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94649562-67f3-494d-ba82-d81c17468534 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:20.831220 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94649562-67f3-494d-ba82-d81c17468534 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:20.849100 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 273/555] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 15 12:11:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:20.849526 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be86ce26-89a8-4bca-9382-0a37f0613ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:20.850179 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be86ce26-89a8-4bca-9382-0a37f0613ad3 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:20.850457 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be86ce26-89a8-4bca-9382-0a37f0613ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:20.854856 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be86ce26-89a8-4bca-9382-0a37f0613ad3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:20.857321 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94649562-67f3-494d-ba82-d81c17468534 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:20.875556 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be86ce26-89a8-4bca-9382-0a37f0613ad3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:20.877274 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be86ce26-89a8-4bca-9382-0a37f0613ad3 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:20.897327 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-be86ce26-89a8-4bca-9382-0a37f0613ad3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 15 12:11:20.897327 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:20.897327 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:20.897327 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:20.897327 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:20.897327 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:20.897327 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:20.897327 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:20.897327 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:20.897327 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:20.897327 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:20.897327 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:20.897327 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 12:11:20.897327 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 12:11:20.897327 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 12:11:20.897327 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 12:11:20.898370 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:20.898370 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:20.898370 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 12:11:20.898370 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:11:20.898370 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 12:11:20.898370 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:11:20.898370 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:20.898370 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:20.898370 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:20.898370 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:20.898370 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:20.898370 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:20.898370 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:20.898370 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:20.898370 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:20.898370 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:20.898370 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:20.898370 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:20.899335 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:20.899335 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:20.899335 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 12:11:20.899335 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 12:11:20.899335 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 12:11:20.899335 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 12:11:20.899335 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 12:11:20.899335 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 12:11:20.899335 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 15 12:11:20.899335 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:11:20.900639 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 283/556] 10.222.0.16 () {56 vars in 1093 bytes} [Thu Sep 15 12:11:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:20.901174 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be86ce26-89a8-4bca-9382-0a37f0613ad3 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:20.975695 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:20.983093 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94649562-67f3-494d-ba82-d81c17468534 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:21.021842 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9670c652-3669-49ba-9886-f4a88623152c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:21.022795 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9670c652-3669-49ba-9886-f4a88623152c None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:21.023082 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9670c652-3669-49ba-9886-f4a88623152c None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:21.023354 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9670c652-3669-49ba-9886-f4a88623152c None admin] PATH_INFO: `/v3/users/swift` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:21.032888 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9670c652-3669-49ba-9886-f4a88623152c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:21.035154 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9670c652-3669-49ba-9886-f4a88623152c None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:21.036803 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be86ce26-89a8-4bca-9382-0a37f0613ad3 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:21.047166 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-9670c652-3669-49ba-9886-f4a88623152c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 15 12:11:21.047166 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:21.047166 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:21.047166 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:21.047166 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:21.047166 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:21.047166 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:21.047166 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:21.047166 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:21.047166 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:21.047166 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:21.047166 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:21.047166 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 12:11:21.047166 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 12:11:21.047166 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 12:11:21.047166 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 12:11:21.048610 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:21.048610 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:21.048610 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 12:11:21.048610 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:11:21.048610 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 12:11:21.048610 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:11:21.048610 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:21.048610 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:21.048610 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:21.048610 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:21.048610 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:21.048610 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:21.048610 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:21.048610 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:21.048610 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:21.048610 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:21.048610 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:21.048610 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:21.049535 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:21.049535 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:21.049535 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 12:11:21.049535 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 12:11:21.049535 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 12:11:21.049535 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 12:11:21.049535 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 12:11:21.049535 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 12:11:21.049535 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 15 12:11:21.049535 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:21.049535 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 274/557] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Sep 15 12:11:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:21.049535 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9670c652-3669-49ba-9886-f4a88623152c None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:21.075238 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92758177-c1e0-417c-8e3a-f562754fa3cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:21.075858 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92758177-c1e0-417c-8e3a-f562754fa3cb None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:21.076131 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92758177-c1e0-417c-8e3a-f562754fa3cb None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:21.076396 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92758177-c1e0-417c-8e3a-f562754fa3cb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:21.087375 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92758177-c1e0-417c-8e3a-f562754fa3cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:11:21.092522 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-92758177-c1e0-417c-8e3a-f562754fa3cb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 12:11:21.092522 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:21.092522 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:21.092522 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:21.092522 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:21.092522 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:21.092522 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:21.092522 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:21.092522 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:21.092522 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:21.092522 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:21.092522 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:21.092522 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:11:21.092522 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:11:21.092522 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:11:21.092522 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:11:21.093476 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:11:21.093476 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:11:21.093476 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:11:21.093476 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:11:21.093476 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:21.093476 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:21.093476 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:21.093476 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:21.093476 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:21.093476 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:21.093476 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:21.093476 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:21.093476 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:21.093476 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:21.093476 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:21.093476 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:21.094398 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:21.094398 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:21.094398 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:21.094398 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:21.094398 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:11:21.094398 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:11:21.094398 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:11:21.094398 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:11:21.094398 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:11:21.094398 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:11:21.094398 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 12:11:21.094398 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:11:21.094398 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 284/558] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Sep 15 12:11:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:21.095146 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d4e852-fc2e-4346-b8c9-9b5d1449e95e None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:21.095146 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d4e852-fc2e-4346-b8c9-9b5d1449e95e None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:21.095269 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d4e852-fc2e-4346-b8c9-9b5d1449e95e None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:21.097270 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 285/559] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:11:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:11:21.097624 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be8fad6-0ff2-4307-8da0-e6590ffdeee8 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:21.097899 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be8fad6-0ff2-4307-8da0-e6590ffdeee8 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:21.098164 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be8fad6-0ff2-4307-8da0-e6590ffdeee8 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:21.099344 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 286/560] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:11:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:11:21.100017 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be8fad6-0ff2-4307-8da0-e6590ffdeee8 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:21.111885 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:21.153069 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9670c652-3669-49ba-9886-f4a88623152c None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:21.186123 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec559110-f143-4930-9b30-46db9b583b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:21.186748 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec559110-f143-4930-9b30-46db9b583b1d None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:21.187548 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec559110-f143-4930-9b30-46db9b583b1d None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:21.187818 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec559110-f143-4930-9b30-46db9b583b1d None admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:21.188537 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec559110-f143-4930-9b30-46db9b583b1d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:21.188839 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec559110-f143-4930-9b30-46db9b583b1d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:21.190262 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec559110-f143-4930-9b30-46db9b583b1d None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:21.200194 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be8fad6-0ff2-4307-8da0-e6590ffdeee8 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:21.207422 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 275/561] 10.222.0.16 () {56 vars in 1133 bytes} [Thu Sep 15 12:11:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:21.208199 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec559110-f143-4930-9b30-46db9b583b1d None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:21.222571 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:21.237276 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14be952-22af-42ac-952c-52e1d1a0ead1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:21.237876 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14be952-22af-42ac-952c-52e1d1a0ead1 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:21.238158 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14be952-22af-42ac-952c-52e1d1a0ead1 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:21.238435 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14be952-22af-42ac-952c-52e1d1a0ead1 None admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:21.239194 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14be952-22af-42ac-952c-52e1d1a0ead1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:21.239501 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14be952-22af-42ac-952c-52e1d1a0ead1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:21.240931 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14be952-22af-42ac-952c-52e1d1a0ead1 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:21.258349 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 287/562] 10.222.0.16 () {56 vars in 1135 bytes} [Thu Sep 15 12:11:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:21.259611 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e707ec-c495-4c45-9c4e-8844a4e36587 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:21.259903 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e707ec-c495-4c45-9c4e-8844a4e36587 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:21.260174 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e707ec-c495-4c45-9c4e-8844a4e36587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:21.278021 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-d8e707ec-c495-4c45-9c4e-8844a4e36587 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:11:21.279243 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-d8e707ec-c495-4c45-9c4e-8844a4e36587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:11:21.306192 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec559110-f143-4930-9b30-46db9b583b1d None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:21.338626 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:21.342107 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c02cb8-6ef4-4a83-a63e-afde8fb2fa93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:21.342740 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c02cb8-6ef4-4a83-a63e-afde8fb2fa93 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:21.343024 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c02cb8-6ef4-4a83-a63e-afde8fb2fa93 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:21.343321 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c02cb8-6ef4-4a83-a63e-afde8fb2fa93 None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:21.343984 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c02cb8-6ef4-4a83-a63e-afde8fb2fa93 None admin] RBAC: Adding query filter params (name=service) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:21.344261 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 288/563] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:11:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:11:21.344380 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c02cb8-6ef4-4a83-a63e-afde8fb2fa93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:21.345430 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be691620-0856-4c78-8bbf-56cba6e4e017 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:21.345649 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c02cb8-6ef4-4a83-a63e-afde8fb2fa93 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:21.345767 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be691620-0856-4c78-8bbf-56cba6e4e017 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:21.345961 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be691620-0856-4c78-8bbf-56cba6e4e017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:21.363558 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-be691620-0856-4c78-8bbf-56cba6e4e017 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:11:21.364977 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-be691620-0856-4c78-8bbf-56cba6e4e017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:11:21.365816 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 276/564] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Sep 15 12:11:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:21.366455 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c02cb8-6ef4-4a83-a63e-afde8fb2fa93 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:21.440277 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 289/565] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:11:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:11:21.440942 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be691620-0856-4c78-8bbf-56cba6e4e017 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:21.455729 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:21.479946 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c02cb8-6ef4-4a83-a63e-afde8fb2fa93 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:21.525143 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98a2bc8-2ce9-49c2-8634-b88a3a94a2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:21.526655 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98a2bc8-2ce9-49c2-8634-b88a3a94a2b6 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:21.527127 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98a2bc8-2ce9-49c2-8634-b88a3a94a2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:21.527540 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98a2bc8-2ce9-49c2-8634-b88a3a94a2b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:21.542758 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98a2bc8-2ce9-49c2-8634-b88a3a94a2b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:21.545068 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98a2bc8-2ce9-49c2-8634-b88a3a94a2b6 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:21.564650 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-f98a2bc8-2ce9-49c2-8634-b88a3a94a2b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:21.564650 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:21.564650 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:21.564650 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:21.564650 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:21.564650 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:21.564650 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:21.564650 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:21.564650 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:21.564650 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:21.564650 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:21.564650 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:21.564650 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:11:21.564650 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:11:21.564650 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:11:21.564650 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:11:21.565765 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:21.565765 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:21.565765 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:21.565765 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:21.565765 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:21.565765 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:21.565765 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:21.565765 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:21.565765 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:21.565765 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:21.565765 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:21.565765 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:21.565765 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:21.565765 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:21.565765 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:21.565765 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:21.565765 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:11:21.566835 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:11:21.566835 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:21.566835 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:21.567950 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be691620-0856-4c78-8bbf-56cba6e4e017 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:21.568623 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 277/566] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:11:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:21.569808 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98a2bc8-2ce9-49c2-8634-b88a3a94a2b6 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:21.598179 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:21.607185 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709dd521-20b0-4dfa-9a21-d091f4ceec9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:21.607921 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709dd521-20b0-4dfa-9a21-d091f4ceec9a None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:21.608272 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709dd521-20b0-4dfa-9a21-d091f4ceec9a None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:21.608661 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709dd521-20b0-4dfa-9a21-d091f4ceec9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:21.679966 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709dd521-20b0-4dfa-9a21-d091f4ceec9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:21.681871 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709dd521-20b0-4dfa-9a21-d091f4ceec9a None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:21.685660 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98a2bc8-2ce9-49c2-8634-b88a3a94a2b6 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:21.712795 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:21.720865 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6e80c9-ef09-45ad-ae7f-81b108d4e80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:21.721500 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e80c9-ef09-45ad-ae7f-81b108d4e80e None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:21.721782 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e80c9-ef09-45ad-ae7f-81b108d4e80e None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:21.722201 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e80c9-ef09-45ad-ae7f-81b108d4e80e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:21.733056 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6e80c9-ef09-45ad-ae7f-81b108d4e80e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:21.734555 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6e80c9-ef09-45ad-ae7f-81b108d4e80e None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:21.750212 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-aa6e80c9-ef09-45ad-ae7f-81b108d4e80e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:21.750212 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:21.750212 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:21.750212 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:21.750212 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:21.750212 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:21.750212 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:21.750212 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:21.750212 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:21.750212 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:21.750212 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:21.750212 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:21.750212 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:11:21.750212 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:11:21.750212 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:11:21.750212 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:11:21.751534 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:21.751534 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:21.751534 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:21.751534 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:21.751534 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:21.751534 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:21.751534 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:21.751534 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:21.751534 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:21.751534 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:21.751534 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:21.751534 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:21.751534 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:21.751534 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:21.751534 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:21.751534 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:21.751534 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:11:21.752404 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:11:21.752404 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:21.752404 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:21.752404 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 278/567] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:11:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:21.752404 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6e80c9-ef09-45ad-ae7f-81b108d4e80e None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:21.789958 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 290/568] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 15 12:11:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 12:11:21.791051 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709dd521-20b0-4dfa-9a21-d091f4ceec9a None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:21.817241 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:21.854324 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6e80c9-ef09-45ad-ae7f-81b108d4e80e None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:21.887092 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9172708c-1aa0-47ef-bff1-2a7745fd0529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:21.887725 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9172708c-1aa0-47ef-bff1-2a7745fd0529 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:21.888166 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9172708c-1aa0-47ef-bff1-2a7745fd0529 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:21.888474 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9172708c-1aa0-47ef-bff1-2a7745fd0529 None admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:21.888563 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709dd521-20b0-4dfa-9a21-d091f4ceec9a None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:21.889152 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9172708c-1aa0-47ef-bff1-2a7745fd0529 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:21.889452 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9172708c-1aa0-47ef-bff1-2a7745fd0529 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:21.891377 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9172708c-1aa0-47ef-bff1-2a7745fd0529 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:21.902590 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 279/569] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 15 12:11:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:21.903383 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9172708c-1aa0-47ef-bff1-2a7745fd0529 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:21.922502 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3971d1e4-d434-4aaa-9bbd-5505020eaf37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:21.923148 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3971d1e4-d434-4aaa-9bbd-5505020eaf37 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:21.923429 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3971d1e4-d434-4aaa-9bbd-5505020eaf37 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:21.923701 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3971d1e4-d434-4aaa-9bbd-5505020eaf37 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:21.933623 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3971d1e4-d434-4aaa-9bbd-5505020eaf37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:11:21.938932 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-3971d1e4-d434-4aaa-9bbd-5505020eaf37 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 12:11:21.938932 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:21.938932 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:21.938932 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:21.938932 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:21.938932 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:21.938932 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:21.938932 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:21.938932 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:21.938932 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:21.938932 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:21.938932 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:21.938932 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:11:21.938932 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:11:21.938932 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:11:21.938932 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:11:21.940032 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:11:21.940032 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:11:21.940032 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:11:21.940032 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:11:21.940032 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:21.940032 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:21.940032 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:21.940032 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:21.940032 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:21.940032 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:21.940032 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:21.940032 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:21.940032 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:21.940032 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:21.940032 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:21.940032 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:21.941035 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:21.941035 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:21.941035 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:21.941035 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:21.941035 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:11:21.941035 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:11:21.941035 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:11:21.941035 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:11:21.941035 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:11:21.941035 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:11:21.941035 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 12:11:21.941035 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:11:21.942839 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 291/570] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Sep 15 12:11:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:21.943960 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:21.944668 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3971d1e4-d434-4aaa-9bbd-5505020eaf37 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:22.002889 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9172708c-1aa0-47ef-bff1-2a7745fd0529 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:22.032027 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:22.039669 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310fbd0c-e2bc-430d-9e11-99b8940ca781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:22.040294 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310fbd0c-e2bc-430d-9e11-99b8940ca781 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:22.040572 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310fbd0c-e2bc-430d-9e11-99b8940ca781 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:22.040841 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310fbd0c-e2bc-430d-9e11-99b8940ca781 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:22.044134 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3971d1e4-d434-4aaa-9bbd-5505020eaf37 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:22.051198 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310fbd0c-e2bc-430d-9e11-99b8940ca781 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:11:22.055915 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-310fbd0c-e2bc-430d-9e11-99b8940ca781 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 12:11:22.055915 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:22.055915 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:22.055915 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:22.055915 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:22.055915 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:22.055915 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:22.055915 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:22.055915 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:22.055915 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:22.055915 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:22.055915 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:22.055915 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:11:22.055915 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:11:22.055915 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:11:22.055915 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:11:22.056991 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:11:22.056991 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:11:22.056991 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:11:22.056991 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:11:22.056991 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:22.056991 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:22.056991 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:22.056991 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:22.056991 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:22.056991 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:22.056991 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:22.056991 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:22.056991 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:22.056991 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:22.056991 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:22.056991 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:22.057822 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:22.057822 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:22.057822 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:22.057822 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:22.057822 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:11:22.057822 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:11:22.057822 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:11:22.057822 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:11:22.057822 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:11:22.057822 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:11:22.057822 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 12:11:22.057822 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:22.057822 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 280/571] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Sep 15 12:11:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:22.057822 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310fbd0c-e2bc-430d-9e11-99b8940ca781 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:22.080369 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad4f29d-dc66-4e5c-a738-b3a9e23c038f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:22.080967 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad4f29d-dc66-4e5c-a738-b3a9e23c038f None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:22.081246 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad4f29d-dc66-4e5c-a738-b3a9e23c038f None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:22.081516 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad4f29d-dc66-4e5c-a738-b3a9e23c038f None admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:22.082153 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad4f29d-dc66-4e5c-a738-b3a9e23c038f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:22.082457 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad4f29d-dc66-4e5c-a738-b3a9e23c038f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:22.083849 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad4f29d-dc66-4e5c-a738-b3a9e23c038f None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:22.095034 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 292/572] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 15 12:11:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:22.095901 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad4f29d-dc66-4e5c-a738-b3a9e23c038f None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:22.155126 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:22.158267 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310fbd0c-e2bc-430d-9e11-99b8940ca781 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:22.192289 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24c93ea-17f8-4718-b5c8-f4359b2a36fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:22.192911 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c93ea-17f8-4718-b5c8-f4359b2a36fb None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:22.193189 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c93ea-17f8-4718-b5c8-f4359b2a36fb None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:22.193462 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c93ea-17f8-4718-b5c8-f4359b2a36fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:22.193651 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad4f29d-dc66-4e5c-a738-b3a9e23c038f None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:22.203124 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24c93ea-17f8-4718-b5c8-f4359b2a36fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:22.204558 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24c93ea-17f8-4718-b5c8-f4359b2a36fb None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:22.218592 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-b24c93ea-17f8-4718-b5c8-f4359b2a36fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:22.218592 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:22.218592 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:22.218592 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:22.218592 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:22.218592 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:22.218592 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:22.218592 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:22.218592 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:22.218592 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:22.218592 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:22.218592 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:22.218592 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:11:22.218592 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:11:22.218592 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:11:22.218592 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:11:22.219527 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:22.219527 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:22.219527 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:22.219527 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:22.219527 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:22.219527 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:22.219527 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:22.219527 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:22.219527 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:22.219527 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:22.219527 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:22.219527 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:22.219527 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:22.219527 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:22.219527 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:22.219527 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:22.219527 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:11:22.220412 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:11:22.220412 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:22.220412 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:22.220412 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 281/573] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:11:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:22.220412 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24c93ea-17f8-4718-b5c8-f4359b2a36fb None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:22.230253 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adab1ea2-877e-4572-83f2-dee8cbf47235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:22.231248 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adab1ea2-877e-4572-83f2-dee8cbf47235 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:22.231528 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adab1ea2-877e-4572-83f2-dee8cbf47235 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:22.232104 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adab1ea2-877e-4572-83f2-dee8cbf47235 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:22.239122 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adab1ea2-877e-4572-83f2-dee8cbf47235 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:22.240555 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adab1ea2-877e-4572-83f2-dee8cbf47235 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:22.252121 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-adab1ea2-877e-4572-83f2-dee8cbf47235 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:11:22.252121 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:22.252121 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:22.252121 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:22.252121 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:22.252121 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:22.252121 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:22.252121 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:22.252121 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:22.252121 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:22.252121 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:22.252121 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:22.252121 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 12:11:22.252121 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 12:11:22.252121 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 12:11:22.253126 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 12:11:22.253126 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:22.253126 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:22.253126 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:22.253126 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:22.253126 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:22.253126 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:22.253126 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:22.253126 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:22.253126 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:22.253126 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:22.253126 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:22.253126 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:22.253126 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:22.253126 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:22.253126 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:22.253126 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:22.254170 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 12:11:22.254170 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 12:11:22.254170 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 12:11:22.254170 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 12:11:22.254170 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 12:11:22.254170 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 12:11:22.254170 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:11:22.254170 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:11:22.254170 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 293/574] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 15 12:11:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:22.254170 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adab1ea2-877e-4572-83f2-dee8cbf47235 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:22.264352 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:22.321904 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24c93ea-17f8-4718-b5c8-f4359b2a36fb None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:22.352366 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adab1ea2-877e-4572-83f2-dee8cbf47235 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:22.354485 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4513c94-d443-40d7-aa88-9f070f0a2e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:22.355114 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4513c94-d443-40d7-aa88-9f070f0a2e56 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:22.355391 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4513c94-d443-40d7-aa88-9f070f0a2e56 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:22.355656 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4513c94-d443-40d7-aa88-9f070f0a2e56 None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:22.356307 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4513c94-d443-40d7-aa88-9f070f0a2e56 None admin] RBAC: Adding query filter params (name=service) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:22.356605 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4513c94-d443-40d7-aa88-9f070f0a2e56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:22.357956 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4513c94-d443-40d7-aa88-9f070f0a2e56 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:22.366291 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 282/575] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Sep 15 12:11:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:22.367111 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4513c94-d443-40d7-aa88-9f070f0a2e56 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:22.383039 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:22.387624 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b649bb11-920e-4770-b522-d128ea14c487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:22.388227 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b649bb11-920e-4770-b522-d128ea14c487 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:22.388509 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b649bb11-920e-4770-b522-d128ea14c487 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:22.388781 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b649bb11-920e-4770-b522-d128ea14c487 None admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:22.389443 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b649bb11-920e-4770-b522-d128ea14c487 None admin] RBAC: Adding query filter params (name=service) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:22.389746 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b649bb11-920e-4770-b522-d128ea14c487 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:22.391181 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b649bb11-920e-4770-b522-d128ea14c487 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:22.401277 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 294/576] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Sep 15 12:11:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:22.404426 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b649bb11-920e-4770-b522-d128ea14c487 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:22.472657 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4513c94-d443-40d7-aa88-9f070f0a2e56 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:22.479846 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:22.505883 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5d4e13-c87e-4a04-ae48-f09edef7f60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:22.506500 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5d4e13-c87e-4a04-ae48-f09edef7f60a None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:22.506796 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5d4e13-c87e-4a04-ae48-f09edef7f60a None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:22.507066 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5d4e13-c87e-4a04-ae48-f09edef7f60a None admin] PATH_INFO: `/v3/users/glance` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:22.511427 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b649bb11-920e-4770-b522-d128ea14c487 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:22.514839 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5d4e13-c87e-4a04-ae48-f09edef7f60a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:22.516318 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5d4e13-c87e-4a04-ae48-f09edef7f60a None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:22.527042 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-7a5d4e13-c87e-4a04-ae48-f09edef7f60a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 15 12:11:22.527042 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:22.527042 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:22.527042 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:22.527042 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:22.527042 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:22.527042 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:22.527042 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:22.527042 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:22.527042 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:22.527042 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:22.527042 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:22.527042 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 12:11:22.527042 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 12:11:22.527042 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 12:11:22.527042 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 12:11:22.528022 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:22.528022 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:22.528022 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 12:11:22.528022 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:11:22.528022 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 12:11:22.528022 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:11:22.528022 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:22.528022 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:22.528022 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:22.528022 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:22.528022 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:22.528022 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:22.528022 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:22.528022 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:22.528022 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:22.528022 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:22.528022 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:22.528022 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:22.528956 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:22.528956 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:22.528956 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 12:11:22.528956 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 12:11:22.528956 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 12:11:22.528956 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 12:11:22.528956 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 12:11:22.528956 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 12:11:22.528956 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 15 12:11:22.528956 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:22.528956 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 283/577] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 15 12:11:22 2022] GET /identity/v3/users/glance => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:22.528956 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5d4e13-c87e-4a04-ae48-f09edef7f60a None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:22.548579 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dd9190-fed3-48be-916d-0fdb9d3b210f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:22.549181 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd9190-fed3-48be-916d-0fdb9d3b210f None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:22.549475 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd9190-fed3-48be-916d-0fdb9d3b210f None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:22.549729 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd9190-fed3-48be-916d-0fdb9d3b210f None admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:22.550364 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dd9190-fed3-48be-916d-0fdb9d3b210f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:22.550663 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dd9190-fed3-48be-916d-0fdb9d3b210f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:22.552042 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dd9190-fed3-48be-916d-0fdb9d3b210f None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:22.563498 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 295/578] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 15 12:11:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:22.564270 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dd9190-fed3-48be-916d-0fdb9d3b210f None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:22.609545 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:22.633778 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5d4e13-c87e-4a04-ae48-f09edef7f60a None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:22.661691 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dd9190-fed3-48be-916d-0fdb9d3b210f None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:22.667217 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28b7f21-c2ef-4cd5-8219-fbbcf85a8ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:22.667812 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b7f21-c2ef-4cd5-8219-fbbcf85a8ecb None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:22.668087 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b7f21-c2ef-4cd5-8219-fbbcf85a8ecb None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:22.668356 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b7f21-c2ef-4cd5-8219-fbbcf85a8ecb None admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:22.669038 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28b7f21-c2ef-4cd5-8219-fbbcf85a8ecb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:22.669336 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28b7f21-c2ef-4cd5-8219-fbbcf85a8ecb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:22.670777 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28b7f21-c2ef-4cd5-8219-fbbcf85a8ecb None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:22.683378 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 284/579] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Sep 15 12:11:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:22.684225 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28b7f21-c2ef-4cd5-8219-fbbcf85a8ecb None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:22.695047 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:22.700618 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52f2de7-45b5-4c43-bb3a-efe9b834a5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:22.701241 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f2de7-45b5-4c43-bb3a-efe9b834a5bb None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:22.701516 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f2de7-45b5-4c43-bb3a-efe9b834a5bb None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:22.701791 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f2de7-45b5-4c43-bb3a-efe9b834a5bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:22.711701 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52f2de7-45b5-4c43-bb3a-efe9b834a5bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:22.713152 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52f2de7-45b5-4c43-bb3a-efe9b834a5bb None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:22.727870 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-c52f2de7-45b5-4c43-bb3a-efe9b834a5bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:22.727870 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:22.727870 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:22.727870 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:22.727870 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:22.727870 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:22.727870 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:22.727870 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:22.727870 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:22.727870 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:22.727870 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:22.727870 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:22.727870 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:11:22.727870 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:11:22.727870 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:11:22.727870 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:11:22.728965 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:22.728965 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:22.728965 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:22.728965 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:22.728965 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:22.728965 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:22.728965 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:22.728965 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:22.728965 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:22.728965 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:22.728965 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:22.728965 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:22.728965 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:22.728965 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:22.728965 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:22.728965 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:22.728965 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:11:22.729938 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:11:22.729938 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:22.729938 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:11:22.729938 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 296/580] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:11:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:22.729938 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52f2de7-45b5-4c43-bb3a-efe9b834a5bb None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:22.799735 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28b7f21-c2ef-4cd5-8219-fbbcf85a8ecb None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:22.831037 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52f2de7-45b5-4c43-bb3a-efe9b834a5bb None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:22.834456 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f21e3f-43cb-41fd-97ad-f6d76d7360af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:22.835110 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f21e3f-43cb-41fd-97ad-f6d76d7360af None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:22.835393 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f21e3f-43cb-41fd-97ad-f6d76d7360af None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:22.835668 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f21e3f-43cb-41fd-97ad-f6d76d7360af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:22.837634 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:22.848144 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f21e3f-43cb-41fd-97ad-f6d76d7360af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:22.849588 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f21e3f-43cb-41fd-97ad-f6d76d7360af None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:22.863303 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0026e3-62a2-4d29-90a1-71eb9e098a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:22.863898 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0026e3-62a2-4d29-90a1-71eb9e098a9b None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:22.864024 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-21f21e3f-43cb-41fd-97ad-f6d76d7360af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:22.864024 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:22.864024 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:22.864024 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:22.864024 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:22.864024 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:22.864024 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:22.864024 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:22.864024 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:22.864024 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:22.864024 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:22.864024 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:22.864024 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:11:22.864024 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:11:22.864024 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:11:22.864024 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:11:22.865098 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:22.865098 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:22.865098 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:22.865098 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:22.865098 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:22.865098 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:22.865098 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:22.865098 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:22.865098 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:22.865098 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:22.865098 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:22.865098 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:22.865098 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:22.865098 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:22.865098 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:22.865098 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:22.865098 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:11:22.866296 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:11:22.866296 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:22.866296 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:22.866466 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0026e3-62a2-4d29-90a1-71eb9e098a9b None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:22.866466 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0026e3-62a2-4d29-90a1-71eb9e098a9b None admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:22.866585 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 285/581] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:11:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:22.866585 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f21e3f-43cb-41fd-97ad-f6d76d7360af None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:22.869531 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0026e3-62a2-4d29-90a1-71eb9e098a9b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:22.869876 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0026e3-62a2-4d29-90a1-71eb9e098a9b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:22.871367 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0026e3-62a2-4d29-90a1-71eb9e098a9b None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:22.888459 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 297/582] 10.222.0.16 () {56 vars in 1137 bytes} [Thu Sep 15 12:11:22 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:22.889315 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0026e3-62a2-4d29-90a1-71eb9e098a9b None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:22.932152 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:22.965387 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f21e3f-43cb-41fd-97ad-f6d76d7360af None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:22.993905 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0026e3-62a2-4d29-90a1-71eb9e098a9b None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:23.002202 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bccfe88-2e47-4632-b0e0-f4f58fe2ba26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:23.002871 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bccfe88-2e47-4632-b0e0-f4f58fe2ba26 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:23.003154 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bccfe88-2e47-4632-b0e0-f4f58fe2ba26 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:23.003429 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bccfe88-2e47-4632-b0e0-f4f58fe2ba26 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:23.009882 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bccfe88-2e47-4632-b0e0-f4f58fe2ba26 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:23.011349 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bccfe88-2e47-4632-b0e0-f4f58fe2ba26 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:23.022891 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-4bccfe88-2e47-4632-b0e0-f4f58fe2ba26 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:11:23.022891 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:23.022891 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:23.022891 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:23.022891 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:23.022891 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:23.022891 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:23.022891 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:23.022891 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:23.022891 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:23.022891 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:23.022891 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:23.022891 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 12:11:23.022891 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 12:11:23.022891 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 12:11:23.023840 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 12:11:23.023840 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:23.023840 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:23.023840 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:23.023840 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:23.023840 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:23.023840 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:23.023840 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:23.023840 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:23.023840 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:23.023840 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:23.023840 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:23.023840 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:23.023840 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:23.023840 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:23.023840 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:23.023840 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:23.025140 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 12:11:23.025140 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 12:11:23.025140 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 12:11:23.025140 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 12:11:23.025140 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 12:11:23.025140 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 12:11:23.025140 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:11:23.025140 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:23.025140 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 286/583] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 15 12:11:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:23.025140 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bccfe88-2e47-4632-b0e0-f4f58fe2ba26 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:23.032243 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bfb539-b388-41f9-bb56-e5e5d9f57245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:23.032899 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bfb539-b388-41f9-bb56-e5e5d9f57245 None admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:23.033179 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bfb539-b388-41f9-bb56-e5e5d9f57245 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:23.033452 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bfb539-b388-41f9-bb56-e5e5d9f57245 None admin] PATH_INFO: `/v3/projects/cab958c081ad4a92939d4469cf4ce1c6/users/9d05c52570474820b4ba0e2cdad5c13f/roles/9c9f10110e12479bb6b3b630dd6412b8` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:23.047563 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bfb539-b388-41f9-bb56-e5e5d9f57245 None admin] RBAC: Authorizing `identity:create_grant(project_id=cab958c081ad4a92939d4469cf4ce1c6, user_id=9d05c52570474820b4ba0e2cdad5c13f, role_id=9c9f10110e12479bb6b3b630dd6412b8)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:23.048987 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bfb539-b388-41f9-bb56-e5e5d9f57245 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:23.062216 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 298/584] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Sep 15 12:11:22 2022] PUT /identity/v3/projects/cab958c081ad4a92939d4469cf4ce1c6/users/9d05c52570474820b4ba0e2cdad5c13f/roles/9c9f10110e12479bb6b3b630dd6412b8 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:11:23.063038 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bfb539-b388-41f9-bb56-e5e5d9f57245 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:23.070931 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:23.133275 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bccfe88-2e47-4632-b0e0-f4f58fe2ba26 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:23.171555 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360d9fac-de3d-4633-920d-b603dc872787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:23.172175 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d9fac-de3d-4633-920d-b603dc872787 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:23.172453 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d9fac-de3d-4633-920d-b603dc872787 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:23.172724 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d9fac-de3d-4633-920d-b603dc872787 None admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:23.173381 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360d9fac-de3d-4633-920d-b603dc872787 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:23.173683 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360d9fac-de3d-4633-920d-b603dc872787 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:23.175102 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360d9fac-de3d-4633-920d-b603dc872787 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:23.179611 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:23.194773 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 287/585] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 15 12:11:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:23.194773 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360d9fac-de3d-4633-920d-b603dc872787 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:23.198123 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bfb539-b388-41f9-bb56-e5e5d9f57245 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:23.245593 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82cf5fd-ec54-4858-b512-9c03e138d5bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:23.246132 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82cf5fd-ec54-4858-b512-9c03e138d5bd None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:23.246414 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82cf5fd-ec54-4858-b512-9c03e138d5bd None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:23.246705 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82cf5fd-ec54-4858-b512-9c03e138d5bd None admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:23.247362 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82cf5fd-ec54-4858-b512-9c03e138d5bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:23.247673 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82cf5fd-ec54-4858-b512-9c03e138d5bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:23.249032 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82cf5fd-ec54-4858-b512-9c03e138d5bd None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:23.262667 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 299/586] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 15 12:11:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:23.263543 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82cf5fd-ec54-4858-b512-9c03e138d5bd None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:23.301439 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360d9fac-de3d-4633-920d-b603dc872787 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:23.308810 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:23.337875 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04de69fa-e8e0-4667-b328-5ecaf24f29e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:23.338507 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de69fa-e8e0-4667-b328-5ecaf24f29e4 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:23.338812 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de69fa-e8e0-4667-b328-5ecaf24f29e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:23.339086 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de69fa-e8e0-4667-b328-5ecaf24f29e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:23.349109 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04de69fa-e8e0-4667-b328-5ecaf24f29e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:23.350570 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04de69fa-e8e0-4667-b328-5ecaf24f29e4 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:23.365457 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-04de69fa-e8e0-4667-b328-5ecaf24f29e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:23.365457 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:23.365457 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:23.365457 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:23.365457 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:23.365457 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:23.365457 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:23.365457 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:23.365457 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:23.365457 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:23.365457 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:23.365457 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:23.365457 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:11:23.365457 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:11:23.365457 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:11:23.365457 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:11:23.366565 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:23.366565 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:23.366565 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:23.366565 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:23.366565 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:23.366565 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:23.366565 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:23.366565 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:23.366565 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:23.366565 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:23.366565 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:23.366565 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:23.366565 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:23.366565 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:23.366565 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:23.366565 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:23.366565 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:11:23.367480 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:11:23.367480 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:23.367480 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:23.367480 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 288/587] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:11:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:23.367781 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04de69fa-e8e0-4667-b328-5ecaf24f29e4 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:23.385108 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82cf5fd-ec54-4858-b512-9c03e138d5bd None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:23.424041 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04d3076-4704-4f5e-974e-a9001447192c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:23.424885 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d3076-4704-4f5e-974e-a9001447192c None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:23.425160 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d3076-4704-4f5e-974e-a9001447192c None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:23.425426 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d3076-4704-4f5e-974e-a9001447192c None admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:23.426103 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04d3076-4704-4f5e-974e-a9001447192c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:23.426403 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04d3076-4704-4f5e-974e-a9001447192c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:23.428051 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04d3076-4704-4f5e-974e-a9001447192c None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:23.446997 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 300/588] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Sep 15 12:11:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:23.447843 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04d3076-4704-4f5e-974e-a9001447192c None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:23.460678 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:23.476617 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04de69fa-e8e0-4667-b328-5ecaf24f29e4 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:23.510504 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbd4d75-e524-44c3-b188-25b6c4d92ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:23.511093 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbd4d75-e524-44c3-b188-25b6c4d92ce8 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:23.511369 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbd4d75-e524-44c3-b188-25b6c4d92ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:23.511636 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbd4d75-e524-44c3-b188-25b6c4d92ce8 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:23.519564 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbd4d75-e524-44c3-b188-25b6c4d92ce8 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:23.520989 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbd4d75-e524-44c3-b188-25b6c4d92ce8 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:23.532575 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-9dbd4d75-e524-44c3-b188-25b6c4d92ce8 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 15 12:11:23.532575 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:23.532575 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:23.532575 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:23.532575 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:23.532575 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:23.532575 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:23.532575 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:23.532575 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:23.532575 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:23.532575 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:23.532575 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:23.532575 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 12:11:23.532575 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 12:11:23.532575 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 12:11:23.532575 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 12:11:23.535475 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:23.535475 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:23.535475 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 12:11:23.535475 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:11:23.535475 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 12:11:23.535475 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:11:23.535475 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:23.535475 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:23.535475 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:23.535475 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:23.535475 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:23.535475 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:23.535475 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:23.535475 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:23.535475 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:23.535475 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:23.535475 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:23.535475 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:23.536413 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:23.536413 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:23.536413 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 12:11:23.536413 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 12:11:23.536413 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 12:11:23.536413 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 12:11:23.536413 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 12:11:23.536413 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 12:11:23.536413 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 15 12:11:23.536413 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:23.536413 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 289/589] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Sep 15 12:11:23 2022] GET /identity/v3/users/neutron => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:23.536413 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbd4d75-e524-44c3-b188-25b6c4d92ce8 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:23.554831 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:23.561871 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04d3076-4704-4f5e-974e-a9001447192c None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:23.600075 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b0d13a-4a9f-440a-ba2b-d16c8feb6fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:23.600663 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b0d13a-4a9f-440a-ba2b-d16c8feb6fdf None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:23.600942 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b0d13a-4a9f-440a-ba2b-d16c8feb6fdf None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:23.601216 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b0d13a-4a9f-440a-ba2b-d16c8feb6fdf None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:23.608559 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b0d13a-4a9f-440a-ba2b-d16c8feb6fdf None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:23.610521 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b0d13a-4a9f-440a-ba2b-d16c8feb6fdf None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:23.622247 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-29b0d13a-4a9f-440a-ba2b-d16c8feb6fdf None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 15 12:11:23.622247 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:23.622247 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:23.622247 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:23.622247 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:23.622247 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:23.622247 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:23.622247 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:23.622247 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:23.622247 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:23.622247 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:23.622247 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:23.622247 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 12:11:23.622247 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 12:11:23.622247 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 12:11:23.622247 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 12:11:23.623313 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:23.623313 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:23.623313 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 12:11:23.623313 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:11:23.623313 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 12:11:23.623313 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:11:23.623313 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:23.623313 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:23.623313 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:23.623313 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:23.623313 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:23.623313 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:23.623313 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:23.623313 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:23.623313 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:23.623313 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:23.623313 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:23.623313 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:23.625038 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:23.625038 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:23.625038 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 12:11:23.625038 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 12:11:23.625038 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 12:11:23.625038 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 12:11:23.625038 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 12:11:23.625038 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 12:11:23.625038 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 15 12:11:23.625038 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:11:23.628582 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 301/590] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 15 12:11:23 2022] GET /identity/v3/users/cinder => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:23.629458 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b0d13a-4a9f-440a-ba2b-d16c8feb6fdf None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:23.647094 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbd4d75-e524-44c3-b188-25b6c4d92ce8 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:23.682922 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb4756a-e2c2-49f2-8488-c5df6baf8afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:23.683531 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb4756a-e2c2-49f2-8488-c5df6baf8afa None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:23.683807 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb4756a-e2c2-49f2-8488-c5df6baf8afa None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:23.684075 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb4756a-e2c2-49f2-8488-c5df6baf8afa None admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:23.684716 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb4756a-e2c2-49f2-8488-c5df6baf8afa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:23.685017 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb4756a-e2c2-49f2-8488-c5df6baf8afa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:23.686375 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb4756a-e2c2-49f2-8488-c5df6baf8afa None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:23.698656 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 290/591] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 15 12:11:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:23.699463 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb4756a-e2c2-49f2-8488-c5df6baf8afa None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:23.707201 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:23.740460 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b0d13a-4a9f-440a-ba2b-d16c8feb6fdf None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:23.778089 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5452d8a-24e7-46ff-b2c9-dcdd5a335eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:23.778418 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:23.779654 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5452d8a-24e7-46ff-b2c9-dcdd5a335eba None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:23.780045 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5452d8a-24e7-46ff-b2c9-dcdd5a335eba None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:23.780266 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5452d8a-24e7-46ff-b2c9-dcdd5a335eba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:23.781383 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5452d8a-24e7-46ff-b2c9-dcdd5a335eba None admin] RBAC: Adding query filter params (role.id=9c9f10110e12479bb6b3b630dd6412b8, scope.project.id=cab958c081ad4a92939d4469cf4ce1c6, user.id=ee33b730d0ec428ca2cd3af4ebf723e8) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:23.781702 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5452d8a-24e7-46ff-b2c9-dcdd5a335eba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:23.783177 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5452d8a-24e7-46ff-b2c9-dcdd5a335eba None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:23.788951 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 302/592] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 15 12:11:23 2022] GET /identity/v3/role_assignments?user.id=ee33b730d0ec428ca2cd3af4ebf723e8&scope.project.id=cab958c081ad4a92939d4469cf4ce1c6&role.id=9c9f10110e12479bb6b3b630dd6412b8 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:23.789735 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5452d8a-24e7-46ff-b2c9-dcdd5a335eba None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:23.814073 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb4756a-e2c2-49f2-8488-c5df6baf8afa None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:23.856910 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb6590d-3e03-4339-8604-fb78df65fee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:23.857566 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb6590d-3e03-4339-8604-fb78df65fee2 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:23.857807 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb6590d-3e03-4339-8604-fb78df65fee2 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:23.858084 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb6590d-3e03-4339-8604-fb78df65fee2 None admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:23.859446 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb6590d-3e03-4339-8604-fb78df65fee2 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:23.859757 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb6590d-3e03-4339-8604-fb78df65fee2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:23.861324 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb6590d-3e03-4339-8604-fb78df65fee2 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:23.883141 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 291/593] 10.222.0.16 () {56 vars in 1139 bytes} [Thu Sep 15 12:11:23 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:23.884084 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb6590d-3e03-4339-8604-fb78df65fee2 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:23.944504 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5452d8a-24e7-46ff-b2c9-dcdd5a335eba None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:23.995563 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe00b3a-b436-490c-b8ab-c0277067c56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:23.996316 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe00b3a-b436-490c-b8ab-c0277067c56b None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:23.996551 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe00b3a-b436-490c-b8ab-c0277067c56b None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:23.996827 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe00b3a-b436-490c-b8ab-c0277067c56b None admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:23.997585 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe00b3a-b436-490c-b8ab-c0277067c56b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:23.997923 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe00b3a-b436-490c-b8ab-c0277067c56b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:23.999719 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe00b3a-b436-490c-b8ab-c0277067c56b None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:24.002490 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:24.019434 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb6590d-3e03-4339-8604-fb78df65fee2 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:24.029264 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 303/594] 10.222.0.16 () {56 vars in 1137 bytes} [Thu Sep 15 12:11:23 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:24.029264 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe00b3a-b436-490c-b8ab-c0277067c56b None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:24.062910 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdda1e41-f558-4a88-a6fe-733b6386bdbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:24.063499 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda1e41-f558-4a88-a6fe-733b6386bdbc None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:24.063842 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda1e41-f558-4a88-a6fe-733b6386bdbc None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:24.064175 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda1e41-f558-4a88-a6fe-733b6386bdbc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:24.071157 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdda1e41-f558-4a88-a6fe-733b6386bdbc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:24.072791 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdda1e41-f558-4a88-a6fe-733b6386bdbc None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:24.073532 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:24.085158 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-bdda1e41-f558-4a88-a6fe-733b6386bdbc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:11:24.085158 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:24.085158 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:24.085158 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:24.085158 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:24.085158 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:24.085158 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:24.085158 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:24.085158 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:24.085158 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:24.085158 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:24.085158 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:24.085158 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 12:11:24.085158 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 12:11:24.085158 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 12:11:24.086245 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 12:11:24.086245 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:24.086245 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:24.086245 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:24.086245 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:24.086245 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:24.086245 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:24.086245 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:24.086245 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:24.086245 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:24.086245 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:24.086245 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:24.086245 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:24.086245 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:24.086245 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:24.086245 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:24.086245 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:24.087349 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 12:11:24.087349 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 12:11:24.087349 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 12:11:24.087349 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 12:11:24.087349 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 12:11:24.087349 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 12:11:24.087349 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:11:24.087349 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:24.088101 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 292/595] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 15 12:11:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:24.088885 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdda1e41-f558-4a88-a6fe-733b6386bdbc None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:24.146701 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe00b3a-b436-490c-b8ab-c0277067c56b None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:24.189881 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20990d8-4890-4537-a6b5-4a302a722ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:24.191521 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20990d8-4890-4537-a6b5-4a302a722ba5 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:24.192283 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20990d8-4890-4537-a6b5-4a302a722ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:24.192774 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20990d8-4890-4537-a6b5-4a302a722ba5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:24.193929 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdda1e41-f558-4a88-a6fe-733b6386bdbc None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:24.205920 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20990d8-4890-4537-a6b5-4a302a722ba5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:24.208007 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20990d8-4890-4537-a6b5-4a302a722ba5 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:24.228444 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-f20990d8-4890-4537-a6b5-4a302a722ba5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:24.228444 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:24.228444 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:24.228444 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:24.228444 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:24.228444 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:24.228444 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:24.228444 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:24.228444 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:24.228444 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:24.228444 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:24.228444 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:24.228444 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:11:24.228444 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:11:24.228444 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:11:24.228444 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:11:24.229404 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:24.229404 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:24.229404 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:24.229404 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:24.229404 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:24.229404 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:24.229404 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:24.229404 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:24.229404 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:24.229404 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:24.229404 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:24.229404 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:24.229404 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:24.229404 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:24.229404 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:24.229404 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:24.229404 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:11:24.230276 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:11:24.230276 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:24.230276 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:11:24.230445 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5312bcd-6938-45e7-ab7f-12ef35e55a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:24.231026 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5312bcd-6938-45e7-ab7f-12ef35e55a49 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:24.231407 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5312bcd-6938-45e7-ab7f-12ef35e55a49 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:24.231771 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5312bcd-6938-45e7-ab7f-12ef35e55a49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:24.232715 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 304/596] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:11:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:24.234353 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20990d8-4890-4537-a6b5-4a302a722ba5 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:24.250256 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5312bcd-6938-45e7-ab7f-12ef35e55a49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:24.252034 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5312bcd-6938-45e7-ab7f-12ef35e55a49 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:24.266972 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-f5312bcd-6938-45e7-ab7f-12ef35e55a49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:24.266972 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:24.266972 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:24.266972 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:24.266972 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:24.266972 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:24.266972 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:24.266972 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:24.266972 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:24.266972 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:24.266972 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:24.266972 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:24.266972 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:11:24.266972 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:11:24.266972 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:11:24.266972 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:11:24.268001 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:24.268001 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:24.268001 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:24.268001 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:24.268001 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:24.268001 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:24.268001 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:24.268001 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:24.268001 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:24.268001 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:24.268001 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:24.268001 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:24.268001 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:24.268001 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:24.268001 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:24.268001 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:24.268001 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:11:24.268875 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:11:24.268875 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:24.268875 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:24.272614 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 293/597] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:11:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:24.273466 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5312bcd-6938-45e7-ab7f-12ef35e55a49 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:24.297148 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:24.327170 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:24.362114 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20990d8-4890-4537-a6b5-4a302a722ba5 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:24.393993 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5312bcd-6938-45e7-ab7f-12ef35e55a49 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:24.403161 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fee450-d755-4b16-bb86-fe4cbf773781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:24.404007 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fee450-d755-4b16-bb86-fe4cbf773781 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:24.404764 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fee450-d755-4b16-bb86-fe4cbf773781 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:24.405484 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fee450-d755-4b16-bb86-fe4cbf773781 None admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:24.406995 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fee450-d755-4b16-bb86-fe4cbf773781 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:24.407637 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fee450-d755-4b16-bb86-fe4cbf773781 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:24.409861 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fee450-d755-4b16-bb86-fe4cbf773781 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:24.430162 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f11a076-043c-48ac-844b-24d60a191ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:24.430162 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f11a076-043c-48ac-844b-24d60a191ac9 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:24.430162 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f11a076-043c-48ac-844b-24d60a191ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:24.430162 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f11a076-043c-48ac-844b-24d60a191ac9 None admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:24.430530 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f11a076-043c-48ac-844b-24d60a191ac9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:24.430530 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f11a076-043c-48ac-844b-24d60a191ac9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:24.430910 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 305/598] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Sep 15 12:11:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:24.431538 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f11a076-043c-48ac-844b-24d60a191ac9 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:24.432107 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fee450-d755-4b16-bb86-fe4cbf773781 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:24.448543 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 294/599] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 15 12:11:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:24.449488 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f11a076-043c-48ac-844b-24d60a191ac9 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:24.554064 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f11a076-043c-48ac-844b-24d60a191ac9 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:24.562572 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fee450-d755-4b16-bb86-fe4cbf773781 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:24.565494 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:24.570198 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:24.592957 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b4a1c0-9607-488f-98d4-153fc3f3c572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:24.594763 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b4a1c0-9607-488f-98d4-153fc3f3c572 None admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:24.595351 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b4a1c0-9607-488f-98d4-153fc3f3c572 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:24.595966 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b4a1c0-9607-488f-98d4-153fc3f3c572 None admin] PATH_INFO: `/v3/projects/cab958c081ad4a92939d4469cf4ce1c6/users/d057b651769b4ae99c1d4f2b0fc31fb4/roles/9c9f10110e12479bb6b3b630dd6412b8` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:24.604689 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4660f519-fb17-4524-8b87-f81e59ffcaac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:24.605292 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4660f519-fb17-4524-8b87-f81e59ffcaac None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:24.605568 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4660f519-fb17-4524-8b87-f81e59ffcaac None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:24.605834 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4660f519-fb17-4524-8b87-f81e59ffcaac None admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:24.606542 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4660f519-fb17-4524-8b87-f81e59ffcaac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:24.606894 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4660f519-fb17-4524-8b87-f81e59ffcaac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:24.608247 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4660f519-fb17-4524-8b87-f81e59ffcaac None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:24.618795 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b4a1c0-9607-488f-98d4-153fc3f3c572 None admin] RBAC: Authorizing `identity:create_grant(project_id=cab958c081ad4a92939d4469cf4ce1c6, user_id=d057b651769b4ae99c1d4f2b0fc31fb4, role_id=9c9f10110e12479bb6b3b630dd6412b8)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:24.620359 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b4a1c0-9607-488f-98d4-153fc3f3c572 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:24.627458 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 306/600] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 15 12:11:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:24.628068 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4660f519-fb17-4524-8b87-f81e59ffcaac None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:24.638046 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 295/601] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Sep 15 12:11:24 2022] PUT /identity/v3/projects/cab958c081ad4a92939d4469cf4ce1c6/users/d057b651769b4ae99c1d4f2b0fc31fb4/roles/9c9f10110e12479bb6b3b630dd6412b8 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:11:24.647704 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b4a1c0-9607-488f-98d4-153fc3f3c572 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:24.760818 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4660f519-fb17-4524-8b87-f81e59ffcaac None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:24.805925 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc6aa86-a68a-44ce-8f1c-8da6550c5369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:24.806985 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6aa86-a68a-44ce-8f1c-8da6550c5369 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:24.808522 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6aa86-a68a-44ce-8f1c-8da6550c5369 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:24.809027 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6aa86-a68a-44ce-8f1c-8da6550c5369 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:24.826111 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc6aa86-a68a-44ce-8f1c-8da6550c5369 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:24.829776 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc6aa86-a68a-44ce-8f1c-8da6550c5369 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:24.849309 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-3fc6aa86-a68a-44ce-8f1c-8da6550c5369 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:11:24.849309 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:24.849309 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:24.849309 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:24.849309 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:24.849309 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:24.849309 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:24.849309 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:24.849309 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:24.849309 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:24.849309 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:24.849309 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:24.849309 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 12:11:24.849309 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 12:11:24.849309 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 12:11:24.850327 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 12:11:24.850327 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:24.850327 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:24.850327 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:24.850327 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:24.850327 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:24.850327 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:24.850327 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:24.850327 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:24.850327 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:24.850327 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:24.850327 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:24.850327 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:24.850327 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:24.850327 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:24.850327 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:24.850327 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:24.851292 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 12:11:24.851292 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 12:11:24.851292 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 12:11:24.851292 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 12:11:24.851292 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 12:11:24.851292 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 12:11:24.851292 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:11:24.851292 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:11:24.853501 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 307/602] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 15 12:11:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:24.859874 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc6aa86-a68a-44ce-8f1c-8da6550c5369 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:24.882444 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b4a1c0-9607-488f-98d4-153fc3f3c572 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:24.896623 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:24.921930 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c99f78b-1017-4945-b834-85174f6bb6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:24.922584 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c99f78b-1017-4945-b834-85174f6bb6f5 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:24.922903 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c99f78b-1017-4945-b834-85174f6bb6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:24.923145 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c99f78b-1017-4945-b834-85174f6bb6f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:24.931622 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c99f78b-1017-4945-b834-85174f6bb6f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:24.933185 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c99f78b-1017-4945-b834-85174f6bb6f5 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:24.946379 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-4c99f78b-1017-4945-b834-85174f6bb6f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:11:24.946379 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:24.946379 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:24.946379 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:24.946379 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:24.946379 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:24.946379 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:24.946379 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:24.946379 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:24.946379 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:24.946379 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:24.946379 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:24.946379 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 12:11:24.946379 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 12:11:24.946379 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 12:11:24.947429 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 12:11:24.947429 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:24.947429 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:24.947429 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:24.947429 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:24.947429 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:24.947429 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:24.947429 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:24.947429 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:24.947429 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:24.947429 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:24.947429 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:24.947429 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:24.947429 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:24.947429 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:24.947429 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:24.947429 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:24.948311 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 12:11:24.948311 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 12:11:24.948311 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 12:11:24.948311 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 12:11:24.948311 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 12:11:24.948311 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 12:11:24.948311 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:11:24.948311 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:24.953421 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 296/603] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 15 12:11:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:24.954671 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c99f78b-1017-4945-b834-85174f6bb6f5 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:24.985700 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:25.026567 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc6aa86-a68a-44ce-8f1c-8da6550c5369 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:25.094875 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34437f0-24e7-4e83-9c8b-8fa9ddbba169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:25.095473 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34437f0-24e7-4e83-9c8b-8fa9ddbba169 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:25.095748 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34437f0-24e7-4e83-9c8b-8fa9ddbba169 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:25.096011 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34437f0-24e7-4e83-9c8b-8fa9ddbba169 None admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:25.096696 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34437f0-24e7-4e83-9c8b-8fa9ddbba169 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:25.096995 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34437f0-24e7-4e83-9c8b-8fa9ddbba169 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:25.098515 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34437f0-24e7-4e83-9c8b-8fa9ddbba169 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:25.113051 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 308/604] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Sep 15 12:11:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:25.118635 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34437f0-24e7-4e83-9c8b-8fa9ddbba169 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:25.155757 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c99f78b-1017-4945-b834-85174f6bb6f5 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:25.227598 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412d4297-d873-4e0c-b821-37be80b35e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:25.230578 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412d4297-d873-4e0c-b821-37be80b35e56 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:25.230896 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412d4297-d873-4e0c-b821-37be80b35e56 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:25.231172 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412d4297-d873-4e0c-b821-37be80b35e56 None admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:25.232157 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412d4297-d873-4e0c-b821-37be80b35e56 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:25.232470 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412d4297-d873-4e0c-b821-37be80b35e56 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:25.234455 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412d4297-d873-4e0c-b821-37be80b35e56 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:25.258083 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 297/605] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Sep 15 12:11:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:11:25.259415 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a572236-c097-4246-a30c-718efc7fb9a8 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:25.259707 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a572236-c097-4246-a30c-718efc7fb9a8 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:25.259984 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a572236-c097-4246-a30c-718efc7fb9a8 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:25.265228 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 298/606] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:11:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:11:25.265228 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a572236-c097-4246-a30c-718efc7fb9a8 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:25.266922 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:25.284588 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34437f0-24e7-4e83-9c8b-8fa9ddbba169 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:25.323736 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fadd9f2-db98-46ee-a2ea-d838f84787dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:25.324393 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fadd9f2-db98-46ee-a2ea-d838f84787dc None admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:25.324670 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fadd9f2-db98-46ee-a2ea-d838f84787dc None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:25.324939 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fadd9f2-db98-46ee-a2ea-d838f84787dc None admin] PATH_INFO: `/v3/projects/cab958c081ad4a92939d4469cf4ce1c6/users/4003dbcee8104aa4a7ce90251bab88a2/roles/9c9f10110e12479bb6b3b630dd6412b8` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:25.342922 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fadd9f2-db98-46ee-a2ea-d838f84787dc None admin] RBAC: Authorizing `identity:create_grant(project_id=cab958c081ad4a92939d4469cf4ce1c6, user_id=4003dbcee8104aa4a7ce90251bab88a2, role_id=9c9f10110e12479bb6b3b630dd6412b8)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:25.344709 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fadd9f2-db98-46ee-a2ea-d838f84787dc None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:25.359604 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:25.366239 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 309/607] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Sep 15 12:11:25 2022] PUT /identity/v3/projects/cab958c081ad4a92939d4469cf4ce1c6/users/4003dbcee8104aa4a7ce90251bab88a2/roles/9c9f10110e12479bb6b3b630dd6412b8 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:11:25.367738 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5111cd-aae8-44ce-be5a-833dbd6b4775 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:25.368241 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5111cd-aae8-44ce-be5a-833dbd6b4775 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:25.368723 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5111cd-aae8-44ce-be5a-833dbd6b4775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:25.392102 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-5b5111cd-aae8-44ce-be5a-833dbd6b4775 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:11:25.393933 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-5b5111cd-aae8-44ce-be5a-833dbd6b4775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:11:25.413650 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a572236-c097-4246-a30c-718efc7fb9a8 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:25.482152 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 310/608] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:11:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:11:25.486645 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c519bf-0a64-4add-a635-3c1656a93311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:25.486645 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c519bf-0a64-4add-a635-3c1656a93311 None admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:25.486645 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c519bf-0a64-4add-a635-3c1656a93311 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:25.486645 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c519bf-0a64-4add-a635-3c1656a93311 None admin] PATH_INFO: `/v3/projects/cab958c081ad4a92939d4469cf4ce1c6/users/ceafc5e4283841528053f01931f10293/roles/9c9f10110e12479bb6b3b630dd6412b8` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:25.511766 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c519bf-0a64-4add-a635-3c1656a93311 None admin] RBAC: Authorizing `identity:create_grant(project_id=cab958c081ad4a92939d4469cf4ce1c6, user_id=ceafc5e4283841528053f01931f10293, role_id=9c9f10110e12479bb6b3b630dd6412b8)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:25.513292 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c519bf-0a64-4add-a635-3c1656a93311 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:25.540212 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 299/609] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Sep 15 12:11:25 2022] PUT /identity/v3/projects/cab958c081ad4a92939d4469cf4ce1c6/users/ceafc5e4283841528053f01931f10293/roles/9c9f10110e12479bb6b3b630dd6412b8 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:11:25.782307 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5111cd-aae8-44ce-be5a-833dbd6b4775 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:25.849999 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:25.889322 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5111cd-aae8-44ce-be5a-833dbd6b4775 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:25.925376 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e638d1d0-fe05-4d2c-8758-8922ebb68e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:25.926378 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638d1d0-fe05-4d2c-8758-8922ebb68e87 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:25.926900 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638d1d0-fe05-4d2c-8758-8922ebb68e87 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:25.927401 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638d1d0-fe05-4d2c-8758-8922ebb68e87 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:25.938195 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e638d1d0-fe05-4d2c-8758-8922ebb68e87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:11:25.943269 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-e638d1d0-fe05-4d2c-8758-8922ebb68e87 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 12:11:25.943269 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:25.943269 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:25.943269 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:25.943269 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:25.943269 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:25.943269 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:25.943269 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:25.943269 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:25.943269 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:25.943269 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:25.943269 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:25.943269 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:11:25.943269 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:11:25.943269 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:11:25.943269 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:11:25.944195 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:11:25.944195 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:11:25.944195 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:11:25.944195 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:11:25.944195 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:25.944195 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:25.944195 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:25.944195 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:25.944195 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:25.944195 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:25.944195 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:25.944195 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:25.944195 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:25.944195 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:25.944195 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:25.944195 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:25.945035 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:25.945035 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:25.945035 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:25.945035 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:25.945035 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:11:25.945035 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:11:25.945035 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:11:25.945035 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:11:25.945035 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:11:25.945035 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:11:25.945035 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 12:11:25.945035 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:11:25.947637 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 311/610] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Sep 15 12:11:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:25.954036 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c519bf-0a64-4add-a635-3c1656a93311 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:26.060749 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c519bf-0a64-4add-a635-3c1656a93311 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:26.089417 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:26.098395 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183e6fbd-5e63-4765-b772-ba453f5e1a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:26.099038 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e6fbd-5e63-4765-b772-ba453f5e1a80 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:26.099318 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e6fbd-5e63-4765-b772-ba453f5e1a80 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:26.099591 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e6fbd-5e63-4765-b772-ba453f5e1a80 None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:26.100261 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183e6fbd-5e63-4765-b772-ba453f5e1a80 None admin] RBAC: Adding query filter params (name=service) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:26.100564 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183e6fbd-5e63-4765-b772-ba453f5e1a80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:26.101951 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183e6fbd-5e63-4765-b772-ba453f5e1a80 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:26.111283 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 300/611] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Sep 15 12:11:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:26.116853 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e638d1d0-fe05-4d2c-8758-8922ebb68e87 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:26.224296 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e638d1d0-fe05-4d2c-8758-8922ebb68e87 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:26.253546 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:26.262426 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8057d50-f93a-4337-934b-9082919aedd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:26.263092 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8057d50-f93a-4337-934b-9082919aedd3 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:26.263763 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8057d50-f93a-4337-934b-9082919aedd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:26.264387 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8057d50-f93a-4337-934b-9082919aedd3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:26.274880 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068fbad8-15c9-42c1-b46e-8bc46cdb89e3 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:26.275356 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068fbad8-15c9-42c1-b46e-8bc46cdb89e3 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:26.275464 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068fbad8-15c9-42c1-b46e-8bc46cdb89e3 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:26.275939 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8057d50-f93a-4337-934b-9082919aedd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:26.277008 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 301/612] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:11:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:11:26.277390 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8057d50-f93a-4337-934b-9082919aedd3 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:26.283938 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701cdab7-795b-43d2-bfad-df5a318f24a6 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:26.284249 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701cdab7-795b-43d2-bfad-df5a318f24a6 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:26.284479 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701cdab7-795b-43d2-bfad-df5a318f24a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:26.293102 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-a8057d50-f93a-4337-934b-9082919aedd3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:26.293102 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:26.293102 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:26.293102 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:26.293102 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:26.293102 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:26.293102 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:26.293102 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:26.293102 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:26.293102 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:26.293102 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:26.293102 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:26.293102 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:11:26.293102 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:11:26.293102 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:11:26.293102 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:11:26.294086 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:26.294086 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:26.294086 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:26.294086 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:26.294086 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:26.294086 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:26.294086 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:26.294086 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:26.294086 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:26.294086 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:26.294086 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:26.294086 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:26.294086 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:26.294086 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:26.294086 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:26.294086 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:26.294086 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:11:26.295037 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:11:26.295037 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:26.295037 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:11:26.295037 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 312/613] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:11:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:26.299909 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8057d50-f93a-4337-934b-9082919aedd3 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:26.331451 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-701cdab7-795b-43d2-bfad-df5a318f24a6 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:11:26.332553 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-701cdab7-795b-43d2-bfad-df5a318f24a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:11:26.410370 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8057d50-f93a-4337-934b-9082919aedd3 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:26.446779 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ba3b7f-d454-4e8c-a624-9f793063e3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:26.447540 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba3b7f-d454-4e8c-a624-9f793063e3d6 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:26.447819 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba3b7f-d454-4e8c-a624-9f793063e3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:26.448091 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba3b7f-d454-4e8c-a624-9f793063e3d6 None admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:26.448734 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ba3b7f-d454-4e8c-a624-9f793063e3d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:26.449036 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ba3b7f-d454-4e8c-a624-9f793063e3d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:26.450400 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ba3b7f-d454-4e8c-a624-9f793063e3d6 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:26.463583 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 313/614] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 15 12:11:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:11:26.469131 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ba3b7f-d454-4e8c-a624-9f793063e3d6 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:26.506923 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:26.544877 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 302/615] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:11:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 12:11:26.576698 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ba3b7f-d454-4e8c-a624-9f793063e3d6 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:26.611749 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3669d38f-14d5-49b9-9e4c-c843af00c72e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:26.612614 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669d38f-14d5-49b9-9e4c-c843af00c72e None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:26.612900 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669d38f-14d5-49b9-9e4c-c843af00c72e None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:26.613176 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669d38f-14d5-49b9-9e4c-c843af00c72e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:26.620694 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3669d38f-14d5-49b9-9e4c-c843af00c72e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:26.622330 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3669d38f-14d5-49b9-9e4c-c843af00c72e None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:26.635535 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-3669d38f-14d5-49b9-9e4c-c843af00c72e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 15 12:11:26.635535 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:26.635535 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:26.635535 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:26.635535 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:26.635535 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:26.635535 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:26.635535 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:26.635535 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:26.635535 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:26.635535 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:26.635535 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:26.635535 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 12:11:26.635535 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 12:11:26.635535 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 12:11:26.635535 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 12:11:26.636527 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:26.636527 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:26.636527 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 12:11:26.636527 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:11:26.636527 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 12:11:26.636527 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:11:26.636527 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:26.636527 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:26.636527 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:26.636527 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:26.636527 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:26.636527 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:26.636527 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:26.636527 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:26.636527 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:26.636527 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:26.636527 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:26.636527 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:26.637467 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:26.637467 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:26.637467 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 12:11:26.637467 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 12:11:26.637467 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 12:11:26.637467 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 12:11:26.637467 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 12:11:26.637467 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 12:11:26.637467 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 15 12:11:26.637467 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:11:26.637467 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 314/616] 10.222.0.16 () {56 vars in 1093 bytes} [Thu Sep 15 12:11:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:11:26.642511 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701cdab7-795b-43d2-bfad-df5a318f24a6 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:26.788493 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701cdab7-795b-43d2-bfad-df5a318f24a6 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:26.818190 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:26.834914 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04d5918-19c8-42af-8841-aab2911695f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:26.835532 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d5918-19c8-42af-8841-aab2911695f9 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:26.835805 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d5918-19c8-42af-8841-aab2911695f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:26.836071 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d5918-19c8-42af-8841-aab2911695f9 None admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:26.836802 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04d5918-19c8-42af-8841-aab2911695f9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:26.837100 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04d5918-19c8-42af-8841-aab2911695f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:26.838519 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04d5918-19c8-42af-8841-aab2911695f9 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:26.864361 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 303/617] 10.222.0.16 () {56 vars in 1133 bytes} [Thu Sep 15 12:11:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:26.869349 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3669d38f-14d5-49b9-9e4c-c843af00c72e None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:26.901171 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04d5918-19c8-42af-8841-aab2911695f9 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:27.000263 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3669d38f-14d5-49b9-9e4c-c843af00c72e None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:27.002481 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04d5918-19c8-42af-8841-aab2911695f9 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:27.003019 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:27.036438 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9365d94-42f2-4f6c-aeee-e67ad3f18240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:27.037047 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9365d94-42f2-4f6c-aeee-e67ad3f18240 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:27.037331 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9365d94-42f2-4f6c-aeee-e67ad3f18240 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:27.037607 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9365d94-42f2-4f6c-aeee-e67ad3f18240 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:27.054179 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3025bf-e4bc-462b-93a5-43a8fd1975a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:27.054904 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3025bf-e4bc-462b-93a5-43a8fd1975a9 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:27.055183 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3025bf-e4bc-462b-93a5-43a8fd1975a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:27.055450 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3025bf-e4bc-462b-93a5-43a8fd1975a9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:27.066247 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3025bf-e4bc-462b-93a5-43a8fd1975a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:11:27.070937 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-ec3025bf-e4bc-462b-93a5-43a8fd1975a9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 12:11:27.070937 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:27.070937 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:27.070937 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:27.070937 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:27.070937 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:27.070937 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:27.070937 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:27.070937 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:27.070937 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:27.070937 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:27.070937 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:27.070937 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:11:27.070937 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:11:27.070937 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:11:27.070937 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:11:27.071903 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:11:27.071903 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:11:27.071903 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:11:27.071903 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:11:27.071903 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:27.071903 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:27.071903 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:27.071903 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:27.071903 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:27.071903 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:27.071903 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:27.071903 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:27.071903 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:27.071903 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:27.071903 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:27.071903 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:27.072830 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:27.072830 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:27.072830 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:27.072830 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:27.072830 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:11:27.072830 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:11:27.072830 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:11:27.072830 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:11:27.072830 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:11:27.072830 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:11:27.072830 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 12:11:27.072830 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:27.072830 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 304/618] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Sep 15 12:11:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:11:27.078435 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3025bf-e4bc-462b-93a5-43a8fd1975a9 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:27.116505 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9365d94-42f2-4f6c-aeee-e67ad3f18240 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:27.118373 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:27.119178 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9365d94-42f2-4f6c-aeee-e67ad3f18240 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:27.214470 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3025bf-e4bc-462b-93a5-43a8fd1975a9 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:27.259446 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:27.267626 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46952415-514b-4b8a-be59-4c9254f6516d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:27.268243 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46952415-514b-4b8a-be59-4c9254f6516d None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:27.268504 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46952415-514b-4b8a-be59-4c9254f6516d None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:27.268772 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46952415-514b-4b8a-be59-4c9254f6516d None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:27.269446 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46952415-514b-4b8a-be59-4c9254f6516d None admin] RBAC: Adding query filter params (name=service) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:27.269744 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46952415-514b-4b8a-be59-4c9254f6516d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:27.273625 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 315/619] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 15 12:11:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 12:11:27.273962 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46952415-514b-4b8a-be59-4c9254f6516d None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:27.278736 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9365d94-42f2-4f6c-aeee-e67ad3f18240 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:27.290147 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 305/620] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Sep 15 12:11:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:11:27.298675 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46952415-514b-4b8a-be59-4c9254f6516d None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:27.392302 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9365d94-42f2-4f6c-aeee-e67ad3f18240 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:27.407945 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:27.411706 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46952415-514b-4b8a-be59-4c9254f6516d None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:27.434226 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb874ea-2e36-4bcc-9089-554033ceabeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:27.434964 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb874ea-2e36-4bcc-9089-554033ceabeb None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:27.435380 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb874ea-2e36-4bcc-9089-554033ceabeb None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:27.435733 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb874ea-2e36-4bcc-9089-554033ceabeb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:27.450023 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb874ea-2e36-4bcc-9089-554033ceabeb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:27.451575 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb874ea-2e36-4bcc-9089-554033ceabeb None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:27.454280 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd91c417-0c8b-4068-bee9-14aa8761444a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:27.455181 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd91c417-0c8b-4068-bee9-14aa8761444a None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:27.455687 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd91c417-0c8b-4068-bee9-14aa8761444a None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:27.456160 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd91c417-0c8b-4068-bee9-14aa8761444a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:27.467324 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd91c417-0c8b-4068-bee9-14aa8761444a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:27.468949 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-bbb874ea-2e36-4bcc-9089-554033ceabeb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:27.468949 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:27.468949 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:27.468949 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:27.468949 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:27.468949 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:27.468949 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:27.468949 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:27.468949 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:27.468949 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:27.468949 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:27.468949 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:27.468949 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:11:27.468949 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:11:27.468949 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:11:27.468949 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:11:27.469861 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:27.469861 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:27.469861 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:27.469861 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:27.469861 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:27.469861 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:27.469861 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:27.469861 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:27.469861 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:27.469861 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:27.469861 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:27.469861 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:27.469861 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:27.469861 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:27.469861 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:27.469861 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:27.469861 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:11:27.470806 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:11:27.470806 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:27.470806 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:11:27.470806 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 316/621] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:11:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:11:27.471587 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31326bc3-ddc7-4887-8751-9009d40890d2 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:27.471863 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31326bc3-ddc7-4887-8751-9009d40890d2 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:27.472130 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31326bc3-ddc7-4887-8751-9009d40890d2 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:27.473083 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd91c417-0c8b-4068-bee9-14aa8761444a None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:27.477488 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 317/622] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:11:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:11:27.477488 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31326bc3-ddc7-4887-8751-9009d40890d2 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:27.492943 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-bd91c417-0c8b-4068-bee9-14aa8761444a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:27.492943 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:27.492943 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:27.492943 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:27.492943 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:27.492943 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:27.492943 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:27.492943 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:27.492943 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:27.492943 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:27.492943 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:27.492943 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:27.492943 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:11:27.492943 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:11:27.492943 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:11:27.492943 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:11:27.493894 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:27.493894 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:27.493894 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:27.493894 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:27.493894 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:27.493894 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:27.493894 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:27.493894 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:27.493894 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:27.493894 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:27.493894 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:27.493894 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:27.493894 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:27.493894 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:27.493894 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:27.493894 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:27.493894 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:11:27.494821 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:11:27.494821 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:27.494821 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:27.500455 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 306/623] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:11:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:27.500455 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8221a71e-13d8-4240-b4f4-130f749a56d9 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:27.500455 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8221a71e-13d8-4240-b4f4-130f749a56d9 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:27.500455 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8221a71e-13d8-4240-b4f4-130f749a56d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:27.518925 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-8221a71e-13d8-4240-b4f4-130f749a56d9 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:11:27.520223 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-8221a71e-13d8-4240-b4f4-130f749a56d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:11:27.540651 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:27.599312 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 307/624] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:11:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:11:27.603715 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8221a71e-13d8-4240-b4f4-130f749a56d9 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:27.611641 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31326bc3-ddc7-4887-8751-9009d40890d2 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:27.653946 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a17d8-132f-4b59-a66f-b71c75b8f767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:27.655043 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a17d8-132f-4b59-a66f-b71c75b8f767 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:27.656467 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a17d8-132f-4b59-a66f-b71c75b8f767 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:27.656884 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a17d8-132f-4b59-a66f-b71c75b8f767 None admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:27.658493 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954a17d8-132f-4b59-a66f-b71c75b8f767 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:27.660008 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954a17d8-132f-4b59-a66f-b71c75b8f767 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:27.663680 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954a17d8-132f-4b59-a66f-b71c75b8f767 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:27.690098 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 318/625] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 15 12:11:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:27.692646 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a17d8-132f-4b59-a66f-b71c75b8f767 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:27.772171 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:27.809609 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8221a71e-13d8-4240-b4f4-130f749a56d9 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:27.812698 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a17d8-132f-4b59-a66f-b71c75b8f767 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:27.823859 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:27.853938 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9939a151-6647-49db-be85-bc608727b6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:27.854979 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939a151-6647-49db-be85-bc608727b6e3 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:27.855453 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939a151-6647-49db-be85-bc608727b6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:27.855928 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939a151-6647-49db-be85-bc608727b6e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:27.864112 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9939a151-6647-49db-be85-bc608727b6e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:27.866431 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9939a151-6647-49db-be85-bc608727b6e3 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:27.878783 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-9939a151-6647-49db-be85-bc608727b6e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:11:27.878783 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:27.878783 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:27.878783 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:27.878783 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:27.878783 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:27.878783 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:27.878783 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:27.878783 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:27.878783 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:27.878783 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:27.878783 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:27.878783 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 12:11:27.878783 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 12:11:27.878783 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 12:11:27.879702 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 12:11:27.879702 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:27.879702 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:27.879702 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:27.879702 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:27.879702 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:27.879702 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:27.879702 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:27.879702 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:27.879702 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:27.879702 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:27.879702 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:27.879702 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:27.879702 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:27.879702 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:27.879702 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:27.879702 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:27.880574 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 12:11:27.880574 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 12:11:27.880574 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 12:11:27.880574 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 12:11:27.880574 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 12:11:27.880574 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 12:11:27.880574 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:11:27.880574 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:11:27.881008 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be1ed6c-3f35-45fc-8118-21bf19ca632a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:27.881008 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be1ed6c-3f35-45fc-8118-21bf19ca632a None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:27.881008 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be1ed6c-3f35-45fc-8118-21bf19ca632a None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:27.881008 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be1ed6c-3f35-45fc-8118-21bf19ca632a None admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:27.881270 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be1ed6c-3f35-45fc-8118-21bf19ca632a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:27.881270 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be1ed6c-3f35-45fc-8118-21bf19ca632a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:27.882672 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be1ed6c-3f35-45fc-8118-21bf19ca632a None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:27.883615 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 319/626] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 15 12:11:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:27.892011 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9939a151-6647-49db-be85-bc608727b6e3 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:27.906817 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 308/627] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 15 12:11:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:27.912310 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be1ed6c-3f35-45fc-8118-21bf19ca632a None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:28.064298 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be1ed6c-3f35-45fc-8118-21bf19ca632a None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:28.066245 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9939a151-6647-49db-be85-bc608727b6e3 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:28.109857 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a3e456-c4e6-4a54-9d3d-d2e96c6fe358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:28.110525 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a3e456-c4e6-4a54-9d3d-d2e96c6fe358 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:28.110844 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a3e456-c4e6-4a54-9d3d-d2e96c6fe358 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:28.111116 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a3e456-c4e6-4a54-9d3d-d2e96c6fe358 None admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:28.111835 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a3e456-c4e6-4a54-9d3d-d2e96c6fe358 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:28.112208 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a3e456-c4e6-4a54-9d3d-d2e96c6fe358 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:28.112890 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294b3e6a-80e9-45b0-bdf6-a5a6c46b7e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:28.113768 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b3e6a-80e9-45b0-bdf6-a5a6c46b7e58 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:28.113895 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a3e456-c4e6-4a54-9d3d-d2e96c6fe358 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:28.114362 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b3e6a-80e9-45b0-bdf6-a5a6c46b7e58 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:28.114871 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b3e6a-80e9-45b0-bdf6-a5a6c46b7e58 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:28.126680 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294b3e6a-80e9-45b0-bdf6-a5a6c46b7e58 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:28.128895 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294b3e6a-80e9-45b0-bdf6-a5a6c46b7e58 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:28.129711 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 320/628] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Sep 15 12:11:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:28.130631 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a3e456-c4e6-4a54-9d3d-d2e96c6fe358 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:28.146598 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-294b3e6a-80e9-45b0-bdf6-a5a6c46b7e58 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 15 12:11:28.146598 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:28.146598 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:28.146598 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:28.146598 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:28.146598 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:28.146598 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:28.146598 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:28.146598 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:28.146598 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:28.146598 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:28.146598 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:28.146598 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 12:11:28.146598 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 12:11:28.146598 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 12:11:28.146598 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 12:11:28.147663 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:28.147663 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:28.147663 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 12:11:28.147663 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:11:28.147663 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 12:11:28.147663 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:11:28.147663 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:28.147663 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:28.147663 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:28.147663 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:28.147663 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:28.147663 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:28.147663 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:28.147663 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:28.147663 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:28.147663 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:28.147663 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:28.147663 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:28.148612 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:28.148612 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:28.148612 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 12:11:28.148612 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 12:11:28.148612 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 12:11:28.148612 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 12:11:28.148612 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 12:11:28.148612 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 12:11:28.148612 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 15 12:11:28.148612 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:28.151590 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 309/629] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Sep 15 12:11:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:28.152757 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294b3e6a-80e9-45b0-bdf6-a5a6c46b7e58 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:28.157439 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:28.176130 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:28.256982 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a3e456-c4e6-4a54-9d3d-d2e96c6fe358 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:28.277649 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294b3e6a-80e9-45b0-bdf6-a5a6c46b7e58 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:28.291738 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c844a5-ad43-4730-b3dd-7c8cd5199ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:28.292358 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c844a5-ad43-4730-b3dd-7c8cd5199ad8 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:28.292634 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c844a5-ad43-4730-b3dd-7c8cd5199ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:28.292902 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c844a5-ad43-4730-b3dd-7c8cd5199ad8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:28.302961 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c844a5-ad43-4730-b3dd-7c8cd5199ad8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:11:28.307665 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-f1c844a5-ad43-4730-b3dd-7c8cd5199ad8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 12:11:28.307665 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:28.307665 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:28.307665 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:28.307665 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:28.307665 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:28.307665 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:28.307665 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:28.307665 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:28.307665 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:28.307665 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:28.307665 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:28.307665 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:11:28.307665 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:11:28.307665 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:11:28.307665 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:11:28.308621 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:11:28.308621 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:11:28.308621 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:11:28.308621 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:11:28.308621 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:28.308621 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:28.308621 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:28.308621 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:28.308621 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:28.308621 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:28.308621 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:28.308621 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:28.308621 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:28.308621 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:28.308621 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:28.308621 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:28.309449 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:28.309449 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:28.309449 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:28.309449 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:28.309449 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:11:28.309449 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:11:28.309449 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:11:28.309449 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:11:28.309449 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:11:28.309449 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:11:28.309449 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 12:11:28.309449 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:11:28.309449 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 321/630] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Sep 15 12:11:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:28.310478 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c844a5-ad43-4730-b3dd-7c8cd5199ad8 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:28.311594 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85377769-fd54-48a8-89dd-2948e07ab0b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:28.312233 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85377769-fd54-48a8-89dd-2948e07ab0b6 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:28.312573 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85377769-fd54-48a8-89dd-2948e07ab0b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:28.312855 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85377769-fd54-48a8-89dd-2948e07ab0b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:28.313860 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85377769-fd54-48a8-89dd-2948e07ab0b6 None admin] RBAC: Adding query filter params (role.id=9c9f10110e12479bb6b3b630dd6412b8, scope.project.id=cab958c081ad4a92939d4469cf4ce1c6, user.id=9d05c52570474820b4ba0e2cdad5c13f) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:28.314173 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85377769-fd54-48a8-89dd-2948e07ab0b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:28.315629 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85377769-fd54-48a8-89dd-2948e07ab0b6 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:28.321358 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 310/631] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 15 12:11:28 2022] GET /identity/v3/role_assignments?user.id=9d05c52570474820b4ba0e2cdad5c13f&scope.project.id=cab958c081ad4a92939d4469cf4ce1c6&role.id=9c9f10110e12479bb6b3b630dd6412b8 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:28.322525 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec92fa-25c3-4801-b96a-0e3023282680 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:28.322836 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec92fa-25c3-4801-b96a-0e3023282680 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:28.323108 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec92fa-25c3-4801-b96a-0e3023282680 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:28.324289 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 311/632] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:11:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:11:28.325308 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6aa90e-2c1d-4870-bf72-3ddc9fb2cfbb None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:28.325590 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6aa90e-2c1d-4870-bf72-3ddc9fb2cfbb None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:28.325862 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6aa90e-2c1d-4870-bf72-3ddc9fb2cfbb None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:28.330732 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 312/633] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:11:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:11:28.330732 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6aa90e-2c1d-4870-bf72-3ddc9fb2cfbb None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:28.409355 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:28.419379 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:28.434119 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c844a5-ad43-4730-b3dd-7c8cd5199ad8 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:28.453514 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6aa90e-2c1d-4870-bf72-3ddc9fb2cfbb None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:28.490847 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c710af-9bf8-4af1-96d3-e10817087faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:28.491848 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c710af-9bf8-4af1-96d3-e10817087faa None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:28.491982 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c69893-6714-4e04-8a91-2881aceb3b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:28.492253 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c710af-9bf8-4af1-96d3-e10817087faa None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:28.492482 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c69893-6714-4e04-8a91-2881aceb3b43 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:28.492651 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c710af-9bf8-4af1-96d3-e10817087faa None admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:28.492747 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c69893-6714-4e04-8a91-2881aceb3b43 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:28.493022 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c69893-6714-4e04-8a91-2881aceb3b43 None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:28.493684 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c69893-6714-4e04-8a91-2881aceb3b43 None admin] RBAC: Adding query filter params (name=service) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:28.493814 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c710af-9bf8-4af1-96d3-e10817087faa None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:28.493983 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c69893-6714-4e04-8a91-2881aceb3b43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:28.494229 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c710af-9bf8-4af1-96d3-e10817087faa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:28.495392 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c69893-6714-4e04-8a91-2881aceb3b43 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:28.496690 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c710af-9bf8-4af1-96d3-e10817087faa None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:28.506340 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 313/634] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Sep 15 12:11:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:28.507561 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0831a2c-e847-4f6f-9cc2-e10c3a24373d None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:28.507842 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0831a2c-e847-4f6f-9cc2-e10c3a24373d None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:28.508156 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0831a2c-e847-4f6f-9cc2-e10c3a24373d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:28.522941 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 322/635] 10.222.0.16 () {56 vars in 1135 bytes} [Thu Sep 15 12:11:28 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:28.524211 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabeb394-914b-4806-aca0-dd20bccbb61f None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:28.524546 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabeb394-914b-4806-aca0-dd20bccbb61f None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:28.524899 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabeb394-914b-4806-aca0-dd20bccbb61f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:28.530948 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-a0831a2c-e847-4f6f-9cc2-e10c3a24373d None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:11:28.532138 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-a0831a2c-e847-4f6f-9cc2-e10c3a24373d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:11:28.545585 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-aabeb394-914b-4806-aca0-dd20bccbb61f None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:11:28.546833 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-aabeb394-914b-4806-aca0-dd20bccbb61f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:11:28.609772 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 314/636] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:11:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:11:28.610959 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0831a2c-e847-4f6f-9cc2-e10c3a24373d None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:28.630820 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 323/637] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:11:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:11:28.632004 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabeb394-914b-4806-aca0-dd20bccbb61f None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:28.680695 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:28.729984 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0831a2c-e847-4f6f-9cc2-e10c3a24373d None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:28.769598 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a5ed83-651d-41dd-bd30-15d879bc009d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:28.770377 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5ed83-651d-41dd-bd30-15d879bc009d None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:28.770781 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5ed83-651d-41dd-bd30-15d879bc009d None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:28.771150 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5ed83-651d-41dd-bd30-15d879bc009d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:28.783662 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a5ed83-651d-41dd-bd30-15d879bc009d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:28.786113 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a5ed83-651d-41dd-bd30-15d879bc009d None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:28.801090 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:28.805021 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-e5a5ed83-651d-41dd-bd30-15d879bc009d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:28.805021 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:28.805021 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:28.805021 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:28.805021 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:28.805021 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:28.805021 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:28.805021 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:28.805021 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:28.805021 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:28.805021 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:28.805021 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:28.805021 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:11:28.805021 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:11:28.805021 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:11:28.805021 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:11:28.806155 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:28.806155 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:28.806155 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:28.806155 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:28.806155 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:28.806155 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:28.806155 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:28.806155 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:28.806155 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:28.806155 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:28.806155 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:28.806155 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:28.806155 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:28.806155 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:28.806155 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:28.806155 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:28.806155 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:11:28.807424 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:11:28.807424 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:28.807424 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:28.808962 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 315/638] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:11:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:28.816095 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a5ed83-651d-41dd-bd30-15d879bc009d None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:28.869556 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabeb394-914b-4806-aca0-dd20bccbb61f None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:28.931635 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a5ed83-651d-41dd-bd30-15d879bc009d None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:28.943403 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:28.943551 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3962ed36-b8ea-454e-a265-a13244c5b199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:28.944133 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3962ed36-b8ea-454e-a265-a13244c5b199 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:28.944464 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3962ed36-b8ea-454e-a265-a13244c5b199 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:28.944739 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3962ed36-b8ea-454e-a265-a13244c5b199 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:28.960842 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3962ed36-b8ea-454e-a265-a13244c5b199 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:28.963713 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3962ed36-b8ea-454e-a265-a13244c5b199 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:28.972705 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cab599d-2a38-4890-be07-9602e1e8f861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:28.973542 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cab599d-2a38-4890-be07-9602e1e8f861 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:28.974001 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cab599d-2a38-4890-be07-9602e1e8f861 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:28.974452 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cab599d-2a38-4890-be07-9602e1e8f861 None admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:28.975372 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cab599d-2a38-4890-be07-9602e1e8f861 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:28.975861 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cab599d-2a38-4890-be07-9602e1e8f861 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:28.977418 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cab599d-2a38-4890-be07-9602e1e8f861 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:28.987465 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-3962ed36-b8ea-454e-a265-a13244c5b199 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:28.987465 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:28.987465 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:28.987465 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:28.987465 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:28.987465 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:28.987465 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:28.987465 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:28.987465 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:28.987465 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:28.987465 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:28.987465 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:28.987465 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:11:28.987465 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:11:28.987465 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:11:28.987465 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:11:28.988723 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:28.988723 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:28.988723 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:28.988723 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:28.988723 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:28.988723 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:28.988723 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:28.988723 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:28.988723 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:28.988723 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:28.988723 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:28.988723 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:28.988723 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:28.988723 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:28.988723 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:28.988723 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:28.988723 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:11:28.989823 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:11:28.989823 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:28.989823 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:11:28.990178 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 324/639] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:11:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:28.993358 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3962ed36-b8ea-454e-a265-a13244c5b199 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:28.996976 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 316/640] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 15 12:11:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:28.996976 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cab599d-2a38-4890-be07-9602e1e8f861 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:29.100354 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3962ed36-b8ea-454e-a265-a13244c5b199 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:29.101166 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cab599d-2a38-4890-be07-9602e1e8f861 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:29.131186 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:29.136202 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a03da7-cd70-4607-9853-ed72d2b481a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:29.136840 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a03da7-cd70-4607-9853-ed72d2b481a9 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:29.137121 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a03da7-cd70-4607-9853-ed72d2b481a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:29.137391 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a03da7-cd70-4607-9853-ed72d2b481a9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:29.141598 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b508c69a-98ef-4b50-9607-f354d504abb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:29.142458 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b508c69a-98ef-4b50-9607-f354d504abb8 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:29.142951 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b508c69a-98ef-4b50-9607-f354d504abb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:29.143398 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b508c69a-98ef-4b50-9607-f354d504abb8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:29.147864 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a03da7-cd70-4607-9853-ed72d2b481a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:11:29.152687 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-02a03da7-cd70-4607-9853-ed72d2b481a9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 12:11:29.152687 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:29.152687 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:29.152687 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:29.152687 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:29.152687 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:29.152687 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:29.152687 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:29.152687 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:29.152687 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:29.152687 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:29.152687 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:29.152687 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:11:29.152687 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:11:29.152687 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:11:29.152687 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:11:29.153600 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:11:29.153600 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:11:29.153600 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:11:29.153600 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:11:29.153600 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:29.153600 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:29.153600 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:29.153600 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:29.153600 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:29.153600 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:29.153600 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:29.153600 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:29.153600 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:29.153600 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:29.153600 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:29.153600 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:29.154450 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:29.154450 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:29.154450 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:29.154450 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:29.154450 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:11:29.154450 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:11:29.154450 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:11:29.154450 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:11:29.154450 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:11:29.154450 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:11:29.154450 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 12:11:29.154450 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:29.154450 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 317/641] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Sep 15 12:11:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:29.155177 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a03da7-cd70-4607-9853-ed72d2b481a9 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:29.159842 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b508c69a-98ef-4b50-9607-f354d504abb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:11:29.165435 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-b508c69a-98ef-4b50-9607-f354d504abb8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 12:11:29.165435 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:29.165435 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:29.165435 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:29.165435 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:29.165435 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:29.165435 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:29.165435 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:29.165435 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:29.165435 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:29.165435 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:29.165435 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:29.165435 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:11:29.165435 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:11:29.165435 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:11:29.165435 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:11:29.166451 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:11:29.166451 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:11:29.166451 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:11:29.166451 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:11:29.166451 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:29.166451 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:29.166451 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:29.166451 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:29.166451 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:29.166451 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:29.166451 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:29.166451 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:29.166451 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:29.166451 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:29.166451 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:29.166451 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:29.167602 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:29.167602 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:29.167602 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:29.167602 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:29.167602 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:11:29.167602 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:11:29.167602 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:11:29.167602 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:11:29.167602 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:11:29.167602 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:11:29.167602 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 12:11:29.167602 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:11:29.167602 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 325/642] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Sep 15 12:11:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:29.167602 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b508c69a-98ef-4b50-9607-f354d504abb8 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:29.193023 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:29.267348 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a03da7-cd70-4607-9853-ed72d2b481a9 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:29.273838 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b508c69a-98ef-4b50-9607-f354d504abb8 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:29.302534 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9f70fc-7c3a-4175-a018-85eba7b52b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:29.303171 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f70fc-7c3a-4175-a018-85eba7b52b88 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:29.303448 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f70fc-7c3a-4175-a018-85eba7b52b88 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:29.303721 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f70fc-7c3a-4175-a018-85eba7b52b88 None admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:29.304354 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9f70fc-7c3a-4175-a018-85eba7b52b88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:29.304660 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9f70fc-7c3a-4175-a018-85eba7b52b88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:29.306028 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9f70fc-7c3a-4175-a018-85eba7b52b88 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:29.310761 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce57336d-9269-4b05-8979-3efbc69f6b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:29.311555 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce57336d-9269-4b05-8979-3efbc69f6b04 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:29.312012 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce57336d-9269-4b05-8979-3efbc69f6b04 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:29.312935 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce57336d-9269-4b05-8979-3efbc69f6b04 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:29.317122 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 318/643] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 15 12:11:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:29.317923 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9f70fc-7c3a-4175-a018-85eba7b52b88 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:29.322493 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce57336d-9269-4b05-8979-3efbc69f6b04 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:29.324147 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce57336d-9269-4b05-8979-3efbc69f6b04 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:29.336405 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-ce57336d-9269-4b05-8979-3efbc69f6b04 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 15 12:11:29.336405 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:29.336405 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:29.336405 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:29.336405 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:29.336405 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:29.336405 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:29.336405 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:29.336405 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:29.336405 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:29.336405 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:29.336405 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:29.336405 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 12:11:29.336405 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 12:11:29.336405 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 12:11:29.336405 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 12:11:29.337574 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:29.337574 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:29.337574 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 12:11:29.337574 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:11:29.337574 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 12:11:29.337574 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:11:29.337574 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:29.337574 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:29.337574 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:29.337574 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:29.337574 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:29.337574 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:29.337574 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:29.337574 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:29.337574 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:29.337574 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:29.337574 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:29.337574 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:29.338901 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:29.338901 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:29.338901 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 12:11:29.338901 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 12:11:29.338901 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 12:11:29.338901 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 12:11:29.338901 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 12:11:29.338901 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 12:11:29.338901 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 15 12:11:29.338901 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:11:29.345476 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 326/644] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 15 12:11:29 2022] GET /identity/v3/users/glance => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:29.345476 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce57336d-9269-4b05-8979-3efbc69f6b04 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:29.398119 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:29.422811 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:29.434179 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9f70fc-7c3a-4175-a018-85eba7b52b88 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:29.452787 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce57336d-9269-4b05-8979-3efbc69f6b04 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:29.471571 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14956480-1f44-42dc-ad3a-166d2efc9641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:29.472259 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14956480-1f44-42dc-ad3a-166d2efc9641 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:29.472545 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14956480-1f44-42dc-ad3a-166d2efc9641 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:29.472819 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14956480-1f44-42dc-ad3a-166d2efc9641 None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:29.473482 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14956480-1f44-42dc-ad3a-166d2efc9641 None admin] RBAC: Adding query filter params (name=service) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:29.473784 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14956480-1f44-42dc-ad3a-166d2efc9641 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:29.475197 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14956480-1f44-42dc-ad3a-166d2efc9641 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:29.488331 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 319/645] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Sep 15 12:11:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:29.488331 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14956480-1f44-42dc-ad3a-166d2efc9641 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:29.495517 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4b4842-4d45-4838-a809-58bd898ba046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:29.496124 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4b4842-4d45-4838-a809-58bd898ba046 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:29.496703 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4b4842-4d45-4838-a809-58bd898ba046 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:29.496983 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4b4842-4d45-4838-a809-58bd898ba046 None admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:29.497636 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4b4842-4d45-4838-a809-58bd898ba046 None admin] RBAC: Adding query filter params (name=service) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:29.497936 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4b4842-4d45-4838-a809-58bd898ba046 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:29.499339 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4b4842-4d45-4838-a809-58bd898ba046 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:29.512628 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 327/646] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Sep 15 12:11:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:29.512628 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4b4842-4d45-4838-a809-58bd898ba046 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:29.592234 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14956480-1f44-42dc-ad3a-166d2efc9641 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:29.618821 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4b4842-4d45-4838-a809-58bd898ba046 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:29.629015 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb385d-9f65-4d09-8129-0128dd8c459e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:29.629491 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:29.630508 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb385d-9f65-4d09-8129-0128dd8c459e None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:29.630900 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb385d-9f65-4d09-8129-0128dd8c459e None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:29.631242 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb385d-9f65-4d09-8129-0128dd8c459e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:29.639059 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fb385d-9f65-4d09-8129-0128dd8c459e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:29.641202 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fb385d-9f65-4d09-8129-0128dd8c459e None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:29.653748 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-33fb385d-9f65-4d09-8129-0128dd8c459e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:11:29.653748 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:29.653748 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:29.653748 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:29.653748 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:29.653748 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:29.653748 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:29.653748 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:29.653748 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:29.653748 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:29.653748 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:29.653748 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:29.653748 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 12:11:29.653748 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 12:11:29.653748 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 12:11:29.654817 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 12:11:29.654817 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:29.654817 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:29.654817 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:29.654817 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:29.654817 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:29.654817 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:29.654817 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:29.654817 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:29.654817 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:29.654817 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:29.654817 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:29.654817 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:29.654817 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:29.654817 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:29.654817 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:29.654817 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:29.656470 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 12:11:29.656470 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 12:11:29.656470 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 12:11:29.656470 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 12:11:29.656470 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 12:11:29.656470 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 12:11:29.656470 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:11:29.656470 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:29.656932 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe6f314-d116-4b78-a160-f4f16c1110d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:29.657027 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 320/647] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 15 12:11:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:29.657692 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb385d-9f65-4d09-8129-0128dd8c459e None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:29.661703 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe6f314-d116-4b78-a160-f4f16c1110d9 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:29.662087 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe6f314-d116-4b78-a160-f4f16c1110d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:29.662487 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe6f314-d116-4b78-a160-f4f16c1110d9 None admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:29.663078 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe6f314-d116-4b78-a160-f4f16c1110d9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:29.663391 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe6f314-d116-4b78-a160-f4f16c1110d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:29.664832 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe6f314-d116-4b78-a160-f4f16c1110d9 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:29.673175 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:29.687810 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 328/648] 10.222.0.16 () {56 vars in 1137 bytes} [Thu Sep 15 12:11:29 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:29.687810 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe6f314-d116-4b78-a160-f4f16c1110d9 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:29.770655 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb385d-9f65-4d09-8129-0128dd8c459e None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:29.793134 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe6f314-d116-4b78-a160-f4f16c1110d9 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:29.805033 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976c1772-8b67-41db-8a8a-dd44e4f39e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:29.805648 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c1772-8b67-41db-8a8a-dd44e4f39e65 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:29.805923 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c1772-8b67-41db-8a8a-dd44e4f39e65 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:29.806191 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c1772-8b67-41db-8a8a-dd44e4f39e65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:29.817073 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976c1772-8b67-41db-8a8a-dd44e4f39e65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:29.818498 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976c1772-8b67-41db-8a8a-dd44e4f39e65 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:29.829575 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23430e4-55b4-446c-be52-0be69f972a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:29.830292 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23430e4-55b4-446c-be52-0be69f972a32 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:29.830639 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23430e4-55b4-446c-be52-0be69f972a32 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:29.831005 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23430e4-55b4-446c-be52-0be69f972a32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:29.832480 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-976c1772-8b67-41db-8a8a-dd44e4f39e65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:29.832480 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:29.832480 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:29.832480 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:29.832480 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:29.832480 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:29.832480 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:29.832480 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:29.832480 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:29.832480 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:29.832480 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:29.832480 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:29.832480 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:11:29.832480 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:11:29.832480 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:11:29.832480 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:11:29.833556 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:29.833556 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:29.833556 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:29.833556 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:29.833556 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:29.833556 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:29.833556 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:29.833556 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:29.833556 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:29.833556 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:29.833556 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:29.833556 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:29.833556 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:29.833556 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:29.833556 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:29.833556 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:29.833556 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:11:29.834515 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:11:29.834515 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:29.834515 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:29.834515 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 321/649] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:11:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:29.834773 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976c1772-8b67-41db-8a8a-dd44e4f39e65 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:29.846899 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23430e4-55b4-446c-be52-0be69f972a32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:29.848341 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23430e4-55b4-446c-be52-0be69f972a32 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:29.863445 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-a23430e4-55b4-446c-be52-0be69f972a32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:29.863445 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:29.863445 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:29.863445 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:29.863445 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:29.863445 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:29.863445 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:29.863445 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:29.863445 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:29.863445 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:29.863445 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:29.863445 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:29.863445 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:11:29.863445 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:11:29.863445 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:11:29.863445 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:11:29.871162 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:29.871162 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:29.871162 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:29.871162 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:29.871162 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:29.871162 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:29.871162 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:29.871162 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:29.871162 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:29.871162 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:29.871162 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:29.871162 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:29.871162 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:29.871162 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:29.871162 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:29.871162 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:29.871162 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:11:29.872264 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:11:29.872264 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:29.872264 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:11:29.872264 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 329/650] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:11:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:29.872264 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23430e4-55b4-446c-be52-0be69f972a32 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:29.896486 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:29.906719 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:29.946765 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976c1772-8b67-41db-8a8a-dd44e4f39e65 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:29.984776 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f017d6-38e1-4c16-8d73-14e317388f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:29.985493 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f017d6-38e1-4c16-8d73-14e317388f7c None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:29.985866 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f017d6-38e1-4c16-8d73-14e317388f7c None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:29.986261 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f017d6-38e1-4c16-8d73-14e317388f7c None admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:29.987102 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f017d6-38e1-4c16-8d73-14e317388f7c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:29.987503 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f017d6-38e1-4c16-8d73-14e317388f7c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:29.989014 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f017d6-38e1-4c16-8d73-14e317388f7c None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:29.991027 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23430e4-55b4-446c-be52-0be69f972a32 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:30.006951 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 322/651] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Sep 15 12:11:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:30.006951 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f017d6-38e1-4c16-8d73-14e317388f7c None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:30.032443 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6108c78b-fcb4-4b99-8403-f01df2f7bb3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:30.033097 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6108c78b-fcb4-4b99-8403-f01df2f7bb3e None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:30.033448 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6108c78b-fcb4-4b99-8403-f01df2f7bb3e None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:30.033784 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6108c78b-fcb4-4b99-8403-f01df2f7bb3e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:30.105432 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6108c78b-fcb4-4b99-8403-f01df2f7bb3e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:30.106902 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6108c78b-fcb4-4b99-8403-f01df2f7bb3e None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:30.110840 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f017d6-38e1-4c16-8d73-14e317388f7c None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:30.129051 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:30.135434 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:30.148268 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e36466-c571-4043-a072-212de955ea2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:30.148896 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e36466-c571-4043-a072-212de955ea2a None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:30.149222 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e36466-c571-4043-a072-212de955ea2a None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:30.149498 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e36466-c571-4043-a072-212de955ea2a None admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:30.150598 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e36466-c571-4043-a072-212de955ea2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:30.150942 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e36466-c571-4043-a072-212de955ea2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:30.152750 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e36466-c571-4043-a072-212de955ea2a None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:30.168363 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 323/652] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 15 12:11:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:30.174192 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e36466-c571-4043-a072-212de955ea2a None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:30.220694 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 330/653] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 15 12:11:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 12:11:30.220694 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6108c78b-fcb4-4b99-8403-f01df2f7bb3e None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:30.283978 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e36466-c571-4043-a072-212de955ea2a None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:30.318711 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a92cd8c-6235-4817-9081-5908f1a0f067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:30.319364 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a92cd8c-6235-4817-9081-5908f1a0f067 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:30.319597 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a92cd8c-6235-4817-9081-5908f1a0f067 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:30.319870 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a92cd8c-6235-4817-9081-5908f1a0f067 None admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:30.320502 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a92cd8c-6235-4817-9081-5908f1a0f067 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:30.320803 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a92cd8c-6235-4817-9081-5908f1a0f067 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:30.322159 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a92cd8c-6235-4817-9081-5908f1a0f067 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:30.325855 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6108c78b-fcb4-4b99-8403-f01df2f7bb3e None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:30.334102 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 324/654] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 15 12:11:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:30.334926 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a92cd8c-6235-4817-9081-5908f1a0f067 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:30.353775 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:30.369558 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caac7b89-8ff0-48eb-858c-77ae7371427d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:30.370213 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac7b89-8ff0-48eb-858c-77ae7371427d None admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:30.370490 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac7b89-8ff0-48eb-858c-77ae7371427d None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:30.370787 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac7b89-8ff0-48eb-858c-77ae7371427d None admin] PATH_INFO: `/v3/projects/cab958c081ad4a92939d4469cf4ce1c6/users/ee33b730d0ec428ca2cd3af4ebf723e8/roles/9c9f10110e12479bb6b3b630dd6412b8` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:30.382941 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:30.387311 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caac7b89-8ff0-48eb-858c-77ae7371427d None admin] RBAC: Authorizing `identity:create_grant(project_id=cab958c081ad4a92939d4469cf4ce1c6, user_id=ee33b730d0ec428ca2cd3af4ebf723e8, role_id=9c9f10110e12479bb6b3b630dd6412b8)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:30.388824 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caac7b89-8ff0-48eb-858c-77ae7371427d None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:30.402414 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 331/655] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Sep 15 12:11:30 2022] PUT /identity/v3/projects/cab958c081ad4a92939d4469cf4ce1c6/users/ee33b730d0ec428ca2cd3af4ebf723e8/roles/9c9f10110e12479bb6b3b630dd6412b8 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:11:30.403512 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caac7b89-8ff0-48eb-858c-77ae7371427d None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:30.458814 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a92cd8c-6235-4817-9081-5908f1a0f067 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:30.500409 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a69b6c-3b72-4ab7-bb63-c297d2a2ffdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:30.501076 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a69b6c-3b72-4ab7-bb63-c297d2a2ffdf None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:30.501604 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a69b6c-3b72-4ab7-bb63-c297d2a2ffdf None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:30.501892 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a69b6c-3b72-4ab7-bb63-c297d2a2ffdf None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:30.510781 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a69b6c-3b72-4ab7-bb63-c297d2a2ffdf None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:30.512331 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a69b6c-3b72-4ab7-bb63-c297d2a2ffdf None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:30.526808 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-68a69b6c-3b72-4ab7-bb63-c297d2a2ffdf None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 15 12:11:30.526808 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:30.526808 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:30.526808 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:30.526808 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:30.526808 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:30.526808 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:30.526808 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:30.526808 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:30.526808 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:30.526808 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:30.526808 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:30.526808 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 12:11:30.526808 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 12:11:30.526808 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 12:11:30.526808 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 12:11:30.527856 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:30.527856 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:30.527856 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 12:11:30.527856 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:11:30.527856 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 12:11:30.527856 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:11:30.527856 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:30.527856 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:30.527856 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:30.527856 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:30.527856 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:30.527856 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:30.527856 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:30.527856 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:30.527856 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:30.527856 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:30.527856 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:30.527856 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:30.528844 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:30.528844 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:30.528844 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 12:11:30.528844 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 12:11:30.528844 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 12:11:30.528844 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 12:11:30.528844 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 12:11:30.528844 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 12:11:30.528844 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 15 12:11:30.528844 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:30.528844 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 325/656] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Sep 15 12:11:30 2022] GET /identity/v3/users/neutron => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:30.529491 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a69b6c-3b72-4ab7-bb63-c297d2a2ffdf None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:30.549263 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caac7b89-8ff0-48eb-858c-77ae7371427d None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:30.590231 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f79df3-61d3-444b-a5c2-c7d0336a71b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:30.591270 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f79df3-61d3-444b-a5c2-c7d0336a71b6 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:30.591822 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f79df3-61d3-444b-a5c2-c7d0336a71b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:30.592440 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f79df3-61d3-444b-a5c2-c7d0336a71b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:30.606170 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f79df3-61d3-444b-a5c2-c7d0336a71b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:30.608123 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f79df3-61d3-444b-a5c2-c7d0336a71b6 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:30.627028 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-a2f79df3-61d3-444b-a5c2-c7d0336a71b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:30.627028 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:30.627028 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:30.627028 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:30.627028 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:30.627028 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:30.627028 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:30.627028 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:30.627028 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:30.627028 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:30.627028 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:30.627028 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:30.627028 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:11:30.627028 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:11:30.627028 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:11:30.627028 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:11:30.628397 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:30.628397 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:30.628397 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:30.628397 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:30.628397 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:30.628397 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:30.628397 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:30.628397 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:30.628397 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:30.628397 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:30.628397 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:30.628397 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:30.628397 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:30.628397 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:30.628397 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:30.628397 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:30.628397 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:11:30.629784 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:11:30.629784 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:30.629784 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:11:30.632300 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 332/657] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:11:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:30.633326 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f79df3-61d3-444b-a5c2-c7d0336a71b6 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:30.652230 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a69b6c-3b72-4ab7-bb63-c297d2a2ffdf None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:30.656040 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:30.662432 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:30.691620 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776cca09-667e-48ed-9269-7221d1b99d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:30.692256 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776cca09-667e-48ed-9269-7221d1b99d70 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:30.692534 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776cca09-667e-48ed-9269-7221d1b99d70 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:30.692804 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776cca09-667e-48ed-9269-7221d1b99d70 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:30.700069 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776cca09-667e-48ed-9269-7221d1b99d70 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:30.701515 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776cca09-667e-48ed-9269-7221d1b99d70 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:30.714367 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-776cca09-667e-48ed-9269-7221d1b99d70 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 15 12:11:30.714367 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:30.714367 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:30.714367 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:30.714367 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:30.714367 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:30.714367 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:30.714367 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:30.714367 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:30.714367 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:30.714367 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:30.714367 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:30.714367 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 12:11:30.714367 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 12:11:30.714367 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 12:11:30.714367 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 12:11:30.715361 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:30.715361 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:30.715361 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 12:11:30.715361 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:11:30.715361 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 12:11:30.715361 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:11:30.715361 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:30.715361 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:30.715361 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:30.715361 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:30.715361 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:30.715361 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:30.715361 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:30.715361 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:30.715361 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:30.715361 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:30.715361 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:30.715361 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:30.716293 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:30.716293 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:30.716293 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 12:11:30.716293 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 12:11:30.716293 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 12:11:30.716293 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 12:11:30.716293 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 12:11:30.716293 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 12:11:30.716293 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 15 12:11:30.716293 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:30.716293 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 326/658] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 15 12:11:30 2022] GET /identity/v3/users/cinder => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:30.716905 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a77a83-9e46-4703-95a0-a74410a19387 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:30.718260 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a77a83-9e46-4703-95a0-a74410a19387 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:30.718260 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a77a83-9e46-4703-95a0-a74410a19387 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:30.718806 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 327/659] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:11:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:11:30.719453 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a77a83-9e46-4703-95a0-a74410a19387 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:30.754450 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f79df3-61d3-444b-a5c2-c7d0336a71b6 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:30.790985 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9b296a-c457-4006-a425-72c44fc72e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:30.791594 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b296a-c457-4006-a425-72c44fc72e54 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:30.791892 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b296a-c457-4006-a425-72c44fc72e54 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:30.792352 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b296a-c457-4006-a425-72c44fc72e54 None admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:30.792882 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9b296a-c457-4006-a425-72c44fc72e54 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:30.793187 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9b296a-c457-4006-a425-72c44fc72e54 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:30.794609 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9b296a-c457-4006-a425-72c44fc72e54 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:30.817697 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 333/660] 10.222.0.16 () {56 vars in 1139 bytes} [Thu Sep 15 12:11:30 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:30.820228 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b73808-30b9-4934-9c24-8f3c5a95cf07 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:30.820696 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b73808-30b9-4934-9c24-8f3c5a95cf07 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:30.821137 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b73808-30b9-4934-9c24-8f3c5a95cf07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:30.843410 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-15b73808-30b9-4934-9c24-8f3c5a95cf07 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:11:30.844785 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-15b73808-30b9-4934-9c24-8f3c5a95cf07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:11:30.856206 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a77a83-9e46-4703-95a0-a74410a19387 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:30.899294 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98b90b0-7f48-4357-aef2-bef757cf9ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:30.899640 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b90b0-7f48-4357-aef2-bef757cf9ca4 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:30.899911 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b90b0-7f48-4357-aef2-bef757cf9ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:30.900180 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b90b0-7f48-4357-aef2-bef757cf9ca4 None admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:30.900844 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98b90b0-7f48-4357-aef2-bef757cf9ca4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:30.901116 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98b90b0-7f48-4357-aef2-bef757cf9ca4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:30.902489 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98b90b0-7f48-4357-aef2-bef757cf9ca4 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:30.915027 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 328/661] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 15 12:11:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:30.915964 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98b90b0-7f48-4357-aef2-bef757cf9ca4 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:30.930716 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 334/662] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:11:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:11:30.930716 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b73808-30b9-4934-9c24-8f3c5a95cf07 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:30.941578 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:30.953119 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:31.041481 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98b90b0-7f48-4357-aef2-bef757cf9ca4 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:31.042721 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b73808-30b9-4934-9c24-8f3c5a95cf07 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:31.075557 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909fb59c-1ab1-4dd0-8eda-9e53797556ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:31.076325 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909fb59c-1ab1-4dd0-8eda-9e53797556ff None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:31.076700 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909fb59c-1ab1-4dd0-8eda-9e53797556ff None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:31.077064 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909fb59c-1ab1-4dd0-8eda-9e53797556ff None admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:31.077931 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909fb59c-1ab1-4dd0-8eda-9e53797556ff None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:31.078323 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909fb59c-1ab1-4dd0-8eda-9e53797556ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:31.079486 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e19d58f-04d9-4a56-aad8-3e1e75ad8d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:31.079962 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909fb59c-1ab1-4dd0-8eda-9e53797556ff None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:31.080096 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19d58f-04d9-4a56-aad8-3e1e75ad8d80 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:31.080358 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19d58f-04d9-4a56-aad8-3e1e75ad8d80 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:31.080632 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19d58f-04d9-4a56-aad8-3e1e75ad8d80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:31.098121 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 329/663] 10.222.0.16 () {56 vars in 1137 bytes} [Thu Sep 15 12:11:30 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:31.099113 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909fb59c-1ab1-4dd0-8eda-9e53797556ff None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:31.156675 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e19d58f-04d9-4a56-aad8-3e1e75ad8d80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:31.158259 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e19d58f-04d9-4a56-aad8-3e1e75ad8d80 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:31.170525 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:31.209830 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:31.238954 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909fb59c-1ab1-4dd0-8eda-9e53797556ff None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:31.275479 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d056987-f6a3-4cfb-adb3-9c0a63754844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:31.276250 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d056987-f6a3-4cfb-adb3-9c0a63754844 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:31.276525 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d056987-f6a3-4cfb-adb3-9c0a63754844 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:31.276793 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d056987-f6a3-4cfb-adb3-9c0a63754844 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:31.282738 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 335/664] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 15 12:11:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 12:11:31.282738 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e19d58f-04d9-4a56-aad8-3e1e75ad8d80 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:31.286913 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d056987-f6a3-4cfb-adb3-9c0a63754844 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:31.288455 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d056987-f6a3-4cfb-adb3-9c0a63754844 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:31.300207 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-6d056987-f6a3-4cfb-adb3-9c0a63754844 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:11:31.300207 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:31.300207 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:31.300207 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:31.300207 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:31.300207 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:31.300207 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:31.300207 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:31.300207 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:31.300207 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:31.300207 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:31.300207 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:31.300207 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 12:11:31.300207 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 12:11:31.300207 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 12:11:31.301086 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 12:11:31.301086 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:31.301086 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:31.301086 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:31.301086 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:31.301086 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:31.301086 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:31.301086 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:31.301086 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:31.301086 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:31.301086 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:31.301086 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:31.301086 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:31.301086 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:31.301086 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:31.301086 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:31.301086 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:31.301978 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 12:11:31.301978 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 12:11:31.301978 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 12:11:31.301978 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 12:11:31.301978 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 12:11:31.301978 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 12:11:31.301978 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:11:31.301978 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:31.301978 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 330/665] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 15 12:11:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:31.302472 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d056987-f6a3-4cfb-adb3-9c0a63754844 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:31.394589 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e19d58f-04d9-4a56-aad8-3e1e75ad8d80 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:31.405894 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d056987-f6a3-4cfb-adb3-9c0a63754844 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:31.407506 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:31.436524 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77a3e1b-b5de-45eb-96e1-9474329667ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:31.437711 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a3e1b-b5de-45eb-96e1-9474329667ae None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:31.438075 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a3e1b-b5de-45eb-96e1-9474329667ae None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:31.438441 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a3e1b-b5de-45eb-96e1-9474329667ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:31.440646 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056eac49-08e7-449a-8af9-60a473398bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:31.441263 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056eac49-08e7-449a-8af9-60a473398bf7 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:31.441544 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056eac49-08e7-449a-8af9-60a473398bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:31.441813 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056eac49-08e7-449a-8af9-60a473398bf7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:31.451848 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056eac49-08e7-449a-8af9-60a473398bf7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:11:31.457748 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-056eac49-08e7-449a-8af9-60a473398bf7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:11:31.457748 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:31.457748 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:31.457748 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:31.457748 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:31.457748 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:31.457748 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:31.457748 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:31.457748 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:31.457748 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:31.457748 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:31.457748 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:31.457748 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:11:31.457748 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:11:31.457748 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:11:31.457748 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:11:31.463543 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:11:31.463543 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:11:31.463543 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:11:31.463543 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:11:31.463543 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:31.463543 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:31.463543 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:31.463543 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:31.463543 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:31.463543 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:31.463543 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:31.463543 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:31.463543 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:31.463543 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:31.463543 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:31.463543 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:31.464457 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:31.464457 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:31.464457 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:31.464457 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:31.464457 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:11:31.464457 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:11:31.464457 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:11:31.464457 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:11:31.464457 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:11:31.464457 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:11:31.464457 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:11:31.464457 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:31.464457 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 331/666] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Sep 15 12:11:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:31.464457 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056eac49-08e7-449a-8af9-60a473398bf7 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:31.467701 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:31.526282 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77a3e1b-b5de-45eb-96e1-9474329667ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:31.527777 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77a3e1b-b5de-45eb-96e1-9474329667ae None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:31.571595 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056eac49-08e7-449a-8af9-60a473398bf7 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:31.606882 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59c4194-c700-4344-b66c-241a05f97bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:31.607617 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c4194-c700-4344-b66c-241a05f97bfe None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:31.607896 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c4194-c700-4344-b66c-241a05f97bfe None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:31.608162 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c4194-c700-4344-b66c-241a05f97bfe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:31.619050 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59c4194-c700-4344-b66c-241a05f97bfe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:31.620594 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59c4194-c700-4344-b66c-241a05f97bfe None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:31.637602 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 336/667] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 15 12:11:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 12:11:31.637602 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77a3e1b-b5de-45eb-96e1-9474329667ae None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:31.637874 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-d59c4194-c700-4344-b66c-241a05f97bfe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:31.637874 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:31.637874 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:31.637874 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:31.637874 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:31.637874 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:31.637874 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:31.637874 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:31.637874 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:31.637874 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:31.637874 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:31.637874 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:31.637874 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:11:31.637874 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:11:31.637874 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:11:31.637874 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:11:31.638750 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:31.638750 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:31.638750 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:31.638750 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:31.638750 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:31.638750 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:31.638750 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:31.638750 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:31.638750 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:31.638750 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:31.638750 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:31.638750 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:31.638750 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:31.638750 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:31.638750 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:31.638750 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:31.638750 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:11:31.639652 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:11:31.639652 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:31.639652 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:31.639652 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 332/668] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:11:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:31.639652 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59c4194-c700-4344-b66c-241a05f97bfe None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:31.650494 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:31.709134 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:31.741589 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77a3e1b-b5de-45eb-96e1-9474329667ae None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:31.757165 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59c4194-c700-4344-b66c-241a05f97bfe None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:31.777482 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94f64e5-36f7-4444-adc0-a279f56c7704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:31.778078 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f64e5-36f7-4444-adc0-a279f56c7704 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:31.778351 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f64e5-36f7-4444-adc0-a279f56c7704 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:31.778620 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f64e5-36f7-4444-adc0-a279f56c7704 None admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:31.779335 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94f64e5-36f7-4444-adc0-a279f56c7704 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:31.779633 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94f64e5-36f7-4444-adc0-a279f56c7704 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:31.781065 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94f64e5-36f7-4444-adc0-a279f56c7704 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:31.797849 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 337/669] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Sep 15 12:11:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:31.798057 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfb4573-69b5-4323-a7fb-148bd214a67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:31.798057 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfb4573-69b5-4323-a7fb-148bd214a67f None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:31.798255 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94f64e5-36f7-4444-adc0-a279f56c7704 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:31.798341 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfb4573-69b5-4323-a7fb-148bd214a67f None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:31.798341 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfb4573-69b5-4323-a7fb-148bd214a67f None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:31.798341 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfb4573-69b5-4323-a7fb-148bd214a67f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:31.798341 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfb4573-69b5-4323-a7fb-148bd214a67f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:31.798341 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfb4573-69b5-4323-a7fb-148bd214a67f None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:31.806323 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 333/670] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 15 12:11:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:31.810927 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfb4573-69b5-4323-a7fb-148bd214a67f None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:31.882916 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:31.917618 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94f64e5-36f7-4444-adc0-a279f56c7704 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:31.918168 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfb4573-69b5-4323-a7fb-148bd214a67f None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:31.935762 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:31.954521 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d606bd52-d089-45cf-824e-517789331578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:31.955006 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc28ae7a-763b-43e1-aa51-35181307e1a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:31.955193 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606bd52-d089-45cf-824e-517789331578 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:31.955436 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606bd52-d089-45cf-824e-517789331578 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:31.955631 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc28ae7a-763b-43e1-aa51-35181307e1a9 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:31.955725 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606bd52-d089-45cf-824e-517789331578 None admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:31.955906 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc28ae7a-763b-43e1-aa51-35181307e1a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:31.956177 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc28ae7a-763b-43e1-aa51-35181307e1a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:31.956332 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d606bd52-d089-45cf-824e-517789331578 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:31.956684 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d606bd52-d089-45cf-824e-517789331578 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:31.957989 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d606bd52-d089-45cf-824e-517789331578 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:31.969597 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc28ae7a-763b-43e1-aa51-35181307e1a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:31.971217 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc28ae7a-763b-43e1-aa51-35181307e1a9 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:31.976404 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 334/671] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 15 12:11:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:31.977247 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d606bd52-d089-45cf-824e-517789331578 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:31.988886 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-cc28ae7a-763b-43e1-aa51-35181307e1a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:31.988886 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:31.988886 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:31.988886 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:31.988886 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:31.988886 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:31.988886 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:31.988886 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:31.988886 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:31.988886 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:31.988886 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:31.988886 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:31.988886 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:11:31.988886 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:11:31.988886 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:11:31.988886 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:11:31.989803 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:31.989803 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:31.989803 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:31.989803 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:31.989803 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:31.989803 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:31.989803 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:31.989803 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:31.989803 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:31.989803 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:31.989803 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:31.989803 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:31.989803 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:31.989803 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:31.989803 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:31.989803 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:31.989803 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:11:31.991561 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:11:31.991561 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:31.991561 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:11:31.991561 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 338/672] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:11:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:31.991561 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc28ae7a-763b-43e1-aa51-35181307e1a9 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:32.082569 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d606bd52-d089-45cf-824e-517789331578 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:32.103722 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc28ae7a-763b-43e1-aa51-35181307e1a9 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:32.118761 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00194e7f-b61d-42d7-a3fa-e4f3687f52f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:32.119375 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00194e7f-b61d-42d7-a3fa-e4f3687f52f1 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:32.119659 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00194e7f-b61d-42d7-a3fa-e4f3687f52f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:32.119934 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00194e7f-b61d-42d7-a3fa-e4f3687f52f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:32.120657 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00194e7f-b61d-42d7-a3fa-e4f3687f52f1 None admin] RBAC: Adding query filter params (role.id=9c9f10110e12479bb6b3b630dd6412b8, scope.project.id=cab958c081ad4a92939d4469cf4ce1c6, user.id=d057b651769b4ae99c1d4f2b0fc31fb4) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:32.120966 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00194e7f-b61d-42d7-a3fa-e4f3687f52f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:32.122413 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00194e7f-b61d-42d7-a3fa-e4f3687f52f1 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:32.129138 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 335/673] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 15 12:11:31 2022] GET /identity/v3/role_assignments?user.id=d057b651769b4ae99c1d4f2b0fc31fb4&scope.project.id=cab958c081ad4a92939d4469cf4ce1c6&role.id=9c9f10110e12479bb6b3b630dd6412b8 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:32.129926 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00194e7f-b61d-42d7-a3fa-e4f3687f52f1 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:32.139744 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:32.162017 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7818241-d326-4693-a9b1-c8007346f45e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:32.163656 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7818241-d326-4693-a9b1-c8007346f45e None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:32.164520 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7818241-d326-4693-a9b1-c8007346f45e None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:32.165702 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7818241-d326-4693-a9b1-c8007346f45e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:32.183568 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7818241-d326-4693-a9b1-c8007346f45e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:32.185832 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:32.185977 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7818241-d326-4693-a9b1-c8007346f45e None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:32.210530 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-e7818241-d326-4693-a9b1-c8007346f45e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:32.210530 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:32.210530 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:32.210530 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:32.210530 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:32.210530 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:32.210530 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:32.210530 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:32.210530 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:32.210530 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:32.210530 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:32.210530 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:32.210530 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:11:32.210530 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:11:32.210530 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:11:32.210530 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:11:32.211667 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:32.211667 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:32.211667 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:32.211667 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:32.211667 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:32.211667 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:32.211667 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:32.211667 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:32.211667 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:32.211667 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:32.211667 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:32.211667 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:32.211667 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:32.211667 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:32.211667 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:32.211667 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:32.211667 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:11:32.212625 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:11:32.212625 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:32.212625 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:11:32.215023 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 339/674] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:11:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:32.218371 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7818241-d326-4693-a9b1-c8007346f45e None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:32.279788 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00194e7f-b61d-42d7-a3fa-e4f3687f52f1 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:32.327356 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c19370-deac-4ae9-8342-6381777f3918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:32.328252 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c19370-deac-4ae9-8342-6381777f3918 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:32.328678 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c19370-deac-4ae9-8342-6381777f3918 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:32.329092 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c19370-deac-4ae9-8342-6381777f3918 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:32.336827 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7818241-d326-4693-a9b1-c8007346f45e None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:32.337319 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c19370-deac-4ae9-8342-6381777f3918 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:32.338518 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c19370-deac-4ae9-8342-6381777f3918 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:32.351486 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-89c19370-deac-4ae9-8342-6381777f3918 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:11:32.351486 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:32.351486 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:32.351486 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:32.351486 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:32.351486 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:32.351486 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:32.351486 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:32.351486 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:32.351486 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:32.351486 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:32.351486 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:32.351486 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 12:11:32.351486 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 12:11:32.351486 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 12:11:32.352409 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 12:11:32.352409 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:32.352409 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:32.352409 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:32.352409 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:32.352409 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:32.352409 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:32.352409 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:32.352409 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:32.352409 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:32.352409 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:32.352409 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:32.352409 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:32.352409 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:32.352409 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:32.352409 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:32.352409 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:32.353297 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 12:11:32.353297 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 12:11:32.353297 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 12:11:32.353297 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 12:11:32.353297 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 12:11:32.353297 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 12:11:32.353297 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:11:32.353297 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:32.355813 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 336/675] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 15 12:11:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:32.356674 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c19370-deac-4ae9-8342-6381777f3918 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:32.378191 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b3701-49cd-4b8c-be5f-a9a3681f9cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:32.378824 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b3701-49cd-4b8c-be5f-a9a3681f9cf1 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:32.379103 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b3701-49cd-4b8c-be5f-a9a3681f9cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:32.379371 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b3701-49cd-4b8c-be5f-a9a3681f9cf1 None admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:32.380195 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182b3701-49cd-4b8c-be5f-a9a3681f9cf1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:32.380894 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182b3701-49cd-4b8c-be5f-a9a3681f9cf1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:32.382513 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182b3701-49cd-4b8c-be5f-a9a3681f9cf1 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:32.395425 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 340/676] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 15 12:11:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:32.396266 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b3701-49cd-4b8c-be5f-a9a3681f9cf1 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:32.436905 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:32.487066 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:32.492152 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c19370-deac-4ae9-8342-6381777f3918 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:32.520019 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b3701-49cd-4b8c-be5f-a9a3681f9cf1 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:32.542358 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6bbf8d-3035-4a23-9f96-17909bac73d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:32.543586 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6bbf8d-3035-4a23-9f96-17909bac73d8 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:32.543972 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6bbf8d-3035-4a23-9f96-17909bac73d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:32.544569 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6bbf8d-3035-4a23-9f96-17909bac73d8 None admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:32.545295 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6bbf8d-3035-4a23-9f96-17909bac73d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:32.545888 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6bbf8d-3035-4a23-9f96-17909bac73d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:32.548639 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6bbf8d-3035-4a23-9f96-17909bac73d8 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:32.559447 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eab4859-9d0a-459e-8261-d762e891587a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:32.560207 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eab4859-9d0a-459e-8261-d762e891587a None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:32.560603 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eab4859-9d0a-459e-8261-d762e891587a None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:32.560938 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eab4859-9d0a-459e-8261-d762e891587a None admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:32.562582 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eab4859-9d0a-459e-8261-d762e891587a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:32.562972 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eab4859-9d0a-459e-8261-d762e891587a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:32.564703 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eab4859-9d0a-459e-8261-d762e891587a None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:32.566339 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 337/677] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 15 12:11:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:32.567368 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6bbf8d-3035-4a23-9f96-17909bac73d8 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:32.584105 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 341/678] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Sep 15 12:11:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:32.584995 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eab4859-9d0a-459e-8261-d762e891587a None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:32.688261 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6bbf8d-3035-4a23-9f96-17909bac73d8 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:32.701428 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:32.709417 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eab4859-9d0a-459e-8261-d762e891587a None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:32.723232 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14fcb60-bb7c-4f61-bd1d-d00dbcae8daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:32.723856 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14fcb60-bb7c-4f61-bd1d-d00dbcae8daf None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:32.724136 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14fcb60-bb7c-4f61-bd1d-d00dbcae8daf None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:32.724406 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14fcb60-bb7c-4f61-bd1d-d00dbcae8daf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:32.731216 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14fcb60-bb7c-4f61-bd1d-d00dbcae8daf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:32.732652 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14fcb60-bb7c-4f61-bd1d-d00dbcae8daf None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:32.744641 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-e14fcb60-bb7c-4f61-bd1d-d00dbcae8daf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:11:32.744641 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:32.744641 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:32.744641 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:32.744641 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:32.744641 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:32.744641 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:32.744641 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:32.744641 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:32.744641 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:32.744641 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:32.744641 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:32.744641 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 12:11:32.744641 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 12:11:32.744641 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 12:11:32.745531 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 12:11:32.745531 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:32.745531 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:32.745531 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:32.745531 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:32.745531 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:32.745531 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:32.745531 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:32.745531 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:32.745531 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:32.745531 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:32.745531 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:32.745531 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:32.745531 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:32.745531 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:32.745531 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:32.745531 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:32.752145 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 12:11:32.752145 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 12:11:32.752145 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 12:11:32.752145 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 12:11:32.752145 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 12:11:32.752145 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 12:11:32.752145 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:11:32.752145 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:32.752580 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c80660-a03c-41d2-9a0c-72495a9d567a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:32.752580 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c80660-a03c-41d2-9a0c-72495a9d567a None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:32.752580 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c80660-a03c-41d2-9a0c-72495a9d567a None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:32.752797 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 338/679] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 15 12:11:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:32.752866 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c80660-a03c-41d2-9a0c-72495a9d567a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:32.752932 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14fcb60-bb7c-4f61-bd1d-d00dbcae8daf None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:32.760555 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c80660-a03c-41d2-9a0c-72495a9d567a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:32.762483 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c80660-a03c-41d2-9a0c-72495a9d567a None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:32.774029 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:32.778092 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-58c80660-a03c-41d2-9a0c-72495a9d567a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 15 12:11:32.778092 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:32.778092 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:32.778092 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:32.778092 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:32.778092 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:32.778092 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:32.778092 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:32.778092 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:32.778092 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:32.778092 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:32.778092 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:32.778092 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 12:11:32.778092 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 12:11:32.778092 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 12:11:32.778092 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 12:11:32.779068 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:32.779068 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:32.779068 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 12:11:32.779068 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:11:32.779068 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 12:11:32.779068 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:11:32.779068 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:32.779068 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:32.779068 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:32.779068 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:32.779068 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:32.779068 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:32.779068 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:32.779068 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:32.779068 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:32.779068 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:32.779068 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:32.779068 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:32.780062 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:32.780062 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:32.780062 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 12:11:32.780062 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 12:11:32.780062 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 12:11:32.780062 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 12:11:32.780062 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 12:11:32.780062 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 12:11:32.780062 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 15 12:11:32.780062 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:11:32.780062 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 342/680] 10.222.0.16 () {56 vars in 1093 bytes} [Thu Sep 15 12:11:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:32.780062 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce70d9-2158-407c-a28c-2ba8d5926b2c None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:32.780062 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce70d9-2158-407c-a28c-2ba8d5926b2c None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:32.780795 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce70d9-2158-407c-a28c-2ba8d5926b2c None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:32.780795 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 343/681] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:11:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:11:32.781169 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fce70d9-2158-407c-a28c-2ba8d5926b2c None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:32.876109 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14fcb60-bb7c-4f61-bd1d-d00dbcae8daf None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:32.888967 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fce70d9-2158-407c-a28c-2ba8d5926b2c None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:32.910299 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648b0443-13dd-43f5-9f3e-928436e1aa06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:32.910952 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b0443-13dd-43f5-9f3e-928436e1aa06 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:32.911227 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b0443-13dd-43f5-9f3e-928436e1aa06 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:32.911491 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b0443-13dd-43f5-9f3e-928436e1aa06 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:32.912206 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648b0443-13dd-43f5-9f3e-928436e1aa06 None admin] RBAC: Adding query filter params (role.id=9c9f10110e12479bb6b3b630dd6412b8, scope.project.id=cab958c081ad4a92939d4469cf4ce1c6, user.id=4003dbcee8104aa4a7ce90251bab88a2) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:32.912511 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648b0443-13dd-43f5-9f3e-928436e1aa06 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:32.913928 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648b0443-13dd-43f5-9f3e-928436e1aa06 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:32.930715 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 339/682] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 15 12:11:32 2022] GET /identity/v3/role_assignments?user.id=4003dbcee8104aa4a7ce90251bab88a2&scope.project.id=cab958c081ad4a92939d4469cf4ce1c6&role.id=9c9f10110e12479bb6b3b630dd6412b8 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:32.930715 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648b0443-13dd-43f5-9f3e-928436e1aa06 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:32.937782 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4916f02-37bd-4df8-a198-e75d1d295fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:32.938708 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4916f02-37bd-4df8-a198-e75d1d295fc5 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:32.939045 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4916f02-37bd-4df8-a198-e75d1d295fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:32.939410 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4916f02-37bd-4df8-a198-e75d1d295fc5 None admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:32.940206 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4916f02-37bd-4df8-a198-e75d1d295fc5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:32.940586 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4916f02-37bd-4df8-a198-e75d1d295fc5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:32.942985 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4916f02-37bd-4df8-a198-e75d1d295fc5 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:32.966169 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 344/683] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Sep 15 12:11:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:32.968423 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f91e2-86b1-47c4-9a29-42a27e08ca41 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:32.968815 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f91e2-86b1-47c4-9a29-42a27e08ca41 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:32.969206 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f91e2-86b1-47c4-9a29-42a27e08ca41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:32.997023 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-d71f91e2-86b1-47c4-9a29-42a27e08ca41 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:11:32.998399 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-d71f91e2-86b1-47c4-9a29-42a27e08ca41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:11:33.012360 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:33.033555 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:33.055506 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648b0443-13dd-43f5-9f3e-928436e1aa06 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:33.089056 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 345/684] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:11:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:11:33.090424 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71f91e2-86b1-47c4-9a29-42a27e08ca41 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:33.102486 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aff338-6802-4541-b992-e16e3d4dd995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:33.103902 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aff338-6802-4541-b992-e16e3d4dd995 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:33.104370 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aff338-6802-4541-b992-e16e3d4dd995 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:33.104798 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aff338-6802-4541-b992-e16e3d4dd995 None admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:33.106196 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aff338-6802-4541-b992-e16e3d4dd995 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:33.107061 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aff338-6802-4541-b992-e16e3d4dd995 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:33.110185 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aff338-6802-4541-b992-e16e3d4dd995 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:33.148353 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 340/685] 10.222.0.16 () {56 vars in 1133 bytes} [Thu Sep 15 12:11:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:33.154212 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aff338-6802-4541-b992-e16e3d4dd995 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:33.254438 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71f91e2-86b1-47c4-9a29-42a27e08ca41 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:33.295334 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aff338-6802-4541-b992-e16e3d4dd995 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:33.299902 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be872f-4f5c-48be-ade3-3df6ed18668a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:33.300742 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be872f-4f5c-48be-ade3-3df6ed18668a None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:33.301318 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be872f-4f5c-48be-ade3-3df6ed18668a None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:33.301793 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be872f-4f5c-48be-ade3-3df6ed18668a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:33.302730 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0be872f-4f5c-48be-ade3-3df6ed18668a None admin] RBAC: Adding query filter params (role.id=9c9f10110e12479bb6b3b630dd6412b8, scope.project.id=cab958c081ad4a92939d4469cf4ce1c6, user.id=ceafc5e4283841528053f01931f10293) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:33.303353 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0be872f-4f5c-48be-ade3-3df6ed18668a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:33.304969 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0be872f-4f5c-48be-ade3-3df6ed18668a None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:33.312776 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 346/686] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 15 12:11:33 2022] GET /identity/v3/role_assignments?user.id=ceafc5e4283841528053f01931f10293&scope.project.id=cab958c081ad4a92939d4469cf4ce1c6&role.id=9c9f10110e12479bb6b3b630dd6412b8 => generated 608 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:33.333282 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f94d762-3b07-4320-af8b-30aea3e30131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:33.333910 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94d762-3b07-4320-af8b-30aea3e30131 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:33.334190 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94d762-3b07-4320-af8b-30aea3e30131 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:33.334464 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94d762-3b07-4320-af8b-30aea3e30131 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:33.349355 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:33.383773 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be872f-4f5c-48be-ade3-3df6ed18668a None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:33.407681 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:33.415275 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f94d762-3b07-4320-af8b-30aea3e30131 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:33.416752 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f94d762-3b07-4320-af8b-30aea3e30131 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:33.562669 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be872f-4f5c-48be-ade3-3df6ed18668a None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:33.588059 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 341/687] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 15 12:11:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 15 12:11:33.594486 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f94d762-3b07-4320-af8b-30aea3e30131 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:33.621951 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facc42a7-f300-4045-b1ba-f5bafbfb9960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:33.622993 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc42a7-f300-4045-b1ba-f5bafbfb9960 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:33.623498 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc42a7-f300-4045-b1ba-f5bafbfb9960 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:33.623965 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc42a7-f300-4045-b1ba-f5bafbfb9960 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:33.636790 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facc42a7-f300-4045-b1ba-f5bafbfb9960 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:11:33.642939 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-facc42a7-f300-4045-b1ba-f5bafbfb9960 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 12:11:33.642939 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:33.642939 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:33.642939 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:33.642939 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:33.642939 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:33.642939 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:33.642939 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:33.642939 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:33.642939 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:33.642939 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:33.642939 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:33.642939 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:11:33.642939 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:11:33.642939 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:11:33.642939 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:11:33.643854 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:11:33.643854 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:11:33.643854 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:11:33.643854 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:11:33.643854 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:33.643854 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:33.643854 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:33.643854 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:33.643854 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:33.643854 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:33.643854 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:33.643854 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:33.643854 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:33.643854 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:33.643854 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:33.643854 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:33.644696 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:33.644696 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:33.644696 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:33.644696 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:33.644696 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:11:33.644696 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:11:33.644696 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:11:33.644696 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:11:33.644696 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:11:33.644696 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:11:33.644696 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 12:11:33.644696 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:11:33.647259 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 347/688] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Sep 15 12:11:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:33.654568 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:33.657031 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facc42a7-f300-4045-b1ba-f5bafbfb9960 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:33.729787 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f94d762-3b07-4320-af8b-30aea3e30131 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:33.749751 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:33.792804 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e28ef3-75eb-4314-8040-91d02ddb8687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:33.793429 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e28ef3-75eb-4314-8040-91d02ddb8687 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:33.793699 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e28ef3-75eb-4314-8040-91d02ddb8687 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:33.793959 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e28ef3-75eb-4314-8040-91d02ddb8687 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:33.808584 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facc42a7-f300-4045-b1ba-f5bafbfb9960 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:33.811590 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e28ef3-75eb-4314-8040-91d02ddb8687 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:33.813091 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e28ef3-75eb-4314-8040-91d02ddb8687 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:33.837758 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-41e28ef3-75eb-4314-8040-91d02ddb8687 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:33.837758 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:33.837758 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:33.837758 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:33.837758 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:33.837758 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:33.837758 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:33.837758 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:33.837758 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:33.837758 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:33.837758 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:33.837758 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:33.837758 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:11:33.837758 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:11:33.837758 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:11:33.837758 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:11:33.838797 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:33.838797 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:33.838797 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:33.838797 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:33.838797 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:33.838797 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:33.838797 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:33.838797 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:33.838797 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:33.838797 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:33.838797 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:33.838797 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:33.838797 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:33.838797 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:33.838797 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:33.838797 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:33.838797 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:11:33.839699 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:11:33.839699 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:33.839699 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:33.839699 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 342/689] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:11:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:33.846636 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e28ef3-75eb-4314-8040-91d02ddb8687 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:33.869874 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bbdf72-2a35-472a-a063-849eb7f066c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:33.870478 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bbdf72-2a35-472a-a063-849eb7f066c0 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:33.870770 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bbdf72-2a35-472a-a063-849eb7f066c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:33.871039 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bbdf72-2a35-472a-a063-849eb7f066c0 None admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:33.871759 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bbdf72-2a35-472a-a063-849eb7f066c0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:33.872064 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bbdf72-2a35-472a-a063-849eb7f066c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:33.873414 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bbdf72-2a35-472a-a063-849eb7f066c0 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:33.890281 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 348/690] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Sep 15 12:11:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:11:33.896371 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bbdf72-2a35-472a-a063-849eb7f066c0 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:34.023213 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:34.034623 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e28ef3-75eb-4314-8040-91d02ddb8687 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:34.083769 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafbf65c-6208-4fbc-a0b8-065d3b426806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:34.084711 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafbf65c-6208-4fbc-a0b8-065d3b426806 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:34.085189 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafbf65c-6208-4fbc-a0b8-065d3b426806 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:34.085683 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafbf65c-6208-4fbc-a0b8-065d3b426806 None admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:34.086547 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafbf65c-6208-4fbc-a0b8-065d3b426806 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:34.087080 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafbf65c-6208-4fbc-a0b8-065d3b426806 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:34.088668 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafbf65c-6208-4fbc-a0b8-065d3b426806 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:34.091020 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bbdf72-2a35-472a-a063-849eb7f066c0 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:34.102343 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 343/691] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 15 12:11:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:34.107421 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafbf65c-6208-4fbc-a0b8-065d3b426806 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:34.169103 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:34.199378 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12b8399-4d9d-4b5f-ad27-20811c028ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:34.200015 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b8399-4d9d-4b5f-ad27-20811c028ed7 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:34.200289 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b8399-4d9d-4b5f-ad27-20811c028ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:34.200558 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b8399-4d9d-4b5f-ad27-20811c028ed7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:34.214783 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafbf65c-6208-4fbc-a0b8-065d3b426806 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:34.220441 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12b8399-4d9d-4b5f-ad27-20811c028ed7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:34.228078 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12b8399-4d9d-4b5f-ad27-20811c028ed7 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:34.252893 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2358a3b5-f2c3-4d3c-8f7c-ee6c4f08ad03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:34.253684 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2358a3b5-f2c3-4d3c-8f7c-ee6c4f08ad03 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:34.254033 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2358a3b5-f2c3-4d3c-8f7c-ee6c4f08ad03 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:34.254459 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2358a3b5-f2c3-4d3c-8f7c-ee6c4f08ad03 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:34.259401 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-d12b8399-4d9d-4b5f-ad27-20811c028ed7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:34.259401 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:34.259401 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:34.259401 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:34.259401 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:34.259401 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:34.259401 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:34.259401 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:34.259401 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:34.259401 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:34.259401 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:34.259401 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:34.259401 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:11:34.259401 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:11:34.259401 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:11:34.259401 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:11:34.260340 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:34.260340 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:34.260340 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:34.260340 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:34.260340 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:34.260340 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:34.260340 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:34.260340 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:34.260340 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:34.260340 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:34.260340 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:34.260340 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:34.260340 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:34.260340 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:34.260340 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:34.260340 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:34.260340 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:11:34.261218 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:11:34.261218 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:34.261218 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:11:34.262572 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2358a3b5-f2c3-4d3c-8f7c-ee6c4f08ad03 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:34.264122 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2358a3b5-f2c3-4d3c-8f7c-ee6c4f08ad03 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:34.267132 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 349/692] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:11:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:11:34.273206 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12b8399-4d9d-4b5f-ad27-20811c028ed7 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:34.276954 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-2358a3b5-f2c3-4d3c-8f7c-ee6c4f08ad03 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:11:34.276954 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:34.276954 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:34.276954 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:34.276954 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:34.276954 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:34.276954 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:34.276954 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:34.276954 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:34.276954 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:34.276954 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:34.276954 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:34.276954 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 12:11:34.276954 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 12:11:34.276954 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 12:11:34.277802 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 12:11:34.277802 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:34.277802 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:34.277802 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:34.277802 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:34.277802 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:34.277802 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:34.277802 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:34.277802 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:34.277802 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:34.277802 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:34.277802 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:34.277802 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:34.277802 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:34.277802 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:34.277802 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:34.277802 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:34.278679 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 12:11:34.278679 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 12:11:34.278679 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 12:11:34.278679 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 12:11:34.278679 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 12:11:34.278679 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 12:11:34.278679 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:11:34.278679 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:34.278679 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 344/693] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 15 12:11:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:11:34.284300 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2358a3b5-f2c3-4d3c-8f7c-ee6c4f08ad03 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:34.311854 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:34.474297 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12b8399-4d9d-4b5f-ad27-20811c028ed7 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:34.479561 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2358a3b5-f2c3-4d3c-8f7c-ee6c4f08ad03 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:34.544275 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7a3b06-0012-4e44-bde7-0af2467b67e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:34.544884 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7a3b06-0012-4e44-bde7-0af2467b67e4 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:34.545165 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7a3b06-0012-4e44-bde7-0af2467b67e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:34.545438 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7a3b06-0012-4e44-bde7-0af2467b67e4 None admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:34.546123 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7a3b06-0012-4e44-bde7-0af2467b67e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:34.546427 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7a3b06-0012-4e44-bde7-0af2467b67e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:34.548253 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7a3b06-0012-4e44-bde7-0af2467b67e4 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:34.550729 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8559962-c348-43ae-b366-128f48ec9104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:34.551345 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8559962-c348-43ae-b366-128f48ec9104 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:34.551620 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8559962-c348-43ae-b366-128f48ec9104 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:34.551888 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8559962-c348-43ae-b366-128f48ec9104 None admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:34.552582 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8559962-c348-43ae-b366-128f48ec9104 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:34.552890 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8559962-c348-43ae-b366-128f48ec9104 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:34.554323 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8559962-c348-43ae-b366-128f48ec9104 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:34.583056 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 350/694] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 15 12:11:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:11:34.583267 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 345/695] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Sep 15 12:11:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:34.586707 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76823238-33a3-438f-94b7-e807471b3e10 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:34.587280 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76823238-33a3-438f-94b7-e807471b3e10 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:34.587560 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76823238-33a3-438f-94b7-e807471b3e10 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:34.587890 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8559962-c348-43ae-b366-128f48ec9104 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:34.589065 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 351/696] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:11:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:11:34.589757 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76823238-33a3-438f-94b7-e807471b3e10 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:34.647321 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:34.688028 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:34.719825 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8559962-c348-43ae-b366-128f48ec9104 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:34.720007 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76823238-33a3-438f-94b7-e807471b3e10 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:34.761772 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5ba719-976e-4dba-b7a4-642137f690fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:34.762380 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5ba719-976e-4dba-b7a4-642137f690fd None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:34.762489 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9a892e-9c41-4940-ba05-9e2203d30642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:34.762669 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5ba719-976e-4dba-b7a4-642137f690fd None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:34.762953 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5ba719-976e-4dba-b7a4-642137f690fd None admin] PATH_INFO: `/v3/users/swift` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:34.763133 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a892e-9c41-4940-ba05-9e2203d30642 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:34.766716 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a892e-9c41-4940-ba05-9e2203d30642 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:34.766716 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a892e-9c41-4940-ba05-9e2203d30642 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:34.766716 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9a892e-9c41-4940-ba05-9e2203d30642 None admin] RBAC: Adding query filter params (role.id=7f53f1c823b746529ba5057bf21b2477, scope.project.id=cab958c081ad4a92939d4469cf4ce1c6, user.id=9d05c52570474820b4ba0e2cdad5c13f) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:34.766716 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9a892e-9c41-4940-ba05-9e2203d30642 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:34.767380 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9a892e-9c41-4940-ba05-9e2203d30642 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:34.771422 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5ba719-976e-4dba-b7a4-642137f690fd None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:34.772939 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5ba719-976e-4dba-b7a4-642137f690fd None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:34.774776 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 346/697] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 15 12:11:34 2022] GET /identity/v3/role_assignments?user.id=9d05c52570474820b4ba0e2cdad5c13f&scope.project.id=cab958c081ad4a92939d4469cf4ce1c6&role.id=7f53f1c823b746529ba5057bf21b2477 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:11:34.778716 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b536f-c21c-4044-bc2b-5820a1e371c3 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:34.778716 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b536f-c21c-4044-bc2b-5820a1e371c3 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:34.778716 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b536f-c21c-4044-bc2b-5820a1e371c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:34.800608 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-ce5ba719-976e-4dba-b7a4-642137f690fd None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 15 12:11:34.800608 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:34.800608 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:34.800608 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:34.800608 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:34.800608 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:34.800608 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:34.800608 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:34.800608 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:34.800608 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:34.800608 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:34.800608 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:34.800608 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 12:11:34.800608 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 12:11:34.800608 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 12:11:34.800608 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 12:11:34.802863 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:34.802863 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:34.802863 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 12:11:34.802863 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:11:34.802863 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 12:11:34.802863 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:11:34.802863 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:34.802863 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:34.802863 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:34.802863 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:34.802863 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:34.802863 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:34.802863 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:34.802863 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:34.802863 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:34.802863 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:34.802863 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:34.802863 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:34.805069 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:34.805069 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:34.805069 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 12:11:34.805069 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 12:11:34.805069 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 12:11:34.805069 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 12:11:34.805069 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 12:11:34.805069 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 12:11:34.805069 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 15 12:11:34.805069 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:11:34.805069 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 352/698] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Sep 15 12:11:34 2022] GET /identity/v3/users/swift => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:34.814715 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5ba719-976e-4dba-b7a4-642137f690fd None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:34.820376 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-1d9b536f-c21c-4044-bc2b-5820a1e371c3 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:11:34.821613 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-1d9b536f-c21c-4044-bc2b-5820a1e371c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:11:34.948395 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 347/699] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:11:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:11:35.008085 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5ba719-976e-4dba-b7a4-642137f690fd None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:35.009644 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:35.050088 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a523f2c7-a061-43d1-aa2c-f0c361d57631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:35.051079 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523f2c7-a061-43d1-aa2c-f0c361d57631 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:35.051557 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523f2c7-a061-43d1-aa2c-f0c361d57631 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:35.052038 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523f2c7-a061-43d1-aa2c-f0c361d57631 None admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:35.052957 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a523f2c7-a061-43d1-aa2c-f0c361d57631 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:35.053454 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a523f2c7-a061-43d1-aa2c-f0c361d57631 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:35.055152 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a523f2c7-a061-43d1-aa2c-f0c361d57631 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:35.086068 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 353/700] 10.222.0.16 () {56 vars in 1135 bytes} [Thu Sep 15 12:11:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:11:35.091801 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9b536f-c21c-4044-bc2b-5820a1e371c3 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:35.191930 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:35.238420 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9b536f-c21c-4044-bc2b-5820a1e371c3 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:35.268342 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a523f2c7-a061-43d1-aa2c-f0c361d57631 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:35.281366 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69fd8fc-1fa9-404f-a6e2-25b6075c645a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:35.282313 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69fd8fc-1fa9-404f-a6e2-25b6075c645a None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:35.283321 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69fd8fc-1fa9-404f-a6e2-25b6075c645a None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:35.283810 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69fd8fc-1fa9-404f-a6e2-25b6075c645a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:35.393985 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a523f2c7-a061-43d1-aa2c-f0c361d57631 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:35.433461 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6260e305-e06d-4a2e-8c2a-071e7dcedab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:35.434506 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6260e305-e06d-4a2e-8c2a-071e7dcedab4 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:35.435017 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6260e305-e06d-4a2e-8c2a-071e7dcedab4 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:35.435742 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6260e305-e06d-4a2e-8c2a-071e7dcedab4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:35.451815 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6260e305-e06d-4a2e-8c2a-071e7dcedab4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:35.453864 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6260e305-e06d-4a2e-8c2a-071e7dcedab4 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:35.458193 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69fd8fc-1fa9-404f-a6e2-25b6075c645a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:35.461341 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69fd8fc-1fa9-404f-a6e2-25b6075c645a None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:35.477514 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-6260e305-e06d-4a2e-8c2a-071e7dcedab4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:35.477514 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:35.477514 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:35.477514 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:35.477514 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:35.477514 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:35.477514 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:35.477514 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:35.477514 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:35.477514 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:35.477514 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:35.477514 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:35.477514 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:11:35.477514 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:11:35.477514 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:11:35.477514 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:11:35.479051 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:35.479051 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:35.479051 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:35.479051 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:35.479051 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:35.479051 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:35.479051 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:35.479051 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:35.479051 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:35.479051 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:35.479051 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:35.479051 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:35.479051 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:35.479051 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:35.479051 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:35.479051 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:35.479051 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:11:35.479944 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:11:35.479944 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:35.479944 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:11:35.488216 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 354/701] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:11:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:35.489929 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6260e305-e06d-4a2e-8c2a-071e7dcedab4 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:35.522454 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:35.624750 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6260e305-e06d-4a2e-8c2a-071e7dcedab4 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:35.647132 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:35.664002 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b489864c-c72a-497a-b10e-f0e020eccfc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:35.664629 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b489864c-c72a-497a-b10e-f0e020eccfc0 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:35.664907 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b489864c-c72a-497a-b10e-f0e020eccfc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:35.665178 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b489864c-c72a-497a-b10e-f0e020eccfc0 None admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:35.665833 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b489864c-c72a-497a-b10e-f0e020eccfc0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:35.666134 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b489864c-c72a-497a-b10e-f0e020eccfc0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:35.667606 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b489864c-c72a-497a-b10e-f0e020eccfc0 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:35.681315 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 355/702] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 15 12:11:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:35.689465 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b489864c-c72a-497a-b10e-f0e020eccfc0 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:35.724644 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 348/703] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 15 12:11:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 633 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 15 12:11:35.726099 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa99f4-0e2d-41ce-95b4-ac7ac83425a8 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:35.726382 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa99f4-0e2d-41ce-95b4-ac7ac83425a8 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:35.726653 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa99f4-0e2d-41ce-95b4-ac7ac83425a8 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:35.728180 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 349/704] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:11:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:11:35.731672 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aa99f4-0e2d-41ce-95b4-ac7ac83425a8 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:35.778359 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:35.809484 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b489864c-c72a-497a-b10e-f0e020eccfc0 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:35.849152 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163e5644-fcda-464f-806a-468293dc7859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:35.849776 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e5644-fcda-464f-806a-468293dc7859 None admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:35.850046 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e5644-fcda-464f-806a-468293dc7859 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:35.850322 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e5644-fcda-464f-806a-468293dc7859 None admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:35.851017 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163e5644-fcda-464f-806a-468293dc7859 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:35.851229 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aa99f4-0e2d-41ce-95b4-ac7ac83425a8 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:35.852526 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163e5644-fcda-464f-806a-468293dc7859 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:35.880145 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 356/705] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Sep 15 12:11:35 2022] POST /identity/v3/users => generated 254 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:11:35.881486 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d16eaae-836d-4f35-859e-12e57ef86f40 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:35.881828 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d16eaae-836d-4f35-859e-12e57ef86f40 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:35.882102 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d16eaae-836d-4f35-859e-12e57ef86f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:35.888110 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af02b112-20a2-4859-9e35-02db8e4ab8d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:35.888964 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af02b112-20a2-4859-9e35-02db8e4ab8d9 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:35.889244 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af02b112-20a2-4859-9e35-02db8e4ab8d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:35.889517 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af02b112-20a2-4859-9e35-02db8e4ab8d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:35.902724 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af02b112-20a2-4859-9e35-02db8e4ab8d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:35.903654 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-8d16eaae-836d-4f35-859e-12e57ef86f40 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:11:35.904063 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af02b112-20a2-4859-9e35-02db8e4ab8d9 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:35.904862 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-8d16eaae-836d-4f35-859e-12e57ef86f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:11:35.921363 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-af02b112-20a2-4859-9e35-02db8e4ab8d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:35.921363 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:35.921363 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:35.921363 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:35.921363 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:35.921363 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:35.921363 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:35.921363 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:35.921363 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:35.921363 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:35.921363 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:35.921363 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:35.921363 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:11:35.921363 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:11:35.921363 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:11:35.921363 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:11:35.923725 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:35.923725 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:35.923725 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:35.923725 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:35.923725 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:35.923725 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:35.923725 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:35.923725 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:35.923725 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:35.923725 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:35.923725 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:35.923725 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:35.923725 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:35.923725 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:35.923725 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:35.923725 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:35.923725 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:11:35.925837 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:11:35.925837 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:35.925837 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:35.925837 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 350/706] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:11:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:35.936157 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af02b112-20a2-4859-9e35-02db8e4ab8d9 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:35.974627 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:35.993039 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 357/707] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:11:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:11:35.994612 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c166a4-0fd7-4411-aec6-d12ed5d0ddba None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:35.994949 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c166a4-0fd7-4411-aec6-d12ed5d0ddba None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:35.995223 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c166a4-0fd7-4411-aec6-d12ed5d0ddba None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:35.998742 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 358/708] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:11:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:11:36.003238 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6891d7e-731e-424b-a551-251826a3b335 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:36.003717 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6891d7e-731e-424b-a551-251826a3b335 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:36.004136 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6891d7e-731e-424b-a551-251826a3b335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:36.032995 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-b6891d7e-731e-424b-a551-251826a3b335 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:11:36.035584 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-b6891d7e-731e-424b-a551-251826a3b335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:11:36.107796 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:36.119742 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af02b112-20a2-4859-9e35-02db8e4ab8d9 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:36.126880 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 359/709] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:11:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:11:36.166347 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e490f01-5134-46da-b49e-c15e2c448aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:36.166987 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e490f01-5134-46da-b49e-c15e2c448aee None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:36.167270 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e490f01-5134-46da-b49e-c15e2c448aee None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:36.167544 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e490f01-5134-46da-b49e-c15e2c448aee None admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:36.168236 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e490f01-5134-46da-b49e-c15e2c448aee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:36.168539 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e490f01-5134-46da-b49e-c15e2c448aee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:36.169956 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e490f01-5134-46da-b49e-c15e2c448aee None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:36.182902 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 351/710] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 15 12:11:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:11:36.189139 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6891d7e-731e-424b-a551-251826a3b335 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:36.304367 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6891d7e-731e-424b-a551-251826a3b335 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:36.314556 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e490f01-5134-46da-b49e-c15e2c448aee None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:36.352715 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8614d74c-0ecd-4ad3-9415-769526dbae17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:36.354363 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8614d74c-0ecd-4ad3-9415-769526dbae17 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:36.355035 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8614d74c-0ecd-4ad3-9415-769526dbae17 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:36.356575 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8614d74c-0ecd-4ad3-9415-769526dbae17 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:36.368380 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8614d74c-0ecd-4ad3-9415-769526dbae17 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:36.372880 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8614d74c-0ecd-4ad3-9415-769526dbae17 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:36.395670 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-8614d74c-0ecd-4ad3-9415-769526dbae17 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:11:36.395670 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:36.395670 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:36.395670 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:36.395670 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:36.395670 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:36.395670 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:36.395670 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:36.395670 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:36.395670 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:36.395670 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:36.395670 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:36.395670 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 12:11:36.395670 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 12:11:36.395670 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 12:11:36.396604 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 12:11:36.396604 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:36.396604 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:36.396604 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:36.396604 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:36.396604 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:36.396604 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:36.396604 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:36.396604 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:36.396604 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:36.396604 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:36.396604 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:36.396604 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:36.396604 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:36.396604 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:36.396604 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:36.396604 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:36.397528 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 12:11:36.397528 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 12:11:36.397528 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 12:11:36.397528 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 12:11:36.397528 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 12:11:36.397528 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 12:11:36.397528 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:11:36.397528 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:11:36.400521 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 360/711] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 15 12:11:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:11:36.411647 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8614d74c-0ecd-4ad3-9415-769526dbae17 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:36.462753 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:36.474709 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:36.495185 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e490f01-5134-46da-b49e-c15e2c448aee None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:36.536178 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8614d74c-0ecd-4ad3-9415-769526dbae17 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:36.538445 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c505072-3875-456f-b3bf-8658cad36fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:36.539898 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c505072-3875-456f-b3bf-8658cad36fc6 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:36.540181 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c505072-3875-456f-b3bf-8658cad36fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:36.540455 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c505072-3875-456f-b3bf-8658cad36fc6 None admin] PATH_INFO: `/v3/services/network` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:36.541051 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c505072-3875-456f-b3bf-8658cad36fc6 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:36.542436 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c505072-3875-456f-b3bf-8658cad36fc6 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:36.556347 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-1c505072-3875-456f-b3bf-8658cad36fc6 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 15 12:11:36.556347 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:36.556347 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 12:11:36.556347 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 12:11:36.556347 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 12:11:36.556347 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 12:11:36.556347 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 12:11:36.556347 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:11:36.556347 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 15 12:11:36.556347 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:36.556347 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 12:11:36.556347 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:36.556347 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:36.556347 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:36.556347 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:36.556347 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:36.556347 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:36.557476 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:36.557476 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:36.557476 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:36.557476 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:36.557476 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:36.557476 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:36.557476 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 12:11:36.557476 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 12:11:36.557476 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 12:11:36.557476 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 12:11:36.557476 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:36.557476 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:36.557476 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:36.557476 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:36.557476 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:36.557476 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:36.558336 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:36.558336 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:36.558336 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:36.558336 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:36.558336 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:36.558336 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:36.558336 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:36.558336 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:36.558336 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:36.558336 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:36.558336 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 12:11:36.558336 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:11:36.558336 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 15 12:11:36.558336 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:36.558336 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 352/712] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 15 12:11:36 2022] GET /identity/v3/services/network => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:36.560589 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c505072-3875-456f-b3bf-8658cad36fc6 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:36.578298 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72ca364-7245-4c9f-8c34-6e7a2e055f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:36.578932 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ca364-7245-4c9f-8c34-6e7a2e055f0f None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:36.579214 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ca364-7245-4c9f-8c34-6e7a2e055f0f None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:36.579485 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ca364-7245-4c9f-8c34-6e7a2e055f0f None admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:36.580327 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72ca364-7245-4c9f-8c34-6e7a2e055f0f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:36.580633 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72ca364-7245-4c9f-8c34-6e7a2e055f0f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:36.582141 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72ca364-7245-4c9f-8c34-6e7a2e055f0f None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:36.602772 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 361/713] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Sep 15 12:11:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:36.602772 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72ca364-7245-4c9f-8c34-6e7a2e055f0f None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:36.688805 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c505072-3875-456f-b3bf-8658cad36fc6 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:36.714981 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72ca364-7245-4c9f-8c34-6e7a2e055f0f None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:36.726335 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d658e1-05a4-4ded-bb75-b0ba6778e6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:36.727315 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:36.728438 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d658e1-05a4-4ded-bb75-b0ba6778e6b3 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:36.728996 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d658e1-05a4-4ded-bb75-b0ba6778e6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:36.729471 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d658e1-05a4-4ded-bb75-b0ba6778e6b3 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:36.730406 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d658e1-05a4-4ded-bb75-b0ba6778e6b3 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:36.732120 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d658e1-05a4-4ded-bb75-b0ba6778e6b3 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:36.743840 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-11d658e1-05a4-4ded-bb75-b0ba6778e6b3 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 15 12:11:36.743840 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:36.743840 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 12:11:36.743840 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 12:11:36.743840 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 12:11:36.743840 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 12:11:36.743840 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 12:11:36.743840 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:11:36.743840 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 15 12:11:36.743840 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:36.743840 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 12:11:36.743840 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:36.743840 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:36.743840 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:36.743840 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:36.743840 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:36.743840 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:36.744907 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:36.744907 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:36.744907 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:36.744907 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:36.744907 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:36.744907 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:36.744907 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 12:11:36.744907 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 12:11:36.744907 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 12:11:36.744907 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 12:11:36.744907 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:36.744907 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:36.744907 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:36.744907 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:36.744907 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:36.744907 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:36.745757 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:36.745757 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:36.745757 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:36.745757 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:36.745757 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:36.745757 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:36.745757 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:36.745757 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:36.745757 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:36.745757 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:36.745757 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 12:11:36.745757 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:11:36.745757 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 15 12:11:36.745757 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:36.753631 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 353/714] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Sep 15 12:11:36 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:36.754275 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff1e7fe-f0bb-4c08-bfc6-d30d5297b126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:36.754912 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff1e7fe-f0bb-4c08-bfc6-d30d5297b126 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:36.755194 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff1e7fe-f0bb-4c08-bfc6-d30d5297b126 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:36.755467 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff1e7fe-f0bb-4c08-bfc6-d30d5297b126 None admin] PATH_INFO: `/v3/services` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:36.755739 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d658e1-05a4-4ded-bb75-b0ba6778e6b3 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:36.756097 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff1e7fe-f0bb-4c08-bfc6-d30d5297b126 None admin] RBAC: Adding query filter params (name=network) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:36.756399 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff1e7fe-f0bb-4c08-bfc6-d30d5297b126 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:36.757752 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff1e7fe-f0bb-4c08-bfc6-d30d5297b126 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:36.763718 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 362/715] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Sep 15 12:11:36 2022] GET /identity/v3/services?name=network => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:36.764652 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff1e7fe-f0bb-4c08-bfc6-d30d5297b126 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:36.769768 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:36.875690 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d658e1-05a4-4ded-bb75-b0ba6778e6b3 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:36.883209 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff1e7fe-f0bb-4c08-bfc6-d30d5297b126 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:36.915404 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5306cab-f32e-4ab1-ab94-fd343cc38aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:36.916563 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5306cab-f32e-4ab1-ab94-fd343cc38aac None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:36.917048 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5306cab-f32e-4ab1-ab94-fd343cc38aac None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:36.917522 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5306cab-f32e-4ab1-ab94-fd343cc38aac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:36.918513 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5306cab-f32e-4ab1-ab94-fd343cc38aac None admin] RBAC: Adding query filter params (role.id=9c9f10110e12479bb6b3b630dd6412b8, scope.project.id=cab958c081ad4a92939d4469cf4ce1c6, user.id=ee33b730d0ec428ca2cd3af4ebf723e8) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:36.919070 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5306cab-f32e-4ab1-ab94-fd343cc38aac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:36.920746 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5306cab-f32e-4ab1-ab94-fd343cc38aac None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:36.921873 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c141f0b0-0ba6-4de2-af0d-880deec7e9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:36.922477 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c141f0b0-0ba6-4de2-af0d-880deec7e9a2 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:36.922795 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c141f0b0-0ba6-4de2-af0d-880deec7e9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:36.923069 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c141f0b0-0ba6-4de2-af0d-880deec7e9a2 None admin] PATH_INFO: `/v3/services` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:36.923698 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c141f0b0-0ba6-4de2-af0d-880deec7e9a2 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:36.924001 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c141f0b0-0ba6-4de2-af0d-880deec7e9a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:36.925339 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c141f0b0-0ba6-4de2-af0d-880deec7e9a2 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:36.929882 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 354/716] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 15 12:11:36 2022] GET /identity/v3/role_assignments?user.id=ee33b730d0ec428ca2cd3af4ebf723e8&scope.project.id=cab958c081ad4a92939d4469cf4ce1c6&role.id=9c9f10110e12479bb6b3b630dd6412b8 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:36.931082 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5306cab-f32e-4ab1-ab94-fd343cc38aac None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:36.934862 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 363/717] 10.222.0.16 () {56 vars in 1124 bytes} [Thu Sep 15 12:11:36 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:36.947816 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c141f0b0-0ba6-4de2-af0d-880deec7e9a2 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:37.039763 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:37.041378 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:37.080625 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5306cab-f32e-4ab1-ab94-fd343cc38aac None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:37.128166 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b0936-7aa8-4615-b1ca-2f7eb9609f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:37.129278 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b0936-7aa8-4615-b1ca-2f7eb9609f9d None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:37.130591 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b0936-7aa8-4615-b1ca-2f7eb9609f9d None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:37.131358 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b0936-7aa8-4615-b1ca-2f7eb9609f9d None admin] PATH_INFO: `/v3/services` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:37.132497 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2b0936-7aa8-4615-b1ca-2f7eb9609f9d None admin] RBAC: Adding query filter params (type=network) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:37.134071 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2b0936-7aa8-4615-b1ca-2f7eb9609f9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:37.135758 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2b0936-7aa8-4615-b1ca-2f7eb9609f9d None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:37.150838 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 355/718] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Sep 15 12:11:36 2022] GET /identity/v3/services?type=network => generated 124 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:37.180660 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c141f0b0-0ba6-4de2-af0d-880deec7e9a2 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:37.221725 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e16dc02-e74d-4a62-ac6e-6cccb6d8bf2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:37.222827 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e16dc02-e74d-4a62-ac6e-6cccb6d8bf2e None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:37.223345 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e16dc02-e74d-4a62-ac6e-6cccb6d8bf2e None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:37.223825 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e16dc02-e74d-4a62-ac6e-6cccb6d8bf2e None admin] PATH_INFO: `/v3/services` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:37.224737 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e16dc02-e74d-4a62-ac6e-6cccb6d8bf2e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:37.225281 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e16dc02-e74d-4a62-ac6e-6cccb6d8bf2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:37.227062 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e16dc02-e74d-4a62-ac6e-6cccb6d8bf2e None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:37.234829 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 364/719] 10.222.0.16 () {56 vars in 1124 bytes} [Thu Sep 15 12:11:36 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:37.368882 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95da34-f1e7-4188-ac68-d5e8bd212bf0 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:37.369214 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95da34-f1e7-4188-ac68-d5e8bd212bf0 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:37.369431 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95da34-f1e7-4188-ac68-d5e8bd212bf0 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:37.371071 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 356/720] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:11:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:11:37.377631 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa2124-9f4c-4d75-8ff1-4c421ddd22fe None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:37.377999 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa2124-9f4c-4d75-8ff1-4c421ddd22fe None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:37.378345 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa2124-9f4c-4d75-8ff1-4c421ddd22fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:37.398479 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-f2fa2124-9f4c-4d75-8ff1-4c421ddd22fe None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:11:37.400002 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-f2fa2124-9f4c-4d75-8ff1-4c421ddd22fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:11:37.475078 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 365/721] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:11:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:11:37.760089 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae95da34-f1e7-4188-ac68-d5e8bd212bf0 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:37.887216 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae95da34-f1e7-4188-ac68-d5e8bd212bf0 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:37.935476 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daebcca-3f41-4532-af5d-e94cc4738010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:37.937062 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daebcca-3f41-4532-af5d-e94cc4738010 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:37.937539 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daebcca-3f41-4532-af5d-e94cc4738010 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:37.938018 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daebcca-3f41-4532-af5d-e94cc4738010 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:37.941718 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:37.950742 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daebcca-3f41-4532-af5d-e94cc4738010 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:11:37.956213 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-0daebcca-3f41-4532-af5d-e94cc4738010 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:11:37.956213 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:37.956213 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:37.956213 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:37.956213 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:37.956213 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:37.956213 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:37.956213 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:37.956213 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:37.956213 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:37.956213 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:37.956213 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:37.956213 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:11:37.956213 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:11:37.956213 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:11:37.956213 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:11:37.957156 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:11:37.957156 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:11:37.957156 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:11:37.957156 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:11:37.957156 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:37.957156 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:37.957156 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:37.957156 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:37.957156 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:37.957156 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:37.957156 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:37.957156 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:37.957156 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:37.957156 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:37.957156 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:37.957156 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:37.957992 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:37.957992 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:37.957992 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:37.957992 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:37.957992 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:11:37.957992 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:11:37.957992 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:11:37.957992 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:11:37.957992 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:11:37.957992 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:11:37.957992 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:11:37.957992 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:37.957992 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 357/722] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Sep 15 12:11:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:37.968856 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fa2124-9f4c-4d75-8ff1-4c421ddd22fe None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:38.005844 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:38.093103 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fa2124-9f4c-4d75-8ff1-4c421ddd22fe None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:38.137217 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f24f8e-cba0-445c-a35f-b183d655eaef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:38.137828 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f24f8e-cba0-445c-a35f-b183d655eaef None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:38.138104 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f24f8e-cba0-445c-a35f-b183d655eaef None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:38.138374 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f24f8e-cba0-445c-a35f-b183d655eaef None admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:38.139065 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f24f8e-cba0-445c-a35f-b183d655eaef None admin] RBAC: Adding query filter params (name=admin) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:38.139363 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f24f8e-cba0-445c-a35f-b183d655eaef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:38.140761 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f24f8e-cba0-445c-a35f-b183d655eaef None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:38.154985 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 366/723] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 15 12:11:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:38.160734 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daebcca-3f41-4532-af5d-e94cc4738010 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:38.295073 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daebcca-3f41-4532-af5d-e94cc4738010 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:38.348237 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb30ae2-2d9a-4e4d-ab65-036d15a6e491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:38.348796 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb30ae2-2d9a-4e4d-ab65-036d15a6e491 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:38.349072 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb30ae2-2d9a-4e4d-ab65-036d15a6e491 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:38.349340 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb30ae2-2d9a-4e4d-ab65-036d15a6e491 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:38.367862 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb30ae2-2d9a-4e4d-ab65-036d15a6e491 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:38.370177 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb30ae2-2d9a-4e4d-ab65-036d15a6e491 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:38.401587 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-edb30ae2-2d9a-4e4d-ab65-036d15a6e491 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:38.401587 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:38.401587 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:38.401587 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:38.401587 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:38.401587 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:38.401587 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:38.401587 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:38.401587 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:38.401587 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:38.401587 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:38.401587 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:38.401587 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:11:38.401587 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:11:38.401587 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:11:38.401587 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:11:38.402734 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:38.402734 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:38.402734 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:38.402734 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:38.402734 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:38.402734 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:38.402734 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:38.402734 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:38.402734 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:38.402734 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:38.402734 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:38.402734 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:38.402734 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:38.402734 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:38.402734 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:38.402734 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:38.402734 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:11:38.403680 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:11:38.403680 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:38.403680 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:38.403680 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 358/724] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:11:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:38.411744 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f24f8e-cba0-445c-a35f-b183d655eaef None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:38.571424 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:38.576384 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f24f8e-cba0-445c-a35f-b183d655eaef None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:38.622371 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb554671-8e69-4b3f-a9cd-7421b806fbd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:38.622933 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb554671-8e69-4b3f-a9cd-7421b806fbd8 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:38.623211 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb554671-8e69-4b3f-a9cd-7421b806fbd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:38.623480 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb554671-8e69-4b3f-a9cd-7421b806fbd8 None admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:38.624760 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb554671-8e69-4b3f-a9cd-7421b806fbd8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:38.625059 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb554671-8e69-4b3f-a9cd-7421b806fbd8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:38.626675 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb554671-8e69-4b3f-a9cd-7421b806fbd8 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:38.647092 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 367/725] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 15 12:11:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:38.652358 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb30ae2-2d9a-4e4d-ab65-036d15a6e491 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:38.714807 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:38.785709 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb30ae2-2d9a-4e4d-ab65-036d15a6e491 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:38.826250 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58cdb85-ecba-40b3-b5f5-7d665647260b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:38.826902 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58cdb85-ecba-40b3-b5f5-7d665647260b None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:38.827211 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58cdb85-ecba-40b3-b5f5-7d665647260b None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:38.827479 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58cdb85-ecba-40b3-b5f5-7d665647260b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:38.839539 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58cdb85-ecba-40b3-b5f5-7d665647260b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:38.841264 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58cdb85-ecba-40b3-b5f5-7d665647260b None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:38.853892 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-c58cdb85-ecba-40b3-b5f5-7d665647260b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 15 12:11:38.853892 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:38.853892 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:38.853892 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:38.853892 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:38.853892 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:38.853892 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:38.853892 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:38.853892 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:38.853892 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:38.853892 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:38.853892 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:38.853892 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 12:11:38.853892 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 12:11:38.853892 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 12:11:38.853892 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 12:11:38.854885 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:38.854885 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:38.854885 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 12:11:38.854885 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:11:38.854885 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 12:11:38.854885 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:11:38.854885 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:38.854885 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:38.854885 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:38.854885 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:38.854885 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:38.854885 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:38.854885 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:38.854885 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:38.854885 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:38.854885 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:38.854885 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:38.854885 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:38.855822 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:38.855822 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:38.855822 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 12:11:38.855822 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 12:11:38.855822 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 12:11:38.855822 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 12:11:38.855822 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 12:11:38.855822 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 12:11:38.855822 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 15 12:11:38.855822 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:38.858925 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 359/726] 10.222.0.16 () {56 vars in 1093 bytes} [Thu Sep 15 12:11:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:38.867785 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb554671-8e69-4b3f-a9cd-7421b806fbd8 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:38.937226 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1e365-a86c-404f-86a0-7aac941764c6 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:38.937862 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1e365-a86c-404f-86a0-7aac941764c6 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:38.938343 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1e365-a86c-404f-86a0-7aac941764c6 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:38.939985 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 360/727] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:11:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:11:38.950771 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcafcb89-caa3-40af-96d7-86bd911396c8 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:38.951409 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcafcb89-caa3-40af-96d7-86bd911396c8 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:38.951890 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcafcb89-caa3-40af-96d7-86bd911396c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:38.987154 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb554671-8e69-4b3f-a9cd-7421b806fbd8 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:38.990677 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-bcafcb89-caa3-40af-96d7-86bd911396c8 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:11:38.991902 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-bcafcb89-caa3-40af-96d7-86bd911396c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:11:39.024781 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa42a0f0-5ff0-4835-8d63-2c74dd2b6c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:39.025378 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa42a0f0-5ff0-4835-8d63-2c74dd2b6c3f None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:39.025654 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa42a0f0-5ff0-4835-8d63-2c74dd2b6c3f None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:39.025919 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa42a0f0-5ff0-4835-8d63-2c74dd2b6c3f None admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:39.026631 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa42a0f0-5ff0-4835-8d63-2c74dd2b6c3f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:39.026953 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa42a0f0-5ff0-4835-8d63-2c74dd2b6c3f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:39.028346 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa42a0f0-5ff0-4835-8d63-2c74dd2b6c3f None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:39.054863 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 368/728] 10.222.0.16 () {56 vars in 1133 bytes} [Thu Sep 15 12:11:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:39.060616 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa42a0f0-5ff0-4835-8d63-2c74dd2b6c3f None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:39.075101 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:39.133458 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 361/729] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:11:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 12:11:39.218459 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa42a0f0-5ff0-4835-8d63-2c74dd2b6c3f None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:39.271929 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cb44f5-9522-4eae-bd75-fd3771080436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:39.272560 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb44f5-9522-4eae-bd75-fd3771080436 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:39.272884 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb44f5-9522-4eae-bd75-fd3771080436 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:39.273155 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb44f5-9522-4eae-bd75-fd3771080436 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:39.286162 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cb44f5-9522-4eae-bd75-fd3771080436 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:39.287617 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cb44f5-9522-4eae-bd75-fd3771080436 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:39.304932 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-27cb44f5-9522-4eae-bd75-fd3771080436 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:39.304932 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:39.304932 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:39.304932 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:39.304932 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:39.304932 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:39.304932 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:39.304932 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:39.304932 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:39.304932 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:39.304932 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:39.304932 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:39.304932 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:11:39.304932 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:11:39.304932 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:11:39.304932 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:11:39.305907 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:39.305907 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:39.305907 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:39.305907 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:39.305907 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:39.305907 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:39.305907 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:39.305907 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:39.305907 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:39.305907 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:39.305907 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:39.305907 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:39.305907 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:39.305907 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:39.305907 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:39.305907 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:39.305907 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:11:39.306842 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:11:39.306842 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:39.306842 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:11:39.306842 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 369/730] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:11:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:11:39.312295 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcafcb89-caa3-40af-96d7-86bd911396c8 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:39.374485 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:39.447895 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcafcb89-caa3-40af-96d7-86bd911396c8 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:39.490369 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25910c05-4fc7-4ac3-a5b6-165391e963db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:39.490919 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25910c05-4fc7-4ac3-a5b6-165391e963db None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:39.491196 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25910c05-4fc7-4ac3-a5b6-165391e963db None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:39.491462 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25910c05-4fc7-4ac3-a5b6-165391e963db None admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:39.492098 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25910c05-4fc7-4ac3-a5b6-165391e963db None admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:39.492395 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25910c05-4fc7-4ac3-a5b6-165391e963db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:39.493752 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25910c05-4fc7-4ac3-a5b6-165391e963db None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:39.506671 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 362/731] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 15 12:11:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:39.512058 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cb44f5-9522-4eae-bd75-fd3771080436 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:39.580087 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:39.587472 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25910c05-4fc7-4ac3-a5b6-165391e963db None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:39.652634 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cb44f5-9522-4eae-bd75-fd3771080436 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:39.709558 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f544ae-c30d-4b9f-a023-331280bcc0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:39.710297 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f544ae-c30d-4b9f-a023-331280bcc0d6 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:39.710577 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f544ae-c30d-4b9f-a023-331280bcc0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:39.710874 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f544ae-c30d-4b9f-a023-331280bcc0d6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:39.718657 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f544ae-c30d-4b9f-a023-331280bcc0d6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:39.720232 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f544ae-c30d-4b9f-a023-331280bcc0d6 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:39.733996 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-e1f544ae-c30d-4b9f-a023-331280bcc0d6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:11:39.733996 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:39.733996 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:39.733996 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:39.733996 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:39.733996 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:39.733996 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:39.733996 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:39.733996 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:39.733996 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:39.733996 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:39.733996 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:39.733996 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 12:11:39.733996 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 12:11:39.733996 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 12:11:39.734987 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 12:11:39.734987 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:39.734987 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:39.734987 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:39.734987 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:39.734987 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:39.734987 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:39.734987 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:39.734987 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:39.734987 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:39.734987 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:39.734987 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:39.734987 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:39.734987 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:39.734987 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:39.734987 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:39.734987 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:39.736319 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 12:11:39.736319 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 12:11:39.736319 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 12:11:39.736319 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 12:11:39.736319 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 12:11:39.736319 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 12:11:39.736319 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:11:39.736319 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:11:39.736319 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 370/732] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 15 12:11:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:39.741454 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f544ae-c30d-4b9f-a023-331280bcc0d6 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:39.747725 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:39.758149 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25910c05-4fc7-4ac3-a5b6-165391e963db None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:39.828975 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e6a90f-0f23-472d-a6fd-3e489610069c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:39.829750 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e6a90f-0f23-472d-a6fd-3e489610069c None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:39.829910 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e6a90f-0f23-472d-a6fd-3e489610069c None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:39.830138 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e6a90f-0f23-472d-a6fd-3e489610069c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:39.844135 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e6a90f-0f23-472d-a6fd-3e489610069c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:11:39.851251 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-25e6a90f-0f23-472d-a6fd-3e489610069c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 12:11:39.851251 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:39.851251 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:39.851251 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:39.851251 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:39.851251 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:39.851251 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:39.851251 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:39.851251 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:39.851251 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:39.851251 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:39.851251 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:39.851251 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:11:39.851251 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:11:39.851251 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:11:39.851251 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:11:39.853269 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:11:39.853269 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:11:39.853269 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:11:39.853269 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:11:39.853269 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:39.853269 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:39.853269 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:39.853269 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:39.853269 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:39.853269 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:39.853269 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:39.853269 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:39.853269 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:39.853269 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:39.853269 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:39.853269 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:39.854947 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:39.854947 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:39.854947 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:39.854947 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:39.854947 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:11:39.854947 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:11:39.854947 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:11:39.854947 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:11:39.854947 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:11:39.854947 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:11:39.854947 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 12:11:39.854947 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:39.854947 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 363/733] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Sep 15 12:11:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:39.854947 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bf25f8-1945-4fd4-8a0f-e7bed1d5fd35 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:39.855980 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bf25f8-1945-4fd4-8a0f-e7bed1d5fd35 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:39.855980 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bf25f8-1945-4fd4-8a0f-e7bed1d5fd35 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:39.857227 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 364/734] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:11:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:11:39.862302 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd7cd6-e6c3-4d80-bfc7-12bce5bf9aeb None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:39.862719 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd7cd6-e6c3-4d80-bfc7-12bce5bf9aeb None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:39.863060 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd7cd6-e6c3-4d80-bfc7-12bce5bf9aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:39.883029 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-68cd7cd6-e6c3-4d80-bfc7-12bce5bf9aeb None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:11:39.884448 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-68cd7cd6-e6c3-4d80-bfc7-12bce5bf9aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:11:39.896055 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f544ae-c30d-4b9f-a023-331280bcc0d6 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:39.923828 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:39.939717 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f388cbc2-680d-440b-a954-b9903c21a893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:39.940349 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f388cbc2-680d-440b-a954-b9903c21a893 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:39.940627 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f388cbc2-680d-440b-a954-b9903c21a893 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:39.940898 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f388cbc2-680d-440b-a954-b9903c21a893 None admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:39.941626 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f388cbc2-680d-440b-a954-b9903c21a893 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:39.941931 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f388cbc2-680d-440b-a954-b9903c21a893 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:39.943492 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f388cbc2-680d-440b-a954-b9903c21a893 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:39.962925 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 371/735] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Sep 15 12:11:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:11:39.962925 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f388cbc2-680d-440b-a954-b9903c21a893 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:40.072077 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f388cbc2-680d-440b-a954-b9903c21a893 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:40.079578 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 365/736] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:11:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 12:11:40.081184 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff1b01-f1e2-45b3-b3fa-ff62e7f63dc8 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:40.081320 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff1b01-f1e2-45b3-b3fa-ff62e7f63dc8 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:40.081484 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff1b01-f1e2-45b3-b3fa-ff62e7f63dc8 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:40.083437 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 366/737] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:11:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:11:40.084420 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bff1b01-f1e2-45b3-b3fa-ff62e7f63dc8 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:40.107645 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e8437b-a20c-47a9-b9c1-1ce338c3bed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:40.108772 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e8437b-a20c-47a9-b9c1-1ce338c3bed0 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:40.109049 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e8437b-a20c-47a9-b9c1-1ce338c3bed0 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:40.109311 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e8437b-a20c-47a9-b9c1-1ce338c3bed0 None admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:40.109985 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e8437b-a20c-47a9-b9c1-1ce338c3bed0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:40.110253 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e8437b-a20c-47a9-b9c1-1ce338c3bed0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:40.111902 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e8437b-a20c-47a9-b9c1-1ce338c3bed0 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:40.125451 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 372/738] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Sep 15 12:11:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:40.125451 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0882f6-1268-44e9-a4d0-ef7303b5a768 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:40.125451 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0882f6-1268-44e9-a4d0-ef7303b5a768 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:40.125451 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0882f6-1268-44e9-a4d0-ef7303b5a768 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:40.125451 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 373/739] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:11:40 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:11:40.125451 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d65e3-eda8-4cbc-83a8-91ae06c548c6 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:40.125451 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d65e3-eda8-4cbc-83a8-91ae06c548c6 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:40.125985 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d65e3-eda8-4cbc-83a8-91ae06c548c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:40.143211 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-f24d65e3-eda8-4cbc-83a8-91ae06c548c6 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:11:40.144371 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-f24d65e3-eda8-4cbc-83a8-91ae06c548c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:11:40.185499 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:40.187664 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:40.199001 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bff1b01-f1e2-45b3-b3fa-ff62e7f63dc8 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:40.223852 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 374/740] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:11:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:11:40.225072 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24d65e3-eda8-4cbc-83a8-91ae06c548c6 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:40.242404 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8332c7b2-8f84-4819-b560-d79f2c5145d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:40.243371 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8332c7b2-8f84-4819-b560-d79f2c5145d0 None admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:40.243937 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8332c7b2-8f84-4819-b560-d79f2c5145d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:40.244423 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8332c7b2-8f84-4819-b560-d79f2c5145d0 None admin] PATH_INFO: `/v3/projects/cab958c081ad4a92939d4469cf4ce1c6/users/9d05c52570474820b4ba0e2cdad5c13f/roles/7f53f1c823b746529ba5057bf21b2477` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:40.246656 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8332c7b2-8f84-4819-b560-d79f2c5145d0 None admin] RBAC: Authorizing `identity:create_grant(project_id=cab958c081ad4a92939d4469cf4ce1c6, user_id=9d05c52570474820b4ba0e2cdad5c13f, role_id=7f53f1c823b746529ba5057bf21b2477)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:40.248419 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8332c7b2-8f84-4819-b560-d79f2c5145d0 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:40.265963 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 367/741] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Sep 15 12:11:40 2022] PUT /identity/v3/projects/cab958c081ad4a92939d4469cf4ce1c6/users/9d05c52570474820b4ba0e2cdad5c13f/roles/7f53f1c823b746529ba5057bf21b2477 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:11:40.267591 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7209a0a7-3804-4c2b-a63a-e9baa1e36d1c None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:40.268140 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7209a0a7-3804-4c2b-a63a-e9baa1e36d1c None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:40.268647 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7209a0a7-3804-4c2b-a63a-e9baa1e36d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:40.294258 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-7209a0a7-3804-4c2b-a63a-e9baa1e36d1c None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:11:40.297061 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-7209a0a7-3804-4c2b-a63a-e9baa1e36d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:11:40.343145 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24d65e3-eda8-4cbc-83a8-91ae06c548c6 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:40.392081 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff3c6f3-91e6-46bf-a09c-bc6c54bdf525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:40.392763 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff3c6f3-91e6-46bf-a09c-bc6c54bdf525 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:40.393068 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff3c6f3-91e6-46bf-a09c-bc6c54bdf525 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:40.393384 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff3c6f3-91e6-46bf-a09c-bc6c54bdf525 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:40.397557 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 368/742] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:11:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 12:11:40.398490 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7209a0a7-3804-4c2b-a63a-e9baa1e36d1c None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:40.415973 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff3c6f3-91e6-46bf-a09c-bc6c54bdf525 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:40.417458 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff3c6f3-91e6-46bf-a09c-bc6c54bdf525 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:40.448009 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-aff3c6f3-91e6-46bf-a09c-bc6c54bdf525 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:40.448009 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:40.448009 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:40.448009 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:40.448009 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:40.448009 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:40.448009 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:40.448009 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:40.448009 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:40.448009 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:40.448009 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:40.448009 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:40.448009 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:11:40.448009 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:11:40.448009 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:11:40.448009 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:11:40.449065 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:40.449065 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:40.449065 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:40.449065 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:40.449065 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:40.449065 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:40.449065 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:40.449065 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:40.449065 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:40.449065 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:40.449065 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:40.449065 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:40.449065 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:40.449065 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:40.449065 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:40.449065 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:40.449065 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:11:40.449958 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:11:40.449958 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:40.449958 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:11:40.449958 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 375/743] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:11:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:40.455683 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff3c6f3-91e6-46bf-a09c-bc6c54bdf525 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:40.497413 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:40.506768 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:40.524085 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7209a0a7-3804-4c2b-a63a-e9baa1e36d1c None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:40.562512 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f555bb3e-faa7-4f53-92e2-b2dbe4dca35a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:40.563284 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f555bb3e-faa7-4f53-92e2-b2dbe4dca35a None admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:40.563569 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f555bb3e-faa7-4f53-92e2-b2dbe4dca35a None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:40.563882 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f555bb3e-faa7-4f53-92e2-b2dbe4dca35a None admin] PATH_INFO: `/v3/services` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:40.564595 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f555bb3e-faa7-4f53-92e2-b2dbe4dca35a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:40.565975 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f555bb3e-faa7-4f53-92e2-b2dbe4dca35a None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:40.584251 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff3c6f3-91e6-46bf-a09c-bc6c54bdf525 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:40.585103 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 369/744] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Sep 15 12:11:40 2022] POST /identity/v3/services => generated 240 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:11:40.586055 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f555bb3e-faa7-4f53-92e2-b2dbe4dca35a None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:40.638542 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa6afdb-dfe6-4141-a7c2-0cbb1572e7f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:40.639121 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa6afdb-dfe6-4141-a7c2-0cbb1572e7f7 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:40.639401 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa6afdb-dfe6-4141-a7c2-0cbb1572e7f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:40.639786 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa6afdb-dfe6-4141-a7c2-0cbb1572e7f7 None admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:40.640458 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa6afdb-dfe6-4141-a7c2-0cbb1572e7f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:40.640764 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa6afdb-dfe6-4141-a7c2-0cbb1572e7f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:40.642253 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa6afdb-dfe6-4141-a7c2-0cbb1572e7f7 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:40.661726 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 376/745] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 15 12:11:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:40.669601 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa6afdb-dfe6-4141-a7c2-0cbb1572e7f7 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:40.771653 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:40.776550 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f555bb3e-faa7-4f53-92e2-b2dbe4dca35a None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:40.793220 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa6afdb-dfe6-4141-a7c2-0cbb1572e7f7 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:40.817188 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b5409b-3de0-4f3b-9718-07007216eeb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:40.818476 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5409b-3de0-4f3b-9718-07007216eeb8 None admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:40.818476 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5409b-3de0-4f3b-9718-07007216eeb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:40.818476 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5409b-3de0-4f3b-9718-07007216eeb8 None admin] PATH_INFO: `/v3/services` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:40.819015 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b5409b-3de0-4f3b-9718-07007216eeb8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:40.820386 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b5409b-3de0-4f3b-9718-07007216eeb8 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:40.831624 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:40.838143 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f00de3-0553-42eb-819b-d606aba30442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:40.838911 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f00de3-0553-42eb-819b-d606aba30442 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:40.839306 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f00de3-0553-42eb-819b-d606aba30442 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:40.839464 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 370/746] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Sep 15 12:11:40 2022] POST /identity/v3/services => generated 251 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:11:40.839559 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f00de3-0553-42eb-819b-d606aba30442 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:40.840580 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b5409b-3de0-4f3b-9718-07007216eeb8 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:40.850960 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f00de3-0553-42eb-819b-d606aba30442 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:40.852590 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f00de3-0553-42eb-819b-d606aba30442 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:40.870902 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-33f00de3-0553-42eb-819b-d606aba30442 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 15 12:11:40.870902 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:40.870902 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:40.870902 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:40.870902 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:40.870902 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:40.870902 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:40.870902 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:40.870902 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:40.870902 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:40.870902 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:40.870902 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:40.870902 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 12:11:40.870902 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 12:11:40.870902 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 12:11:40.870902 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 12:11:40.871903 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:40.871903 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:40.871903 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 12:11:40.871903 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:11:40.871903 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 12:11:40.871903 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:11:40.871903 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:40.871903 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:40.871903 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:40.871903 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:40.871903 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:40.871903 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:40.871903 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:40.871903 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:40.871903 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:40.871903 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:40.871903 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:40.871903 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:40.872917 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:40.872917 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:40.872917 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 12:11:40.872917 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 12:11:40.872917 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 12:11:40.872917 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 12:11:40.872917 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 12:11:40.872917 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 12:11:40.872917 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 15 12:11:40.872917 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:11:40.872917 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 377/747] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Sep 15 12:11:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:40.880031 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f00de3-0553-42eb-819b-d606aba30442 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:40.983829 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b5409b-3de0-4f3b-9718-07007216eeb8 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:41.018683 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f00de3-0553-42eb-819b-d606aba30442 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:41.044094 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22915ee7-a536-4b93-a929-95ed1db983b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:41.045056 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22915ee7-a536-4b93-a929-95ed1db983b9 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:41.045581 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22915ee7-a536-4b93-a929-95ed1db983b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:41.046553 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22915ee7-a536-4b93-a929-95ed1db983b9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:41.058233 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22915ee7-a536-4b93-a929-95ed1db983b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:11:41.064210 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-22915ee7-a536-4b93-a929-95ed1db983b9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:11:41.064210 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:41.064210 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:41.064210 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:41.064210 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:41.064210 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:41.064210 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:41.064210 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:41.064210 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:41.064210 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:41.064210 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:41.064210 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:41.064210 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:11:41.064210 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:11:41.064210 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:11:41.064210 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:11:41.065137 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:11:41.065137 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:11:41.065137 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:11:41.065137 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:11:41.065137 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:41.065137 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:41.065137 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:41.065137 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:41.065137 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:41.065137 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:41.065137 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:41.065137 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:41.065137 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:41.065137 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:41.065137 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:41.065137 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:41.065997 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:41.065997 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:41.065997 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:41.065997 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:41.065997 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:11:41.065997 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:11:41.065997 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:11:41.065997 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:11:41.065997 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:11:41.065997 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:11:41.065997 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:11:41.065997 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:41.068391 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 371/748] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Sep 15 12:11:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:41.074901 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22915ee7-a536-4b93-a929-95ed1db983b9 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:41.078828 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d43f4d-8c0c-4fd6-be14-8ce99b8abb29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:41.079465 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d43f4d-8c0c-4fd6-be14-8ce99b8abb29 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:41.079721 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d43f4d-8c0c-4fd6-be14-8ce99b8abb29 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:41.080164 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d43f4d-8c0c-4fd6-be14-8ce99b8abb29 None admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:41.080825 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d43f4d-8c0c-4fd6-be14-8ce99b8abb29 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:41.081136 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d43f4d-8c0c-4fd6-be14-8ce99b8abb29 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:41.082662 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d43f4d-8c0c-4fd6-be14-8ce99b8abb29 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:41.099985 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:41.105894 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 378/749] 10.222.0.16 () {56 vars in 1149 bytes} [Thu Sep 15 12:11:40 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:11:41.112050 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d43f4d-8c0c-4fd6-be14-8ce99b8abb29 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:41.150465 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:41.204232 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22915ee7-a536-4b93-a929-95ed1db983b9 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:41.230974 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d43f4d-8c0c-4fd6-be14-8ce99b8abb29 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:41.246354 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574694e0-546b-4f93-8cd6-6a864278a32e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:41.247485 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574694e0-546b-4f93-8cd6-6a864278a32e None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:41.248089 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574694e0-546b-4f93-8cd6-6a864278a32e None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:41.248579 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574694e0-546b-4f93-8cd6-6a864278a32e None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:41.249492 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574694e0-546b-4f93-8cd6-6a864278a32e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:41.249997 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574694e0-546b-4f93-8cd6-6a864278a32e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:41.252020 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574694e0-546b-4f93-8cd6-6a864278a32e None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:41.263172 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 372/750] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 15 12:11:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:41.268950 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574694e0-546b-4f93-8cd6-6a864278a32e None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:41.269847 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dbad7d-d932-4ff7-9294-26a93f2dde17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:41.270457 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dbad7d-d932-4ff7-9294-26a93f2dde17 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:41.270759 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dbad7d-d932-4ff7-9294-26a93f2dde17 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:41.271035 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dbad7d-d932-4ff7-9294-26a93f2dde17 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:41.352967 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:41.354601 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dbad7d-d932-4ff7-9294-26a93f2dde17 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:41.356994 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dbad7d-d932-4ff7-9294-26a93f2dde17 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:41.489181 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574694e0-546b-4f93-8cd6-6a864278a32e None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:41.520238 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:41.531785 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 379/751] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 15 12:11:41 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 15 12:11:41.537399 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dbad7d-d932-4ff7-9294-26a93f2dde17 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:41.558578 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0956b6df-ff7d-47dc-a98e-7918cbaef59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:41.559251 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0956b6df-ff7d-47dc-a98e-7918cbaef59a None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:41.559527 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0956b6df-ff7d-47dc-a98e-7918cbaef59a None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:41.559796 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0956b6df-ff7d-47dc-a98e-7918cbaef59a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:41.579983 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0956b6df-ff7d-47dc-a98e-7918cbaef59a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:41.581438 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0956b6df-ff7d-47dc-a98e-7918cbaef59a None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:41.602618 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-0956b6df-ff7d-47dc-a98e-7918cbaef59a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:41.602618 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:41.602618 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:41.602618 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:41.602618 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:41.602618 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:41.602618 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:41.602618 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:41.602618 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:41.602618 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:41.602618 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:41.602618 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:41.602618 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:11:41.602618 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:11:41.602618 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:11:41.602618 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:11:41.603802 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:41.603802 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:41.603802 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:41.603802 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:41.603802 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:41.603802 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:41.603802 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:41.603802 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:41.603802 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:41.603802 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:41.603802 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:41.603802 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:41.603802 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:41.603802 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:41.603802 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:41.603802 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:41.603802 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:11:41.604786 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:11:41.604786 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:41.604786 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:41.605342 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 373/752] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:11:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:11:41.611535 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0956b6df-ff7d-47dc-a98e-7918cbaef59a None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:41.712478 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:41.720321 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dbad7d-d932-4ff7-9294-26a93f2dde17 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:41.793018 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf4f747-a8d0-4a1d-adcf-4bdccb01b823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:41.794930 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf4f747-a8d0-4a1d-adcf-4bdccb01b823 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:41.795577 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf4f747-a8d0-4a1d-adcf-4bdccb01b823 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:41.797068 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf4f747-a8d0-4a1d-adcf-4bdccb01b823 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:41.817087 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0956b6df-ff7d-47dc-a98e-7918cbaef59a None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:41.818868 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf4f747-a8d0-4a1d-adcf-4bdccb01b823 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:41.820552 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf4f747-a8d0-4a1d-adcf-4bdccb01b823 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:41.848101 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-ccf4f747-a8d0-4a1d-adcf-4bdccb01b823 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:41.848101 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:41.848101 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:41.848101 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:41.848101 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:41.848101 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:41.848101 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:41.848101 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:41.848101 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:41.848101 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:41.848101 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:41.848101 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:41.848101 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:11:41.848101 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:11:41.848101 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:11:41.848101 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:11:41.849124 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:41.849124 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:41.849124 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:41.849124 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:41.849124 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:41.849124 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:41.849124 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:41.849124 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:41.849124 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:41.849124 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:41.849124 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:41.849124 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:41.849124 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:41.849124 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:41.849124 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:41.849124 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:41.849124 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:11:41.850005 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:11:41.850005 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:41.850005 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:11:41.852175 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 380/753] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:11:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:41.857706 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf4f747-a8d0-4a1d-adcf-4bdccb01b823 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:41.891516 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc79fce-254f-4bb4-aa4c-990edcafd66d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:41.892170 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc79fce-254f-4bb4-aa4c-990edcafd66d None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:41.892452 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc79fce-254f-4bb4-aa4c-990edcafd66d None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:41.892729 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc79fce-254f-4bb4-aa4c-990edcafd66d None admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:41.893473 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc79fce-254f-4bb4-aa4c-990edcafd66d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:41.893677 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc79fce-254f-4bb4-aa4c-990edcafd66d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:41.895096 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc79fce-254f-4bb4-aa4c-990edcafd66d None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:41.916423 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 374/754] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 15 12:11:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:41.919655 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc79fce-254f-4bb4-aa4c-990edcafd66d None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:41.961405 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:41.974435 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf4f747-a8d0-4a1d-adcf-4bdccb01b823 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:42.042119 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d4d373-fadc-4302-a183-dda518a88bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:42.042743 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d4d373-fadc-4302-a183-dda518a88bc3 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:42.043078 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d4d373-fadc-4302-a183-dda518a88bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:42.043293 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d4d373-fadc-4302-a183-dda518a88bc3 None admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:42.043939 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d4d373-fadc-4302-a183-dda518a88bc3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:42.044239 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d4d373-fadc-4302-a183-dda518a88bc3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:42.045588 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d4d373-fadc-4302-a183-dda518a88bc3 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:42.074058 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 381/755] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 15 12:11:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:42.081583 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d4d373-fadc-4302-a183-dda518a88bc3 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:42.086608 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc79fce-254f-4bb4-aa4c-990edcafd66d None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:42.118772 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:42.129443 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4ccc7a-31c7-406b-9e2a-c196bd7017ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:42.130332 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ccc7a-31c7-406b-9e2a-c196bd7017ae None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:42.130973 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ccc7a-31c7-406b-9e2a-c196bd7017ae None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:42.131450 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ccc7a-31c7-406b-9e2a-c196bd7017ae None admin] PATH_INFO: `/v3/users/swift` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:42.143799 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4ccc7a-31c7-406b-9e2a-c196bd7017ae None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:42.146584 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4ccc7a-31c7-406b-9e2a-c196bd7017ae None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:42.166554 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-8a4ccc7a-31c7-406b-9e2a-c196bd7017ae None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 15 12:11:42.166554 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:42.166554 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:42.166554 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:42.166554 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:42.166554 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:42.166554 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:42.166554 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:42.166554 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:42.166554 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:42.166554 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:42.166554 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:42.166554 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 12:11:42.166554 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 12:11:42.166554 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 12:11:42.166554 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 12:11:42.167596 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:42.167596 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:42.167596 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 12:11:42.167596 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:11:42.167596 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 12:11:42.167596 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:11:42.167596 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:42.167596 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:42.167596 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:42.167596 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:42.167596 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:42.167596 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:42.167596 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:42.167596 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:42.167596 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:42.167596 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:42.167596 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:42.167596 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:42.168554 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:42.168554 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:42.168554 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 12:11:42.168554 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 12:11:42.168554 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 12:11:42.168554 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 12:11:42.168554 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 12:11:42.168554 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 12:11:42.168554 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 15 12:11:42.168554 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:42.180168 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 375/756] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Sep 15 12:11:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:42.185685 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4ccc7a-31c7-406b-9e2a-c196bd7017ae None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:42.269106 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d4d373-fadc-4302-a183-dda518a88bc3 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:42.308209 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3013a17-9814-45a7-a0ef-d9dc9d87455b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:42.308756 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3013a17-9814-45a7-a0ef-d9dc9d87455b None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:42.309030 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3013a17-9814-45a7-a0ef-d9dc9d87455b None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:42.309293 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3013a17-9814-45a7-a0ef-d9dc9d87455b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:42.321261 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3013a17-9814-45a7-a0ef-d9dc9d87455b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:42.322711 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3013a17-9814-45a7-a0ef-d9dc9d87455b None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:42.343325 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-d3013a17-9814-45a7-a0ef-d9dc9d87455b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:11:42.343325 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:42.343325 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:42.343325 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:42.343325 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:42.343325 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:42.343325 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:42.343325 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:42.343325 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:42.343325 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:42.343325 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:42.343325 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:42.343325 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 12:11:42.343325 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 12:11:42.343325 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 12:11:42.344262 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 12:11:42.344262 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:42.344262 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:42.344262 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:42.344262 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:42.344262 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:42.344262 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:42.344262 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:42.344262 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:42.344262 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:42.344262 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:42.344262 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:42.344262 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:42.344262 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:42.344262 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:42.344262 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:42.344262 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:42.345146 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 12:11:42.345146 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 12:11:42.345146 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 12:11:42.345146 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 12:11:42.345146 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 12:11:42.345146 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 12:11:42.345146 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:11:42.345146 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:11:42.345146 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 382/757] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 15 12:11:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:11:42.355683 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3013a17-9814-45a7-a0ef-d9dc9d87455b None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:42.356453 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:42.367815 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4ccc7a-31c7-406b-9e2a-c196bd7017ae None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:42.403781 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4048ccd4-c730-404d-8e55-f9651550f3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:42.404389 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4048ccd4-c730-404d-8e55-f9651550f3fb None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:42.404942 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4048ccd4-c730-404d-8e55-f9651550f3fb None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:42.405250 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4048ccd4-c730-404d-8e55-f9651550f3fb None admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:42.406139 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4048ccd4-c730-404d-8e55-f9651550f3fb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:42.406446 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4048ccd4-c730-404d-8e55-f9651550f3fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:42.407917 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4048ccd4-c730-404d-8e55-f9651550f3fb None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:42.428954 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 376/758] 10.222.0.16 () {56 vars in 1135 bytes} [Thu Sep 15 12:11:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:42.434388 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4048ccd4-c730-404d-8e55-f9651550f3fb None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:42.490316 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:42.538397 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3013a17-9814-45a7-a0ef-d9dc9d87455b None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:42.606310 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8a0c98-94a6-43a3-9d8d-5d75ccb67667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:42.607307 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a0c98-94a6-43a3-9d8d-5d75ccb67667 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:42.609119 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a0c98-94a6-43a3-9d8d-5d75ccb67667 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:42.609687 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a0c98-94a6-43a3-9d8d-5d75ccb67667 None admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:42.610607 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8a0c98-94a6-43a3-9d8d-5d75ccb67667 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:42.611618 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8a0c98-94a6-43a3-9d8d-5d75ccb67667 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:42.615320 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8a0c98-94a6-43a3-9d8d-5d75ccb67667 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:42.639066 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 383/759] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Sep 15 12:11:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:42.646115 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4048ccd4-c730-404d-8e55-f9651550f3fb None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:42.647283 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8a0c98-94a6-43a3-9d8d-5d75ccb67667 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:42.714903 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075cdeef-f282-45ef-a7fa-c96c3c22b1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:42.721923 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075cdeef-f282-45ef-a7fa-c96c3c22b1ff None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:42.722521 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075cdeef-f282-45ef-a7fa-c96c3c22b1ff None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:42.723018 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075cdeef-f282-45ef-a7fa-c96c3c22b1ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:42.741637 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:42.825944 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8a0c98-94a6-43a3-9d8d-5d75ccb67667 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:42.843700 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075cdeef-f282-45ef-a7fa-c96c3c22b1ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:42.845167 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075cdeef-f282-45ef-a7fa-c96c3c22b1ff None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:42.857594 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:42.872348 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679655c2-6c42-40f6-98e0-8ccbdf869ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:42.872979 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679655c2-6c42-40f6-98e0-8ccbdf869ef4 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:42.873241 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679655c2-6c42-40f6-98e0-8ccbdf869ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:42.873507 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679655c2-6c42-40f6-98e0-8ccbdf869ef4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:42.874280 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679655c2-6c42-40f6-98e0-8ccbdf869ef4 None admin] RBAC: Adding query filter params (role.id=9c9f10110e12479bb6b3b630dd6412b8, scope.project.id=cab958c081ad4a92939d4469cf4ce1c6, user.id=b4614bede59c47ea813a73fcc0840a2d) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:42.874584 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679655c2-6c42-40f6-98e0-8ccbdf869ef4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:42.876031 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679655c2-6c42-40f6-98e0-8ccbdf869ef4 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:42.890183 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 384/760] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 15 12:11:42 2022] GET /identity/v3/role_assignments?user.id=b4614bede59c47ea813a73fcc0840a2d&scope.project.id=cab958c081ad4a92939d4469cf4ce1c6&role.id=9c9f10110e12479bb6b3b630dd6412b8 => generated 259 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:42.957560 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 377/761] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 15 12:11:42 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 12:11:42.958879 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa7d8f7-44c5-4cde-9a89-235a616a619d None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:42.959166 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa7d8f7-44c5-4cde-9a89-235a616a619d None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:42.959438 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa7d8f7-44c5-4cde-9a89-235a616a619d None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:42.961189 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 385/762] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:11:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:11:42.971330 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075cdeef-f282-45ef-a7fa-c96c3c22b1ff None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:42.972111 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa29b2-df9a-414c-a51f-ab5c43f2470e None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:42.972393 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa29b2-df9a-414c-a51f-ab5c43f2470e None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:42.972676 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa29b2-df9a-414c-a51f-ab5c43f2470e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:42.995869 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-f7aa29b2-df9a-414c-a51f-ab5c43f2470e None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:11:42.997081 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-f7aa29b2-df9a-414c-a51f-ab5c43f2470e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:11:43.073446 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:43.107419 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 386/763] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:11:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:11:43.110033 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a5c83-3cb5-4518-89d3-2e4eecbc48f3 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:43.110033 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a5c83-3cb5-4518-89d3-2e4eecbc48f3 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:43.110302 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a5c83-3cb5-4518-89d3-2e4eecbc48f3 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:43.112090 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 387/764] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:11:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:11:43.117261 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753d812-214c-4e7f-a18e-67cc98eb90bb None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:43.117538 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753d812-214c-4e7f-a18e-67cc98eb90bb None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:43.117806 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753d812-214c-4e7f-a18e-67cc98eb90bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:43.139228 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-b753d812-214c-4e7f-a18e-67cc98eb90bb None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:11:43.140978 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-b753d812-214c-4e7f-a18e-67cc98eb90bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:11:43.146366 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075cdeef-f282-45ef-a7fa-c96c3c22b1ff None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:43.186872 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19348a38-7d17-4789-a447-fa87a42d3ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:43.187880 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19348a38-7d17-4789-a447-fa87a42d3ac5 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:43.188160 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19348a38-7d17-4789-a447-fa87a42d3ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:43.188485 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19348a38-7d17-4789-a447-fa87a42d3ac5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:43.201479 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19348a38-7d17-4789-a447-fa87a42d3ac5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:43.203954 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19348a38-7d17-4789-a447-fa87a42d3ac5 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:43.215854 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 388/765] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:11:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:11:43.224207 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-19348a38-7d17-4789-a447-fa87a42d3ac5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:43.224207 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:43.224207 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:43.224207 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:43.224207 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:43.224207 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:43.224207 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:43.224207 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:43.224207 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:43.224207 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:43.224207 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:43.224207 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:43.224207 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:11:43.224207 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:11:43.224207 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:11:43.224207 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:11:43.225192 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:43.225192 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:43.225192 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:43.225192 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:43.225192 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:43.225192 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:43.225192 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:43.225192 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:43.225192 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:43.225192 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:43.225192 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:43.225192 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:43.225192 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:43.225192 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:43.225192 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:43.225192 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:43.225192 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:11:43.226082 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:11:43.226082 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:43.226082 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:43.226082 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 378/766] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:11:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:43.233795 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b753d812-214c-4e7f-a18e-67cc98eb90bb None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:43.301266 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:43.356334 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b753d812-214c-4e7f-a18e-67cc98eb90bb None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:43.394562 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4027f12-81c8-40a7-bfa3-2971d91f44b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:43.395122 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4027f12-81c8-40a7-bfa3-2971d91f44b9 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:43.395402 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4027f12-81c8-40a7-bfa3-2971d91f44b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:43.395672 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4027f12-81c8-40a7-bfa3-2971d91f44b9 None admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:43.396311 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4027f12-81c8-40a7-bfa3-2971d91f44b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:43.396611 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4027f12-81c8-40a7-bfa3-2971d91f44b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:43.397963 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4027f12-81c8-40a7-bfa3-2971d91f44b9 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:43.410164 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 389/767] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 15 12:11:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:43.415156 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19348a38-7d17-4789-a447-fa87a42d3ac5 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:43.500303 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4027f12-81c8-40a7-bfa3-2971d91f44b9 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:43.522215 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:43.526348 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19348a38-7d17-4789-a447-fa87a42d3ac5 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:43.561613 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865aaf7b-8728-469e-809b-820184d4f88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:43.562248 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865aaf7b-8728-469e-809b-820184d4f88f None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:43.562516 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865aaf7b-8728-469e-809b-820184d4f88f None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:43.562827 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865aaf7b-8728-469e-809b-820184d4f88f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:43.569760 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865aaf7b-8728-469e-809b-820184d4f88f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:43.571250 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865aaf7b-8728-469e-809b-820184d4f88f None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:43.583788 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-865aaf7b-8728-469e-809b-820184d4f88f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:11:43.583788 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:43.583788 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:43.583788 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:43.583788 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:43.583788 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:43.583788 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:43.583788 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:43.583788 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:43.583788 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:43.583788 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:43.583788 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:43.583788 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 12:11:43.583788 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 12:11:43.583788 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 12:11:43.584822 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 12:11:43.584822 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:43.584822 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:43.584822 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:43.584822 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:43.584822 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:43.584822 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:43.584822 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:43.584822 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:43.584822 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:43.584822 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:43.584822 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:43.584822 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:43.584822 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:43.584822 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:43.584822 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:43.584822 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:43.585702 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 12:11:43.585702 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 12:11:43.585702 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 12:11:43.585702 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 12:11:43.585702 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 12:11:43.585702 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 12:11:43.585702 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:11:43.585702 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:43.585702 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 379/768] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 15 12:11:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:43.586179 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865aaf7b-8728-469e-809b-820184d4f88f None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:43.632413 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4027f12-81c8-40a7-bfa3-2971d91f44b9 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:43.649869 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:43.672330 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa57dfac-2f18-48ab-917d-a19718d2c419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:43.673585 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57dfac-2f18-48ab-917d-a19718d2c419 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:43.674035 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57dfac-2f18-48ab-917d-a19718d2c419 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:43.674495 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57dfac-2f18-48ab-917d-a19718d2c419 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:43.686013 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa57dfac-2f18-48ab-917d-a19718d2c419 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:11:43.691956 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-fa57dfac-2f18-48ab-917d-a19718d2c419 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:11:43.691956 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:43.691956 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:43.691956 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:43.691956 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:43.691956 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:43.691956 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:43.691956 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:43.691956 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:43.691956 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:43.691956 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:43.691956 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:43.691956 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:11:43.691956 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:11:43.691956 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:11:43.691956 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:11:43.692848 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:11:43.692848 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:11:43.692848 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:11:43.692848 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:11:43.692848 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:43.692848 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:43.692848 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:43.692848 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:43.692848 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:43.692848 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:43.692848 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:43.692848 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:43.692848 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:43.692848 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:43.692848 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:43.692848 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:43.693683 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:43.693683 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:43.693683 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:43.693683 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:43.693683 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:11:43.693683 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:11:43.693683 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:11:43.693683 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:11:43.693683 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:11:43.693683 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:11:43.693683 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:11:43.693683 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:11:43.696222 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 390/769] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Sep 15 12:11:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:43.697190 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa57dfac-2f18-48ab-917d-a19718d2c419 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:43.708317 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865aaf7b-8728-469e-809b-820184d4f88f None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:43.744566 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b2d674-b87f-4a95-8138-f8f09971f7c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:43.745196 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b2d674-b87f-4a95-8138-f8f09971f7c8 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:43.745467 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b2d674-b87f-4a95-8138-f8f09971f7c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:43.745737 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b2d674-b87f-4a95-8138-f8f09971f7c8 None admin] PATH_INFO: `/v3/services/network` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:43.746316 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b2d674-b87f-4a95-8138-f8f09971f7c8 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:43.747719 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b2d674-b87f-4a95-8138-f8f09971f7c8 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:43.757832 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-30b2d674-b87f-4a95-8138-f8f09971f7c8 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 15 12:11:43.757832 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:43.757832 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 12:11:43.757832 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 12:11:43.757832 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 12:11:43.757832 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 12:11:43.757832 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 12:11:43.757832 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:11:43.757832 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 15 12:11:43.757832 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:43.757832 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 12:11:43.757832 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:43.757832 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:43.757832 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:43.757832 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:43.757832 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:43.757832 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:43.758874 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:43.758874 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:43.758874 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:43.758874 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:43.758874 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:43.758874 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:43.758874 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 12:11:43.758874 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 12:11:43.758874 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 12:11:43.758874 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 12:11:43.758874 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:43.758874 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:43.758874 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:43.758874 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:43.758874 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:43.758874 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:43.760228 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:43.760228 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:43.760228 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:43.760228 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:43.760228 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:43.760228 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:43.760228 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:43.760228 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:43.760228 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:43.760228 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:43.760228 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 12:11:43.760228 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:11:43.760228 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 15 12:11:43.760228 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:43.760228 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 380/770] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 15 12:11:43 2022] GET /identity/v3/services/network => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:43.761029 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b2d674-b87f-4a95-8138-f8f09971f7c8 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:43.788378 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:43.822611 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa57dfac-2f18-48ab-917d-a19718d2c419 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:43.859354 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bcaed1-3ca7-4b9b-ab7a-f4f6da884a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:43.859954 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bcaed1-3ca7-4b9b-ab7a-f4f6da884a09 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:43.860234 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bcaed1-3ca7-4b9b-ab7a-f4f6da884a09 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:43.860505 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bcaed1-3ca7-4b9b-ab7a-f4f6da884a09 None admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:43.861190 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bcaed1-3ca7-4b9b-ab7a-f4f6da884a09 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:43.861510 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bcaed1-3ca7-4b9b-ab7a-f4f6da884a09 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:43.862945 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bcaed1-3ca7-4b9b-ab7a-f4f6da884a09 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:43.871387 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b2d674-b87f-4a95-8138-f8f09971f7c8 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:43.875759 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 391/771] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Sep 15 12:11:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:43.877302 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3495af1-a1c0-47cf-bf50-5226aa5b6e2d None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:43.877596 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3495af1-a1c0-47cf-bf50-5226aa5b6e2d None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:43.877868 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3495af1-a1c0-47cf-bf50-5226aa5b6e2d None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:43.883459 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 392/772] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:11:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:11:43.884245 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3495af1-a1c0-47cf-bf50-5226aa5b6e2d None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:43.908519 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951d8c54-7573-47cd-8586-2ebb02841b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:43.909460 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d8c54-7573-47cd-8586-2ebb02841b17 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:43.909927 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d8c54-7573-47cd-8586-2ebb02841b17 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:43.910264 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d8c54-7573-47cd-8586-2ebb02841b17 None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:43.910944 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951d8c54-7573-47cd-8586-2ebb02841b17 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:43.911247 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951d8c54-7573-47cd-8586-2ebb02841b17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:43.912645 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951d8c54-7573-47cd-8586-2ebb02841b17 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:43.921594 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 381/773] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 15 12:11:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:43.922171 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:43.927093 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951d8c54-7573-47cd-8586-2ebb02841b17 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:43.995212 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3495af1-a1c0-47cf-bf50-5226aa5b6e2d None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:44.022352 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:44.035787 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8647b98-8fc8-4cbb-9470-426260013e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:44.036466 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8647b98-8fc8-4cbb-9470-426260013e4f None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:44.036805 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8647b98-8fc8-4cbb-9470-426260013e4f None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:44.037144 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8647b98-8fc8-4cbb-9470-426260013e4f None admin] PATH_INFO: `/v3/services` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:44.037765 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8647b98-8fc8-4cbb-9470-426260013e4f None admin] RBAC: Adding query filter params (name=network) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:44.038063 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8647b98-8fc8-4cbb-9470-426260013e4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:44.039294 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951d8c54-7573-47cd-8586-2ebb02841b17 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:44.039463 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8647b98-8fc8-4cbb-9470-426260013e4f None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:44.049620 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 393/774] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Sep 15 12:11:43 2022] GET /identity/v3/services?name=network => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:44.049620 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1c0eb-5e9c-43e5-a680-c3e3f128b9e9 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:44.049620 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1c0eb-5e9c-43e5-a680-c3e3f128b9e9 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:44.049620 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1c0eb-5e9c-43e5-a680-c3e3f128b9e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:44.069911 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-73f1c0eb-5e9c-43e5-a680-c3e3f128b9e9 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:11:44.071428 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-73f1c0eb-5e9c-43e5-a680-c3e3f128b9e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:11:44.074929 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ea4a6e-d948-40a6-84db-9f587624c71c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:44.075540 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea4a6e-d948-40a6-84db-9f587624c71c None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:44.075817 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea4a6e-d948-40a6-84db-9f587624c71c None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:44.076088 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea4a6e-d948-40a6-84db-9f587624c71c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:44.076810 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ea4a6e-d948-40a6-84db-9f587624c71c None admin] RBAC: Adding query filter params (role.id=7f53f1c823b746529ba5057bf21b2477, scope.project.id=cab958c081ad4a92939d4469cf4ce1c6, user.id=ee33b730d0ec428ca2cd3af4ebf723e8) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:44.077146 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ea4a6e-d948-40a6-84db-9f587624c71c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:44.080018 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ea4a6e-d948-40a6-84db-9f587624c71c None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:44.086619 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 382/775] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 15 12:11:43 2022] GET /identity/v3/role_assignments?user.id=ee33b730d0ec428ca2cd3af4ebf723e8&scope.project.id=cab958c081ad4a92939d4469cf4ce1c6&role.id=7f53f1c823b746529ba5057bf21b2477 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:44.087545 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ea4a6e-d948-40a6-84db-9f587624c71c None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:44.170500 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 394/776] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:11:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:11:44.170500 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f1c0eb-5e9c-43e5-a680-c3e3f128b9e9 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:44.229749 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ea4a6e-d948-40a6-84db-9f587624c71c None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:44.235984 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:44.312370 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af239d08-5d44-420f-ad35-e3fd2bd0852d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:44.313011 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af239d08-5d44-420f-ad35-e3fd2bd0852d None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:44.313282 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af239d08-5d44-420f-ad35-e3fd2bd0852d None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:44.313547 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af239d08-5d44-420f-ad35-e3fd2bd0852d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:44.327469 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af239d08-5d44-420f-ad35-e3fd2bd0852d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:44.329062 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af239d08-5d44-420f-ad35-e3fd2bd0852d None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:44.338828 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:44.351099 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-af239d08-5d44-420f-ad35-e3fd2bd0852d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:44.351099 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:44.351099 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:44.351099 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:44.351099 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:44.351099 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:44.351099 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:44.351099 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:44.351099 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:44.351099 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:44.351099 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:44.351099 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:44.351099 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:11:44.351099 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:11:44.351099 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:11:44.351099 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:11:44.352280 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:44.352280 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:44.352280 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:44.352280 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:44.352280 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:44.352280 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:44.352280 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:44.352280 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:44.352280 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:44.352280 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:44.352280 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:44.352280 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:44.352280 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:44.352280 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:44.352280 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:44.352280 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:44.352280 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:11:44.353364 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:11:44.353364 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:44.353364 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:44.359675 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 383/777] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:11:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:44.366763 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af239d08-5d44-420f-ad35-e3fd2bd0852d None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:44.379197 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f1c0eb-5e9c-43e5-a680-c3e3f128b9e9 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:44.455053 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898325da-f8fa-48d6-9565-71961d4bc488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:44.456169 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898325da-f8fa-48d6-9565-71961d4bc488 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:44.456749 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898325da-f8fa-48d6-9565-71961d4bc488 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:44.457264 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898325da-f8fa-48d6-9565-71961d4bc488 None admin] PATH_INFO: `/v3/services` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:44.458322 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898325da-f8fa-48d6-9565-71961d4bc488 None admin] RBAC: Adding query filter params (type=network) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:44.458923 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898325da-f8fa-48d6-9565-71961d4bc488 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:44.462566 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898325da-f8fa-48d6-9565-71961d4bc488 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:44.472668 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 395/778] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Sep 15 12:11:44 2022] GET /identity/v3/services?type=network => generated 350 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:44.474069 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898325da-f8fa-48d6-9565-71961d4bc488 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:44.529776 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af239d08-5d44-420f-ad35-e3fd2bd0852d None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:44.568798 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a41475-fbbb-4e75-b58b-fe8c0b7dc16a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:44.569403 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a41475-fbbb-4e75-b58b-fe8c0b7dc16a None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:44.569682 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a41475-fbbb-4e75-b58b-fe8c0b7dc16a None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:44.570009 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a41475-fbbb-4e75-b58b-fe8c0b7dc16a None admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:44.570654 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a41475-fbbb-4e75-b58b-fe8c0b7dc16a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:44.570987 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a41475-fbbb-4e75-b58b-fe8c0b7dc16a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:44.572406 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a41475-fbbb-4e75-b58b-fe8c0b7dc16a None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:44.585307 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 384/779] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 15 12:11:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:44.586124 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a41475-fbbb-4e75-b58b-fe8c0b7dc16a None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:44.594711 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:44.601613 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898325da-f8fa-48d6-9565-71961d4bc488 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:44.641401 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7625ce9a-d662-4a48-8e10-b8e730050dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:44.642027 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625ce9a-d662-4a48-8e10-b8e730050dff None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:44.642304 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625ce9a-d662-4a48-8e10-b8e730050dff None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:44.642574 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625ce9a-d662-4a48-8e10-b8e730050dff None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:44.643189 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7625ce9a-d662-4a48-8e10-b8e730050dff None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:44.644530 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7625ce9a-d662-4a48-8e10-b8e730050dff None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:44.650175 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:44.657770 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-7625ce9a-d662-4a48-8e10-b8e730050dff None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 15 12:11:44.657770 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:44.657770 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 12:11:44.657770 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 12:11:44.657770 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 12:11:44.657770 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 12:11:44.657770 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 12:11:44.657770 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:11:44.657770 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 15 12:11:44.657770 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:11:44.657770 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 12:11:44.657770 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:11:44.657770 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:44.657770 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:44.657770 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:44.657770 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:44.657770 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:44.658954 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:44.658954 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:44.658954 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:44.658954 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:44.658954 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:44.658954 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:44.658954 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 12:11:44.658954 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 12:11:44.658954 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 12:11:44.658954 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 12:11:44.658954 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:44.658954 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:44.658954 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:44.658954 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:44.658954 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:44.658954 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:44.663754 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:44.663754 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:44.663754 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:44.663754 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:44.663754 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:44.663754 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:44.663754 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:44.663754 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:44.663754 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:44.663754 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:44.663754 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 12:11:44.663754 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:11:44.663754 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 15 12:11:44.663754 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:11:44.663754 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 396/780] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Sep 15 12:11:44 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:44.664584 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7625ce9a-d662-4a48-8e10-b8e730050dff None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:44.703407 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a41475-fbbb-4e75-b58b-fe8c0b7dc16a None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:44.739868 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37952de7-696a-474d-bfc5-0dda2809f42b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:44.740725 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37952de7-696a-474d-bfc5-0dda2809f42b None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:44.741185 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37952de7-696a-474d-bfc5-0dda2809f42b None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:44.741618 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37952de7-696a-474d-bfc5-0dda2809f42b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:44.742546 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37952de7-696a-474d-bfc5-0dda2809f42b None admin] RBAC: Adding query filter params (interface=public, service_id=034ef66bfec4411caeecc0fd493e4f82, region_id=RegionOne) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:44.743058 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37952de7-696a-474d-bfc5-0dda2809f42b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:44.744652 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37952de7-696a-474d-bfc5-0dda2809f42b None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:44.753254 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 385/781] 10.222.0.16 () {56 vars in 1251 bytes} [Thu Sep 15 12:11:44 2022] GET /identity/v3/endpoints?service_id=034ef66bfec4411caeecc0fd493e4f82&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:44.754429 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37952de7-696a-474d-bfc5-0dda2809f42b None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:44.774492 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7625ce9a-d662-4a48-8e10-b8e730050dff None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:44.811770 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40432351-6d9c-44a7-9861-b8f221686af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:44.812470 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40432351-6d9c-44a7-9861-b8f221686af5 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:44.812744 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40432351-6d9c-44a7-9861-b8f221686af5 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:44.813009 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40432351-6d9c-44a7-9861-b8f221686af5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:44.822997 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40432351-6d9c-44a7-9861-b8f221686af5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:44.824932 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40432351-6d9c-44a7-9861-b8f221686af5 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:44.838291 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-40432351-6d9c-44a7-9861-b8f221686af5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 15 12:11:44.838291 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:44.838291 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:44.838291 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:44.838291 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:44.838291 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:44.838291 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:44.838291 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:44.838291 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:44.838291 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:44.838291 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:44.838291 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:44.838291 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 12:11:44.838291 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 12:11:44.838291 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 12:11:44.838291 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 12:11:44.839300 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:44.839300 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:44.839300 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 12:11:44.839300 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:11:44.839300 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 12:11:44.839300 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:11:44.839300 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:44.839300 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:44.839300 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:44.839300 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:44.839300 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:44.839300 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:44.839300 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:44.839300 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:44.839300 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:44.839300 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:44.839300 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:44.839300 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:44.840282 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:44.840282 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:44.840282 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 12:11:44.840282 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 12:11:44.840282 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 12:11:44.840282 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 12:11:44.840282 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 12:11:44.840282 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 12:11:44.840282 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 15 12:11:44.840282 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:11:44.843125 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 397/782] 10.222.0.16 () {56 vars in 1093 bytes} [Thu Sep 15 12:11:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:44.844193 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40432351-6d9c-44a7-9861-b8f221686af5 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:44.869136 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:44.872268 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37952de7-696a-474d-bfc5-0dda2809f42b None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:44.901029 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:44.915145 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a690c6c9-a351-4d6c-8d55-54d253142e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:44.916142 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690c6c9-a351-4d6c-8d55-54d253142e31 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:44.916621 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690c6c9-a351-4d6c-8d55-54d253142e31 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:44.917137 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690c6c9-a351-4d6c-8d55-54d253142e31 None admin] PATH_INFO: `/v3/services` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:44.917961 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a690c6c9-a351-4d6c-8d55-54d253142e31 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:44.918488 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a690c6c9-a351-4d6c-8d55-54d253142e31 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:44.920102 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a690c6c9-a351-4d6c-8d55-54d253142e31 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:44.930308 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 386/783] 10.222.0.16 () {56 vars in 1124 bytes} [Thu Sep 15 12:11:44 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:44.931463 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a690c6c9-a351-4d6c-8d55-54d253142e31 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:44.965338 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40432351-6d9c-44a7-9861-b8f221686af5 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:45.003469 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dc6626-8a24-4469-8288-3335ef9b3807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:45.004147 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc6626-8a24-4469-8288-3335ef9b3807 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:45.004523 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc6626-8a24-4469-8288-3335ef9b3807 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:45.004799 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc6626-8a24-4469-8288-3335ef9b3807 None admin] PATH_INFO: `/v3/services` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:45.005396 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dc6626-8a24-4469-8288-3335ef9b3807 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:45.006764 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dc6626-8a24-4469-8288-3335ef9b3807 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:45.012986 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 398/784] 10.222.0.16 () {56 vars in 1087 bytes} [Thu Sep 15 12:11:44 2022] GET /identity/v3/services => generated 772 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:45.013865 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dc6626-8a24-4469-8288-3335ef9b3807 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:45.111036 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a690c6c9-a351-4d6c-8d55-54d253142e31 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:45.192792 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30672648-a747-43d2-86a4-e0e1bbda51c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:45.193421 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30672648-a747-43d2-86a4-e0e1bbda51c4 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:45.193703 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30672648-a747-43d2-86a4-e0e1bbda51c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:45.194131 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30672648-a747-43d2-86a4-e0e1bbda51c4 None admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:45.194872 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30672648-a747-43d2-86a4-e0e1bbda51c4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:45.195182 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30672648-a747-43d2-86a4-e0e1bbda51c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:45.195906 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:45.198003 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30672648-a747-43d2-86a4-e0e1bbda51c4 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:45.223139 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 387/785] 10.222.0.16 () {56 vars in 1133 bytes} [Thu Sep 15 12:11:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:45.224237 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dc6626-8a24-4469-8288-3335ef9b3807 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:45.228942 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30672648-a747-43d2-86a4-e0e1bbda51c4 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:45.270930 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5711665c-b98f-46c5-8130-310baa490c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:45.271461 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5711665c-b98f-46c5-8130-310baa490c2c None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:45.271726 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5711665c-b98f-46c5-8130-310baa490c2c None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:45.271996 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5711665c-b98f-46c5-8130-310baa490c2c None admin] PATH_INFO: `/v3/services` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:45.272622 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5711665c-b98f-46c5-8130-310baa490c2c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:45.272919 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5711665c-b98f-46c5-8130-310baa490c2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:45.274268 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5711665c-b98f-46c5-8130-310baa490c2c None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:45.279599 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 399/786] 10.222.0.16 () {56 vars in 1124 bytes} [Thu Sep 15 12:11:45 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:45.285072 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5711665c-b98f-46c5-8130-310baa490c2c None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:45.289333 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:45.354107 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30672648-a747-43d2-86a4-e0e1bbda51c4 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:45.397621 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc814ce5-f84f-4388-b01b-d8c3893bf7f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:45.398233 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc814ce5-f84f-4388-b01b-d8c3893bf7f7 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:45.398514 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc814ce5-f84f-4388-b01b-d8c3893bf7f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:45.398812 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc814ce5-f84f-4388-b01b-d8c3893bf7f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:45.411837 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5711665c-b98f-46c5-8130-310baa490c2c None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:45.451673 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a43b4d6-50d0-43fe-a8b3-8097f045bcd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:45.452666 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a43b4d6-50d0-43fe-a8b3-8097f045bcd7 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:45.453141 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a43b4d6-50d0-43fe-a8b3-8097f045bcd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:45.453724 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a43b4d6-50d0-43fe-a8b3-8097f045bcd7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:45.454519 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a43b4d6-50d0-43fe-a8b3-8097f045bcd7 None admin] RBAC: Adding query filter params (interface=public, service_id=f79fdb8e755a41f4b6519924e3422d7f, region_id=RegionOne) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:45.454964 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a43b4d6-50d0-43fe-a8b3-8097f045bcd7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:45.456411 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a43b4d6-50d0-43fe-a8b3-8097f045bcd7 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:45.473064 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 400/787] 10.222.0.16 () {56 vars in 1251 bytes} [Thu Sep 15 12:11:45 2022] GET /identity/v3/endpoints?service_id=f79fdb8e755a41f4b6519924e3422d7f&interface=public®ion_id=RegionOne => generated 194 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:11:45.473283 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc814ce5-f84f-4388-b01b-d8c3893bf7f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:45.474927 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9414dc01-ef7c-4261-bfa5-33040910a6bd None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:45.475105 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc814ce5-f84f-4388-b01b-d8c3893bf7f7 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:45.475525 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9414dc01-ef7c-4261-bfa5-33040910a6bd None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:45.475947 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9414dc01-ef7c-4261-bfa5-33040910a6bd None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:45.478779 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 401/788] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:11:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:11:45.479828 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9414dc01-ef7c-4261-bfa5-33040910a6bd None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:45.509101 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:45.539087 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:45.603873 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9414dc01-ef7c-4261-bfa5-33040910a6bd None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:45.613326 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 388/789] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 15 12:11:45 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 12:11:45.615158 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2536e3-0e04-4634-8d06-62ddf146afe9 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:45.615556 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2536e3-0e04-4634-8d06-62ddf146afe9 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:45.615933 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2536e3-0e04-4634-8d06-62ddf146afe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:45.639663 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-5b2536e3-0e04-4634-8d06-62ddf146afe9 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:11:45.641089 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-5b2536e3-0e04-4634-8d06-62ddf146afe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:11:45.643710 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691279b6-f877-4a61-995b-bce73e0b04b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:45.645468 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691279b6-f877-4a61-995b-bce73e0b04b0 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:45.645903 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691279b6-f877-4a61-995b-bce73e0b04b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:45.646325 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691279b6-f877-4a61-995b-bce73e0b04b0 None admin] PATH_INFO: `/v3/services` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:45.647123 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691279b6-f877-4a61-995b-bce73e0b04b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:45.648688 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691279b6-f877-4a61-995b-bce73e0b04b0 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:45.662002 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 402/790] 10.222.0.16 () {56 vars in 1087 bytes} [Thu Sep 15 12:11:45 2022] GET /identity/v3/services => generated 772 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:45.663748 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691279b6-f877-4a61-995b-bce73e0b04b0 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:45.778076 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 389/791] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:11:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:11:45.806448 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:45.846499 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691279b6-f877-4a61-995b-bce73e0b04b0 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:45.890653 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc4aa56-ea2d-47c3-8fd1-d33f8957d9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:45.891690 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc4aa56-ea2d-47c3-8fd1-d33f8957d9d0 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:45.892143 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc4aa56-ea2d-47c3-8fd1-d33f8957d9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:45.892584 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc4aa56-ea2d-47c3-8fd1-d33f8957d9d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:45.903824 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc4aa56-ea2d-47c3-8fd1-d33f8957d9d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:45.906088 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc4aa56-ea2d-47c3-8fd1-d33f8957d9d0 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:45.921868 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-5bc4aa56-ea2d-47c3-8fd1-d33f8957d9d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:45.921868 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:45.921868 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:45.921868 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:45.921868 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:45.921868 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:45.921868 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:45.921868 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:45.921868 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:45.921868 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:45.921868 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:45.921868 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:45.921868 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:11:45.921868 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:11:45.921868 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:11:45.921868 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:11:45.922874 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:45.922874 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:45.922874 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:45.922874 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:45.922874 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:45.922874 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:45.922874 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:45.922874 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:45.922874 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:45.922874 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:45.922874 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:45.922874 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:45.922874 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:45.922874 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:45.922874 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:45.922874 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:45.922874 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:11:45.923758 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:11:45.923758 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:45.923758 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:11:45.925318 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 403/792] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:11:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:45.930812 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2536e3-0e04-4634-8d06-62ddf146afe9 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:46.019330 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:46.044665 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2536e3-0e04-4634-8d06-62ddf146afe9 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:46.082747 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cd90b8-a874-40a4-9225-670d29de805c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:46.083285 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd90b8-a874-40a4-9225-670d29de805c None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:46.083696 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd90b8-a874-40a4-9225-670d29de805c None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:46.084020 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd90b8-a874-40a4-9225-670d29de805c None admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:46.084663 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cd90b8-a874-40a4-9225-670d29de805c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:46.084963 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cd90b8-a874-40a4-9225-670d29de805c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:46.086332 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cd90b8-a874-40a4-9225-670d29de805c None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:46.100371 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 390/793] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 15 12:11:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:46.106370 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc4aa56-ea2d-47c3-8fd1-d33f8957d9d0 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:46.176697 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cd90b8-a874-40a4-9225-670d29de805c None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:46.276002 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc4aa56-ea2d-47c3-8fd1-d33f8957d9d0 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:46.325551 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cd90b8-a874-40a4-9225-670d29de805c None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:46.338672 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:46.354551 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed52141-894b-4d7e-82e8-4a7610a47cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:46.355203 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed52141-894b-4d7e-82e8-4a7610a47cfa None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:46.355524 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed52141-894b-4d7e-82e8-4a7610a47cfa None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:46.355794 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed52141-894b-4d7e-82e8-4a7610a47cfa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:46.368047 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed52141-894b-4d7e-82e8-4a7610a47cfa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:46.369478 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed52141-894b-4d7e-82e8-4a7610a47cfa None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:46.387562 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-0ed52141-894b-4d7e-82e8-4a7610a47cfa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:11:46.387562 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:46.387562 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:46.387562 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:46.387562 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:46.387562 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:46.387562 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:46.387562 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:46.387562 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:46.387562 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:46.387562 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:46.387562 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:46.387562 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 12:11:46.387562 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 12:11:46.387562 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 12:11:46.388522 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 12:11:46.388522 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:46.388522 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:46.388522 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:46.388522 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:46.388522 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:46.388522 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:46.388522 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:46.388522 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:46.388522 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:46.388522 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:46.388522 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:46.388522 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:46.388522 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:46.388522 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:46.388522 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:46.388522 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:46.389965 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 12:11:46.389965 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 12:11:46.389965 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 12:11:46.389965 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 12:11:46.389965 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 12:11:46.389965 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 12:11:46.389965 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:11:46.389965 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:11:46.394734 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 404/794] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 15 12:11:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:46.396046 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f57651e-8151-469a-a9e4-481b83c2e498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:46.396680 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f57651e-8151-469a-a9e4-481b83c2e498 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:46.396955 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f57651e-8151-469a-a9e4-481b83c2e498 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:46.397217 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f57651e-8151-469a-a9e4-481b83c2e498 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:46.398285 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed52141-894b-4d7e-82e8-4a7610a47cfa None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:46.402518 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:46.420696 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f57651e-8151-469a-a9e4-481b83c2e498 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:11:46.428150 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-1f57651e-8151-469a-a9e4-481b83c2e498 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 12:11:46.428150 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:46.428150 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:46.428150 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:46.428150 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:46.428150 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:46.428150 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:46.428150 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:46.428150 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:46.428150 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:46.428150 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:46.428150 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:46.428150 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:11:46.428150 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:11:46.428150 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:11:46.428150 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:11:46.429079 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:11:46.429079 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:11:46.429079 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:11:46.429079 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:11:46.429079 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:46.429079 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:46.429079 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:46.429079 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:46.429079 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:46.429079 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:46.429079 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:46.429079 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:46.429079 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:46.429079 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:46.429079 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:46.429079 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:46.429910 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:46.429910 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:46.429910 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:46.429910 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:46.429910 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:11:46.429910 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:11:46.429910 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:11:46.429910 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:11:46.429910 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:11:46.429910 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:11:46.429910 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 12:11:46.429910 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:46.432759 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 391/795] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Sep 15 12:11:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:11:46.438646 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f57651e-8151-469a-a9e4-481b83c2e498 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:46.583351 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f57651e-8151-469a-a9e4-481b83c2e498 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:46.593055 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed52141-894b-4d7e-82e8-4a7610a47cfa None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:46.618645 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f3e8e3-3ef2-4f04-bd9d-c9af4a6188db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:46.619341 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f3e8e3-3ef2-4f04-bd9d-c9af4a6188db None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:46.619622 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f3e8e3-3ef2-4f04-bd9d-c9af4a6188db None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:46.619892 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f3e8e3-3ef2-4f04-bd9d-c9af4a6188db None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:46.620550 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f3e8e3-3ef2-4f04-bd9d-c9af4a6188db None admin] RBAC: Adding query filter params (name=service) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:46.620853 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f3e8e3-3ef2-4f04-bd9d-c9af4a6188db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:46.622221 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f3e8e3-3ef2-4f04-bd9d-c9af4a6188db None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:46.631595 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 392/796] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Sep 15 12:11:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:46.632899 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2808a4b-c778-4bed-9842-38d48d403723 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:46.633187 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2808a4b-c778-4bed-9842-38d48d403723 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:46.633460 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2808a4b-c778-4bed-9842-38d48d403723 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:46.634942 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 393/797] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:11:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:11:46.637662 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2808a4b-c778-4bed-9842-38d48d403723 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:46.643935 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef7ef39-74ea-4b14-adaf-d5f2da8cb35e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:46.644545 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef7ef39-74ea-4b14-adaf-d5f2da8cb35e None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:46.644820 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef7ef39-74ea-4b14-adaf-d5f2da8cb35e None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:46.645083 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef7ef39-74ea-4b14-adaf-d5f2da8cb35e None admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:46.645776 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef7ef39-74ea-4b14-adaf-d5f2da8cb35e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:46.646080 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef7ef39-74ea-4b14-adaf-d5f2da8cb35e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:46.647512 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef7ef39-74ea-4b14-adaf-d5f2da8cb35e None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:46.666433 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 405/798] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Sep 15 12:11:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:11:46.668097 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14309737-9d92-4e22-a3c1-b80c228a7cfb None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:46.668646 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14309737-9d92-4e22-a3c1-b80c228a7cfb None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:46.668921 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14309737-9d92-4e22-a3c1-b80c228a7cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:46.688389 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-14309737-9d92-4e22-a3c1-b80c228a7cfb None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:11:46.689573 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-14309737-9d92-4e22-a3c1-b80c228a7cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:11:46.703347 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:46.740011 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:46.750256 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2808a4b-c778-4bed-9842-38d48d403723 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:46.774783 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 406/799] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:11:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:11:46.775727 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14309737-9d92-4e22-a3c1-b80c228a7cfb None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:46.800406 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81bc4e8-9e42-4b2a-82cc-6292a41a78ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:46.801271 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81bc4e8-9e42-4b2a-82cc-6292a41a78ca None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:46.801925 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81bc4e8-9e42-4b2a-82cc-6292a41a78ca None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:46.802198 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81bc4e8-9e42-4b2a-82cc-6292a41a78ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:46.836045 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81bc4e8-9e42-4b2a-82cc-6292a41a78ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:46.837518 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81bc4e8-9e42-4b2a-82cc-6292a41a78ca None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:46.871687 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-e81bc4e8-9e42-4b2a-82cc-6292a41a78ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:46.871687 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:46.871687 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:46.871687 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:46.871687 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:46.871687 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:46.871687 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:46.871687 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:46.871687 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:46.871687 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:46.871687 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:46.871687 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:46.871687 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:11:46.871687 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:11:46.871687 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:11:46.871687 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:11:46.873958 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:46.873958 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:46.873958 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:46.873958 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:46.873958 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:46.873958 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:46.873958 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:46.873958 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:46.873958 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:46.873958 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:46.873958 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:46.873958 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:46.873958 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:46.873958 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:46.873958 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:46.873958 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:46.873958 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:11:46.875403 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:11:46.875403 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:46.875403 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:46.875403 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 394/800] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:11:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:11:46.881471 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81bc4e8-9e42-4b2a-82cc-6292a41a78ca None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:46.918194 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14309737-9d92-4e22-a3c1-b80c228a7cfb None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:46.976707 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b661ffe-4be0-41d8-9189-3aa759506ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:46.977320 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b661ffe-4be0-41d8-9189-3aa759506ccd None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:46.977594 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b661ffe-4be0-41d8-9189-3aa759506ccd None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:46.977863 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b661ffe-4be0-41d8-9189-3aa759506ccd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:46.978587 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b661ffe-4be0-41d8-9189-3aa759506ccd None admin] RBAC: Adding query filter params (role.id=7f53f1c823b746529ba5057bf21b2477, scope.project.id=cab958c081ad4a92939d4469cf4ce1c6, user.id=9d05c52570474820b4ba0e2cdad5c13f) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:46.978961 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b661ffe-4be0-41d8-9189-3aa759506ccd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:46.980668 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b661ffe-4be0-41d8-9189-3aa759506ccd None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:46.990254 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 407/801] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 15 12:11:46 2022] GET /identity/v3/role_assignments?user.id=9d05c52570474820b4ba0e2cdad5c13f&scope.project.id=cab958c081ad4a92939d4469cf4ce1c6&role.id=7f53f1c823b746529ba5057bf21b2477 => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:47.052300 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81bc4e8-9e42-4b2a-82cc-6292a41a78ca None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:47.069531 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:47.099758 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c46cce2-7204-4fc9-954d-e3938ee9d964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:47.100420 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c46cce2-7204-4fc9-954d-e3938ee9d964 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:47.100693 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c46cce2-7204-4fc9-954d-e3938ee9d964 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:47.100961 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c46cce2-7204-4fc9-954d-e3938ee9d964 None admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:47.101605 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c46cce2-7204-4fc9-954d-e3938ee9d964 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:47.101897 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c46cce2-7204-4fc9-954d-e3938ee9d964 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:47.103387 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c46cce2-7204-4fc9-954d-e3938ee9d964 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:47.120416 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 395/802] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 15 12:11:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:11:47.127364 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b661ffe-4be0-41d8-9189-3aa759506ccd None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:47.176324 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:47.177039 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c46cce2-7204-4fc9-954d-e3938ee9d964 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:47.307968 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b661ffe-4be0-41d8-9189-3aa759506ccd None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:47.361042 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0bc5b9-fc24-4dc8-a9ee-b5f8da4f3af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:47.362192 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0bc5b9-fc24-4dc8-a9ee-b5f8da4f3af7 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:47.362646 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0bc5b9-fc24-4dc8-a9ee-b5f8da4f3af7 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:47.363098 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0bc5b9-fc24-4dc8-a9ee-b5f8da4f3af7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:47.370371 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c46cce2-7204-4fc9-954d-e3938ee9d964 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:47.372828 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0bc5b9-fc24-4dc8-a9ee-b5f8da4f3af7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:47.374407 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0bc5b9-fc24-4dc8-a9ee-b5f8da4f3af7 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:47.387967 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-ec0bc5b9-fc24-4dc8-a9ee-b5f8da4f3af7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 15 12:11:47.387967 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:47.387967 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:47.387967 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:47.387967 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:47.387967 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:47.387967 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:47.387967 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:47.387967 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:47.387967 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:47.387967 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:47.387967 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:47.387967 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 12:11:47.387967 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 12:11:47.387967 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 12:11:47.387967 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 12:11:47.389091 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:47.389091 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:47.389091 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 12:11:47.389091 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:11:47.389091 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 12:11:47.389091 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:11:47.389091 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:47.389091 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:47.389091 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:47.389091 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:47.389091 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:47.389091 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:47.389091 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:47.389091 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:47.389091 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:47.389091 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:47.389091 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:47.389091 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:47.390241 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:47.390241 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:47.390241 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 12:11:47.390241 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 12:11:47.390241 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 12:11:47.390241 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 12:11:47.390241 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 12:11:47.390241 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 12:11:47.390241 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 15 12:11:47.390241 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:11:47.390865 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 408/803] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Sep 15 12:11:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:47.396102 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0bc5b9-fc24-4dc8-a9ee-b5f8da4f3af7 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:47.416683 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18735561-1c2f-433f-8628-63668808cffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:47.417312 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18735561-1c2f-433f-8628-63668808cffa None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:47.417585 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18735561-1c2f-433f-8628-63668808cffa None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:47.417849 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18735561-1c2f-433f-8628-63668808cffa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:47.436043 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18735561-1c2f-433f-8628-63668808cffa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:11:47.444522 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-18735561-1c2f-433f-8628-63668808cffa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:11:47.444522 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:47.444522 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:47.444522 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:47.444522 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:47.444522 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:47.444522 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:47.444522 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:47.444522 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:47.444522 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:47.444522 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:47.444522 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:47.444522 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:11:47.444522 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:11:47.444522 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:11:47.444522 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:11:47.445522 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:11:47.445522 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:11:47.445522 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:11:47.445522 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:11:47.445522 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:47.445522 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:47.445522 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:47.445522 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:47.445522 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:47.445522 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:47.445522 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:47.445522 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:47.445522 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:47.445522 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:47.445522 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:47.445522 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:47.446363 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:47.446363 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:47.446363 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:47.446363 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:47.446363 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:11:47.446363 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:11:47.446363 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:11:47.446363 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:11:47.446363 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:11:47.446363 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:11:47.446363 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:11:47.446363 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:47.448258 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 396/804] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Sep 15 12:11:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:47.455235 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18735561-1c2f-433f-8628-63668808cffa None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:47.522108 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0bc5b9-fc24-4dc8-a9ee-b5f8da4f3af7 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:47.523816 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:47.533394 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:47.585722 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee95a6e-8c03-4ca4-b3fb-64981e520920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:47.586724 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee95a6e-8c03-4ca4-b3fb-64981e520920 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:47.587170 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee95a6e-8c03-4ca4-b3fb-64981e520920 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:47.587541 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee95a6e-8c03-4ca4-b3fb-64981e520920 None admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:47.588284 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee95a6e-8c03-4ca4-b3fb-64981e520920 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:47.588585 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee95a6e-8c03-4ca4-b3fb-64981e520920 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:47.590005 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee95a6e-8c03-4ca4-b3fb-64981e520920 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:47.611563 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 409/805] 10.222.0.16 () {56 vars in 1149 bytes} [Thu Sep 15 12:11:47 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:47.614416 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e06e1-5d1e-4b13-9a5b-0002b8661382 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:47.614715 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e06e1-5d1e-4b13-9a5b-0002b8661382 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:47.615044 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e06e1-5d1e-4b13-9a5b-0002b8661382 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:47.616778 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 410/806] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:11:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 12:11:47.617822 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1e06e1-5d1e-4b13-9a5b-0002b8661382 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:47.654566 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18735561-1c2f-433f-8628-63668808cffa None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:47.691776 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4db295c-e69a-4b54-9d85-14e02520dbe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:47.692381 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db295c-e69a-4b54-9d85-14e02520dbe2 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:47.692656 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db295c-e69a-4b54-9d85-14e02520dbe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:47.692967 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db295c-e69a-4b54-9d85-14e02520dbe2 None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:47.693651 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4db295c-e69a-4b54-9d85-14e02520dbe2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:47.693920 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4db295c-e69a-4b54-9d85-14e02520dbe2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:47.695343 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4db295c-e69a-4b54-9d85-14e02520dbe2 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:47.704193 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 397/807] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 15 12:11:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:11:47.705491 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc3bb1-eaa3-4524-a50a-47653b4edc5d None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:47.705777 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc3bb1-eaa3-4524-a50a-47653b4edc5d None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:47.706050 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc3bb1-eaa3-4524-a50a-47653b4edc5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:47.724087 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-d8cc3bb1-eaa3-4524-a50a-47653b4edc5d None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:11:47.725254 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-d8cc3bb1-eaa3-4524-a50a-47653b4edc5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:11:47.743401 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1e06e1-5d1e-4b13-9a5b-0002b8661382 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:47.783114 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5b30fe-1b37-4bff-90af-bf6b01a45508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:47.783887 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b30fe-1b37-4bff-90af-bf6b01a45508 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:47.784334 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b30fe-1b37-4bff-90af-bf6b01a45508 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:47.784675 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b30fe-1b37-4bff-90af-bf6b01a45508 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:47.796787 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5b30fe-1b37-4bff-90af-bf6b01a45508 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:47.798478 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5b30fe-1b37-4bff-90af-bf6b01a45508 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:47.810829 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 398/808] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:11:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:11:47.812317 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc3bb1-eaa3-4524-a50a-47653b4edc5d None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:47.820893 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-af5b30fe-1b37-4bff-90af-bf6b01a45508 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:47.820893 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:47.820893 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:47.820893 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:47.820893 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:47.820893 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:47.820893 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:47.820893 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:47.820893 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:47.820893 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:47.820893 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:47.820893 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:47.820893 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:11:47.820893 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:11:47.820893 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:11:47.820893 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:11:47.821864 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:47.821864 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:47.821864 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:47.821864 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:47.821864 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:47.821864 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:47.821864 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:47.821864 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:47.821864 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:47.821864 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:47.821864 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:47.821864 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:47.821864 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:47.821864 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:47.821864 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:47.821864 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:47.821864 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:11:47.823266 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:11:47.823266 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:47.823266 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:11:47.828193 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 411/809] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:11:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:47.829053 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5b30fe-1b37-4bff-90af-bf6b01a45508 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:47.838216 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:47.853686 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:47.933218 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc3bb1-eaa3-4524-a50a-47653b4edc5d None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:47.995887 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb2635e-3d9b-4b6d-9d95-c612a7c1bcb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:47.996519 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb2635e-3d9b-4b6d-9d95-c612a7c1bcb3 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:47.996792 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb2635e-3d9b-4b6d-9d95-c612a7c1bcb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:47.997062 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb2635e-3d9b-4b6d-9d95-c612a7c1bcb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:48.008487 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb2635e-3d9b-4b6d-9d95-c612a7c1bcb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:48.009935 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb2635e-3d9b-4b6d-9d95-c612a7c1bcb3 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:48.026409 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-bcb2635e-3d9b-4b6d-9d95-c612a7c1bcb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:48.026409 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:48.026409 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:48.026409 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:48.026409 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:48.026409 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:48.026409 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:48.026409 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:48.026409 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:48.026409 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:48.026409 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:48.026409 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:48.026409 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:11:48.026409 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:11:48.026409 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:11:48.026409 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:11:48.028639 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:48.028639 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:48.028639 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:48.028639 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:48.028639 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:48.028639 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:48.028639 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:48.028639 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:48.028639 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:48.028639 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:48.028639 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:48.028639 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:48.028639 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:48.028639 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:48.028639 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:48.028639 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:48.028639 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:11:48.031279 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:11:48.031279 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:48.031279 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:48.031279 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 399/810] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:11:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:48.037319 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb2635e-3d9b-4b6d-9d95-c612a7c1bcb3 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:48.057432 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5b30fe-1b37-4bff-90af-bf6b01a45508 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:48.132564 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:48.149008 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb2635e-3d9b-4b6d-9d95-c612a7c1bcb3 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:48.152073 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa02079-05d3-4f28-9eaf-39358bd704c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:48.152694 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa02079-05d3-4f28-9eaf-39358bd704c0 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:48.153043 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa02079-05d3-4f28-9eaf-39358bd704c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:48.153313 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa02079-05d3-4f28-9eaf-39358bd704c0 None admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:48.154031 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa02079-05d3-4f28-9eaf-39358bd704c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:48.154335 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa02079-05d3-4f28-9eaf-39358bd704c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:48.159815 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa02079-05d3-4f28-9eaf-39358bd704c0 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:48.185414 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b2bca2-01d2-4a3d-80ef-44f6221c660f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:48.186022 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2bca2-01d2-4a3d-80ef-44f6221c660f None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:48.186768 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2bca2-01d2-4a3d-80ef-44f6221c660f None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:48.187176 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2bca2-01d2-4a3d-80ef-44f6221c660f None admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:48.187822 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b2bca2-01d2-4a3d-80ef-44f6221c660f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:48.188123 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b2bca2-01d2-4a3d-80ef-44f6221c660f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:48.189493 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b2bca2-01d2-4a3d-80ef-44f6221c660f None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:48.192890 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 412/811] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 15 12:11:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:48.197999 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa02079-05d3-4f28-9eaf-39358bd704c0 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:48.201626 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 400/812] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 15 12:11:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:48.211873 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b2bca2-01d2-4a3d-80ef-44f6221c660f None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:48.315379 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:48.359908 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa02079-05d3-4f28-9eaf-39358bd704c0 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:48.361252 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b2bca2-01d2-4a3d-80ef-44f6221c660f None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:48.396547 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b6f2dd-8928-405a-bfb2-f2f35896e6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:48.397168 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b6f2dd-8928-405a-bfb2-f2f35896e6f4 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:48.397492 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b6f2dd-8928-405a-bfb2-f2f35896e6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:48.397713 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b6f2dd-8928-405a-bfb2-f2f35896e6f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:48.399365 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5463cd0-ac26-4eb2-b937-1004c3e9bff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:48.399983 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5463cd0-ac26-4eb2-b937-1004c3e9bff1 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:48.400258 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5463cd0-ac26-4eb2-b937-1004c3e9bff1 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:48.400525 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5463cd0-ac26-4eb2-b937-1004c3e9bff1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:48.402455 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:48.404854 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b6f2dd-8928-405a-bfb2-f2f35896e6f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:48.406367 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b6f2dd-8928-405a-bfb2-f2f35896e6f4 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:48.409582 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5463cd0-ac26-4eb2-b937-1004c3e9bff1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:48.411028 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5463cd0-ac26-4eb2-b937-1004c3e9bff1 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:48.420145 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-13b6f2dd-8928-405a-bfb2-f2f35896e6f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:11:48.420145 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:48.420145 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:48.420145 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:48.420145 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:48.420145 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:48.420145 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:48.420145 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:48.420145 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:48.420145 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:48.420145 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:48.420145 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:48.420145 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 12:11:48.420145 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 12:11:48.420145 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 12:11:48.421531 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 12:11:48.421531 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:48.421531 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:48.421531 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:48.421531 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:48.421531 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:48.421531 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:48.421531 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:48.421531 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:48.421531 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:48.421531 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:48.421531 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:48.421531 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:48.421531 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:48.421531 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:48.421531 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:48.421531 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:48.422408 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 12:11:48.422408 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 12:11:48.422408 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 12:11:48.422408 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 12:11:48.422408 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 12:11:48.422408 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 12:11:48.422408 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:11:48.422408 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:11:48.422408 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 413/813] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 15 12:11:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:48.423467 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b6f2dd-8928-405a-bfb2-f2f35896e6f4 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:48.424681 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-a5463cd0-ac26-4eb2-b937-1004c3e9bff1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 15 12:11:48.424681 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:48.424681 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:48.424681 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:48.424681 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:48.424681 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:48.424681 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:48.424681 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:48.424681 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:48.424681 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:48.424681 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:48.424681 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:48.424681 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 12:11:48.424681 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 12:11:48.424681 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 12:11:48.424681 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 12:11:48.425758 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:48.425758 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:48.425758 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 12:11:48.425758 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:11:48.425758 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 12:11:48.425758 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:11:48.425758 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:48.425758 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:48.425758 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:48.425758 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:48.425758 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:48.425758 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:48.425758 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:48.425758 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:48.425758 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:48.425758 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:48.425758 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:48.425758 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:48.426905 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:48.426905 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:48.426905 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 12:11:48.426905 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 12:11:48.426905 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 12:11:48.426905 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 12:11:48.426905 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 12:11:48.426905 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 12:11:48.426905 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 15 12:11:48.426905 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:48.428656 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 401/814] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Sep 15 12:11:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:48.429944 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5bd0e4-f0a1-48bf-b4b8-0e79d6e5a26e None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:48.430225 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5bd0e4-f0a1-48bf-b4b8-0e79d6e5a26e None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:48.430481 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5bd0e4-f0a1-48bf-b4b8-0e79d6e5a26e None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:48.431884 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 402/815] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:11:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:11:48.435533 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5bd0e4-f0a1-48bf-b4b8-0e79d6e5a26e None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:48.549833 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5bd0e4-f0a1-48bf-b4b8-0e79d6e5a26e None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:48.587151 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b9f5c-c49c-4cea-bf5e-23efa68766c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:48.587867 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b9f5c-c49c-4cea-bf5e-23efa68766c5 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:48.588027 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b9f5c-c49c-4cea-bf5e-23efa68766c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:48.588329 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b9f5c-c49c-4cea-bf5e-23efa68766c5 None admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:48.589017 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9b9f5c-c49c-4cea-bf5e-23efa68766c5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:48.589322 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9b9f5c-c49c-4cea-bf5e-23efa68766c5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:48.590788 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9b9f5c-c49c-4cea-bf5e-23efa68766c5 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:48.603199 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 403/816] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Sep 15 12:11:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:48.604480 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7263ab-9fec-4d2a-98f3-b5007a4548a1 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:48.604785 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7263ab-9fec-4d2a-98f3-b5007a4548a1 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:48.605030 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7263ab-9fec-4d2a-98f3-b5007a4548a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:48.624849 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-ea7263ab-9fec-4d2a-98f3-b5007a4548a1 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:11:48.626040 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-ea7263ab-9fec-4d2a-98f3-b5007a4548a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:11:48.653390 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b6f2dd-8928-405a-bfb2-f2f35896e6f4 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:48.676986 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:48.683258 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:48.690011 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eab39a-b5e2-4805-a885-cc8448bc4498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:48.690578 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eab39a-b5e2-4805-a885-cc8448bc4498 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:48.690887 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eab39a-b5e2-4805-a885-cc8448bc4498 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:48.691162 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eab39a-b5e2-4805-a885-cc8448bc4498 None admin] PATH_INFO: `/v3/services/network` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:48.691743 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eab39a-b5e2-4805-a885-cc8448bc4498 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:48.693102 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eab39a-b5e2-4805-a885-cc8448bc4498 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:48.704626 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 404/817] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:11:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:11:48.704626 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7263ab-9fec-4d2a-98f3-b5007a4548a1 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:48.704859 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-26eab39a-b5e2-4805-a885-cc8448bc4498 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 15 12:11:48.704859 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:48.704859 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 12:11:48.704859 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 12:11:48.704859 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 12:11:48.704859 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 12:11:48.704859 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 12:11:48.704859 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:11:48.704859 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 15 12:11:48.704859 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:11:48.704859 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 12:11:48.704859 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:11:48.704859 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:48.704859 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:48.704859 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:48.704859 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:48.704859 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:48.705754 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:48.705754 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:48.705754 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:48.705754 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:48.705754 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:48.705754 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:48.705754 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 12:11:48.705754 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 12:11:48.705754 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 12:11:48.705754 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 12:11:48.705754 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:48.705754 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:48.705754 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:48.705754 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:48.705754 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:48.705754 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:48.706579 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:48.706579 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:48.706579 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:48.706579 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:48.706579 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:48.706579 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:48.706579 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:48.706579 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:48.706579 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:48.706579 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:48.706579 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 12:11:48.706579 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:11:48.706579 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 15 12:11:48.706579 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:11:48.706579 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 414/818] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 15 12:11:48 2022] GET /identity/v3/services/network => generated 88 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:48.708411 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eab39a-b5e2-4805-a885-cc8448bc4498 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:48.817387 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7263ab-9fec-4d2a-98f3-b5007a4548a1 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:48.822160 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eab39a-b5e2-4805-a885-cc8448bc4498 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:48.853399 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d036fcb2-30c9-46ff-b030-c600e470c5a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:48.854006 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d036fcb2-30c9-46ff-b030-c600e470c5a6 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:48.854283 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d036fcb2-30c9-46ff-b030-c600e470c5a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:48.854552 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d036fcb2-30c9-46ff-b030-c600e470c5a6 None admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:48.855531 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d036fcb2-30c9-46ff-b030-c600e470c5a6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:48.855840 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d036fcb2-30c9-46ff-b030-c600e470c5a6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:48.857446 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d036fcb2-30c9-46ff-b030-c600e470c5a6 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:48.858055 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ea5266-3368-4e18-859d-4154fbce7068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:48.859276 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ea5266-3368-4e18-859d-4154fbce7068 None admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:48.859623 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ea5266-3368-4e18-859d-4154fbce7068 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:48.860045 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ea5266-3368-4e18-859d-4154fbce7068 None admin] PATH_INFO: `/v3/projects/cab958c081ad4a92939d4469cf4ce1c6/users/b4614bede59c47ea813a73fcc0840a2d/roles/9c9f10110e12479bb6b3b630dd6412b8` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:48.875420 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ea5266-3368-4e18-859d-4154fbce7068 None admin] RBAC: Authorizing `identity:create_grant(project_id=cab958c081ad4a92939d4469cf4ce1c6, user_id=b4614bede59c47ea813a73fcc0840a2d, role_id=9c9f10110e12479bb6b3b630dd6412b8)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:48.876944 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 405/819] 10.222.0.16 () {56 vars in 1135 bytes} [Thu Sep 15 12:11:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:48.877271 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ea5266-3368-4e18-859d-4154fbce7068 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:48.877766 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d036fcb2-30c9-46ff-b030-c600e470c5a6 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:48.897104 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 415/820] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Sep 15 12:11:48 2022] PUT /identity/v3/projects/cab958c081ad4a92939d4469cf4ce1c6/users/b4614bede59c47ea813a73fcc0840a2d/roles/9c9f10110e12479bb6b3b630dd6412b8 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:11:48.898581 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ea5266-3368-4e18-859d-4154fbce7068 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:48.935587 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:48.970085 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:49.035297 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d036fcb2-30c9-46ff-b030-c600e470c5a6 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:49.102613 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ea5266-3368-4e18-859d-4154fbce7068 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:49.104630 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0e5e70-2c0e-41fb-9136-6dcb4fc42c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:49.105249 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e5e70-2c0e-41fb-9136-6dcb4fc42c27 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:49.105520 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e5e70-2c0e-41fb-9136-6dcb4fc42c27 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:49.105847 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e5e70-2c0e-41fb-9136-6dcb4fc42c27 None admin] PATH_INFO: `/v3/services` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:49.106483 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0e5e70-2c0e-41fb-9136-6dcb4fc42c27 None admin] RBAC: Adding query filter params (name=network) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:49.106849 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0e5e70-2c0e-41fb-9136-6dcb4fc42c27 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:49.108753 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0e5e70-2c0e-41fb-9136-6dcb4fc42c27 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:49.118894 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 406/821] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Sep 15 12:11:48 2022] GET /identity/v3/services?name=network => generated 124 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:49.119870 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0e5e70-2c0e-41fb-9136-6dcb4fc42c27 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:49.157302 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ebe06c-7721-41b7-88a5-89e6ba3398f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:49.158591 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ebe06c-7721-41b7-88a5-89e6ba3398f9 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:49.159565 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ebe06c-7721-41b7-88a5-89e6ba3398f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:49.160283 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ebe06c-7721-41b7-88a5-89e6ba3398f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:49.173047 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ebe06c-7721-41b7-88a5-89e6ba3398f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:49.175816 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ebe06c-7721-41b7-88a5-89e6ba3398f9 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:49.194023 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-39ebe06c-7721-41b7-88a5-89e6ba3398f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:49.194023 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:49.194023 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:49.194023 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:49.194023 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:49.194023 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:49.194023 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:49.194023 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:49.194023 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:49.194023 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:49.194023 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:49.194023 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:49.194023 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:11:49.194023 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:11:49.194023 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:11:49.194023 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:11:49.195045 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:49.195045 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:49.195045 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:49.195045 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:49.195045 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:49.195045 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:49.195045 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:49.195045 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:49.195045 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:49.195045 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:49.195045 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:49.195045 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:49.195045 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:49.195045 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:49.195045 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:49.195045 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:49.195045 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:11:49.195938 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:11:49.195938 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:49.195938 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:11:49.198141 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 416/822] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:11:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:49.199504 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ebe06c-7721-41b7-88a5-89e6ba3398f9 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:49.236992 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0e5e70-2c0e-41fb-9136-6dcb4fc42c27 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:49.245658 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:49.281778 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166686be-5cc6-4fc1-b0d9-a9beccfd523b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:49.282552 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166686be-5cc6-4fc1-b0d9-a9beccfd523b None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:49.282943 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166686be-5cc6-4fc1-b0d9-a9beccfd523b None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:49.283288 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166686be-5cc6-4fc1-b0d9-a9beccfd523b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:49.283953 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166686be-5cc6-4fc1-b0d9-a9beccfd523b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:49.285400 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166686be-5cc6-4fc1-b0d9-a9beccfd523b None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:49.298568 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-166686be-5cc6-4fc1-b0d9-a9beccfd523b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 15 12:11:49.298568 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:49.298568 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 12:11:49.298568 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 12:11:49.298568 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 12:11:49.298568 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 12:11:49.298568 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 12:11:49.298568 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:11:49.298568 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 15 12:11:49.298568 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:49.298568 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 12:11:49.298568 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:49.298568 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:49.298568 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:49.298568 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:49.298568 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:49.298568 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:49.299693 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:49.299693 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:49.299693 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:49.299693 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:49.299693 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:49.299693 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:49.299693 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 12:11:49.299693 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 12:11:49.299693 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 12:11:49.299693 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 12:11:49.299693 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:49.299693 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:49.299693 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:49.299693 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:49.299693 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:49.299693 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:49.300550 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:49.300550 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:49.300550 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:49.300550 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:49.300550 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:49.300550 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:49.300550 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:49.300550 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:49.300550 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:49.300550 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:49.300550 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 12:11:49.300550 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:11:49.300550 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 15 12:11:49.300550 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:49.303466 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 407/823] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Sep 15 12:11:49 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:49.304478 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166686be-5cc6-4fc1-b0d9-a9beccfd523b None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:49.321391 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:49.329132 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ebe06c-7721-41b7-88a5-89e6ba3398f9 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:49.366969 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d65e6bb-e15d-4700-bc43-852ce7ef44ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:49.367882 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d65e6bb-e15d-4700-bc43-852ce7ef44ec None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:49.368385 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d65e6bb-e15d-4700-bc43-852ce7ef44ec None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:49.368834 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d65e6bb-e15d-4700-bc43-852ce7ef44ec None admin] PATH_INFO: `/v3/services` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:49.369861 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d65e6bb-e15d-4700-bc43-852ce7ef44ec None admin] RBAC: Adding query filter params (type=network) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:49.370343 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d65e6bb-e15d-4700-bc43-852ce7ef44ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:49.371954 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d65e6bb-e15d-4700-bc43-852ce7ef44ec None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:49.383235 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 417/824] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Sep 15 12:11:49 2022] GET /identity/v3/services?type=network => generated 350 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:49.384540 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d65e6bb-e15d-4700-bc43-852ce7ef44ec None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:49.427365 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166686be-5cc6-4fc1-b0d9-a9beccfd523b None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:49.464721 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71420415-e8b6-4876-82bc-b1ca7bbc7c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:49.465668 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71420415-e8b6-4876-82bc-b1ca7bbc7c44 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:49.466157 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71420415-e8b6-4876-82bc-b1ca7bbc7c44 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:49.466629 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71420415-e8b6-4876-82bc-b1ca7bbc7c44 None admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:49.468140 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71420415-e8b6-4876-82bc-b1ca7bbc7c44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:49.468674 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71420415-e8b6-4876-82bc-b1ca7bbc7c44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:49.470292 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71420415-e8b6-4876-82bc-b1ca7bbc7c44 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:49.484632 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 408/825] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 15 12:11:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:49.485774 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71420415-e8b6-4876-82bc-b1ca7bbc7c44 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:49.510473 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d65e6bb-e15d-4700-bc43-852ce7ef44ec None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:49.517687 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:49.558094 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d48527-0d08-40f0-9d6c-d7c747d2b059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:49.558724 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d48527-0d08-40f0-9d6c-d7c747d2b059 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:49.559319 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d48527-0d08-40f0-9d6c-d7c747d2b059 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:49.559598 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d48527-0d08-40f0-9d6c-d7c747d2b059 None admin] PATH_INFO: `/v3/services` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:49.560237 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d48527-0d08-40f0-9d6c-d7c747d2b059 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:49.560539 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d48527-0d08-40f0-9d6c-d7c747d2b059 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:49.562549 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d48527-0d08-40f0-9d6c-d7c747d2b059 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:49.568715 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 418/826] 10.222.0.16 () {56 vars in 1124 bytes} [Thu Sep 15 12:11:49 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:49.569513 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d48527-0d08-40f0-9d6c-d7c747d2b059 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:49.596846 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71420415-e8b6-4876-82bc-b1ca7bbc7c44 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:49.598540 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:49.633357 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fb7e2d-254e-425d-82e1-ccbcf5905be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:49.633966 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb7e2d-254e-425d-82e1-ccbcf5905be8 None admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:49.634253 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb7e2d-254e-425d-82e1-ccbcf5905be8 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:49.634527 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb7e2d-254e-425d-82e1-ccbcf5905be8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:49.635231 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fb7e2d-254e-425d-82e1-ccbcf5905be8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:49.636619 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fb7e2d-254e-425d-82e1-ccbcf5905be8 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:49.671250 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 409/827] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:11:49 2022] POST /identity/v3/endpoints => generated 337 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:11:49.672997 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbfdd68-5dc6-48d2-94f1-1ee97a732f17 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:49.673491 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbfdd68-5dc6-48d2-94f1-1ee97a732f17 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:49.673943 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbfdd68-5dc6-48d2-94f1-1ee97a732f17 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:49.675487 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 410/828] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:11:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:11:49.676383 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbfdd68-5dc6-48d2-94f1-1ee97a732f17 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:49.696124 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d48527-0d08-40f0-9d6c-d7c747d2b059 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:49.748878 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2819fb-3d00-437a-bc56-32f6b4639c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:49.749529 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2819fb-3d00-437a-bc56-32f6b4639c3d None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:49.749806 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2819fb-3d00-437a-bc56-32f6b4639c3d None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:49.750077 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2819fb-3d00-437a-bc56-32f6b4639c3d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:49.761038 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2819fb-3d00-437a-bc56-32f6b4639c3d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:49.763284 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2819fb-3d00-437a-bc56-32f6b4639c3d None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:49.776270 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-3a2819fb-3d00-437a-bc56-32f6b4639c3d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:11:49.776270 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:49.776270 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:49.776270 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:49.776270 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:49.776270 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:49.776270 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:49.776270 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:49.776270 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:49.776270 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:49.776270 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:49.776270 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:49.776270 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 12:11:49.776270 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 12:11:49.776270 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 12:11:49.777223 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 12:11:49.777223 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:49.777223 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:49.777223 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:49.777223 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:49.777223 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:49.777223 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:49.777223 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:49.777223 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:49.777223 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:49.777223 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:49.777223 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:49.777223 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:49.777223 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:49.777223 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:49.777223 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:49.777223 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:49.778197 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 12:11:49.778197 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 12:11:49.778197 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 12:11:49.778197 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 12:11:49.778197 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 12:11:49.778197 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 12:11:49.778197 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:11:49.778197 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:11:49.778197 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 419/829] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 15 12:11:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:49.779189 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb03139a-2acc-4bb4-8e33-82e0c9383937 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:49.779513 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb03139a-2acc-4bb4-8e33-82e0c9383937 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:49.780303 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb03139a-2acc-4bb4-8e33-82e0c9383937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:49.800874 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-cb03139a-2acc-4bb4-8e33-82e0c9383937 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:11:49.802448 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-cb03139a-2acc-4bb4-8e33-82e0c9383937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:11:49.816994 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:49.840650 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbfdd68-5dc6-48d2-94f1-1ee97a732f17 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:49.882631 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbd742a-9c31-4307-ad8b-f923319c028f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:49.883277 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd742a-9c31-4307-ad8b-f923319c028f None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:49.883584 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd742a-9c31-4307-ad8b-f923319c028f None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:49.883821 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd742a-9c31-4307-ad8b-f923319c028f None admin] PATH_INFO: `/v3/services` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:49.884461 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbd742a-9c31-4307-ad8b-f923319c028f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:49.884747 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbd742a-9c31-4307-ad8b-f923319c028f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:49.886113 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbd742a-9c31-4307-ad8b-f923319c028f None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:49.891956 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 411/830] 10.222.0.16 () {56 vars in 1124 bytes} [Thu Sep 15 12:11:49 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:49.892763 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbd742a-9c31-4307-ad8b-f923319c028f None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:49.894603 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 420/831] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:11:49 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:11:49.903114 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb03139a-2acc-4bb4-8e33-82e0c9383937 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:49.919020 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:50.028628 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbd742a-9c31-4307-ad8b-f923319c028f None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:50.054284 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb03139a-2acc-4bb4-8e33-82e0c9383937 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:50.073834 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f90bd04-f87a-48ba-b891-7eb2eb539115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:50.074846 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f90bd04-f87a-48ba-b891-7eb2eb539115 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:50.075135 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f90bd04-f87a-48ba-b891-7eb2eb539115 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:50.075411 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f90bd04-f87a-48ba-b891-7eb2eb539115 None admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:50.076110 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f90bd04-f87a-48ba-b891-7eb2eb539115 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:50.076419 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f90bd04-f87a-48ba-b891-7eb2eb539115 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:50.078448 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f90bd04-f87a-48ba-b891-7eb2eb539115 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:50.095488 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7c5199-a711-4ab4-95e2-8d492626f4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:50.096098 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7c5199-a711-4ab4-95e2-8d492626f4a3 None admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:50.096419 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7c5199-a711-4ab4-95e2-8d492626f4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:50.096535 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 412/832] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Sep 15 12:11:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:50.096692 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7c5199-a711-4ab4-95e2-8d492626f4a3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:50.097326 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7c5199-a711-4ab4-95e2-8d492626f4a3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:50.098799 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7c5199-a711-4ab4-95e2-8d492626f4a3 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:50.103068 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f90bd04-f87a-48ba-b891-7eb2eb539115 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:50.120724 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:50.122245 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 421/833] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:11:49 2022] POST /identity/v3/endpoints => generated 346 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:11:50.184589 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7c5199-a711-4ab4-95e2-8d492626f4a3 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:50.238727 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f90bd04-f87a-48ba-b891-7eb2eb539115 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:50.262573 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:50.292431 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221231a2-bed3-4d4c-8196-a28b3105751d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:50.293023 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221231a2-bed3-4d4c-8196-a28b3105751d None admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:50.293456 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221231a2-bed3-4d4c-8196-a28b3105751d None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:50.293740 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221231a2-bed3-4d4c-8196-a28b3105751d None admin] PATH_INFO: `/v3/projects/cab958c081ad4a92939d4469cf4ce1c6/users/ee33b730d0ec428ca2cd3af4ebf723e8/roles/7f53f1c823b746529ba5057bf21b2477` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:50.297162 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221231a2-bed3-4d4c-8196-a28b3105751d None admin] RBAC: Authorizing `identity:create_grant(project_id=cab958c081ad4a92939d4469cf4ce1c6, user_id=ee33b730d0ec428ca2cd3af4ebf723e8, role_id=7f53f1c823b746529ba5057bf21b2477)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:50.299785 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221231a2-bed3-4d4c-8196-a28b3105751d None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:50.305476 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7c5199-a711-4ab4-95e2-8d492626f4a3 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:50.317674 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 413/834] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Sep 15 12:11:50 2022] PUT /identity/v3/projects/cab958c081ad4a92939d4469cf4ce1c6/users/ee33b730d0ec428ca2cd3af4ebf723e8/roles/7f53f1c823b746529ba5057bf21b2477 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:11:50.352173 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3818417-dfa1-4a4c-b144-751e445ac323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:50.353189 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3818417-dfa1-4a4c-b144-751e445ac323 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:50.353494 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3818417-dfa1-4a4c-b144-751e445ac323 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:50.353768 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3818417-dfa1-4a4c-b144-751e445ac323 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:50.354377 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3818417-dfa1-4a4c-b144-751e445ac323 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:50.355837 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3818417-dfa1-4a4c-b144-751e445ac323 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:50.365809 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-a3818417-dfa1-4a4c-b144-751e445ac323 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 15 12:11:50.365809 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:50.365809 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 12:11:50.365809 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 12:11:50.365809 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 12:11:50.365809 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 12:11:50.365809 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 12:11:50.365809 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:11:50.365809 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 15 12:11:50.365809 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:11:50.365809 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 12:11:50.365809 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:11:50.365809 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:50.365809 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:50.365809 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:50.365809 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:50.366871 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:50.366871 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:50.366871 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:50.366871 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:50.366871 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:50.366871 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:50.366871 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:50.366871 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 12:11:50.366871 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 12:11:50.366871 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 12:11:50.366871 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 12:11:50.366871 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:50.366871 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:50.366871 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:50.366871 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:50.366871 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:50.366871 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:50.367783 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:50.367783 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:50.367783 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:50.367783 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:50.367783 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:50.367783 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:50.367783 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:50.367783 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:50.367783 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:50.367783 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:50.367783 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 12:11:50.367783 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:11:50.367783 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 15 12:11:50.367783 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:11:50.367783 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 422/835] 10.222.0.16 () {56 vars in 1132 bytes} [Thu Sep 15 12:11:50 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:11:50.373268 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221231a2-bed3-4d4c-8196-a28b3105751d None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:50.453732 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:50.494440 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221231a2-bed3-4d4c-8196-a28b3105751d None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:50.533134 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e38653-c3e6-45de-9af7-3ea3ce9e58c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:50.533748 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e38653-c3e6-45de-9af7-3ea3ce9e58c8 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:50.534025 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e38653-c3e6-45de-9af7-3ea3ce9e58c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:50.534296 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e38653-c3e6-45de-9af7-3ea3ce9e58c8 None admin] PATH_INFO: `/v3/services` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:50.534957 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e38653-c3e6-45de-9af7-3ea3ce9e58c8 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:50.535258 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e38653-c3e6-45de-9af7-3ea3ce9e58c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:50.536633 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e38653-c3e6-45de-9af7-3ea3ce9e58c8 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:50.541835 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 414/836] 10.222.0.16 () {56 vars in 1126 bytes} [Thu Sep 15 12:11:50 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:50.548301 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3818417-dfa1-4a4c-b144-751e445ac323 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:50.653823 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3818417-dfa1-4a4c-b144-751e445ac323 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:50.682556 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:50.688703 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c6b03b-11c5-40ab-829a-2a3e644d1949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:50.689378 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c6b03b-11c5-40ab-829a-2a3e644d1949 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:50.689658 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c6b03b-11c5-40ab-829a-2a3e644d1949 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:50.689931 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c6b03b-11c5-40ab-829a-2a3e644d1949 None admin] PATH_INFO: `/v3/services` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:50.690619 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c6b03b-11c5-40ab-829a-2a3e644d1949 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:50.690953 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c6b03b-11c5-40ab-829a-2a3e644d1949 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:50.692320 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c6b03b-11c5-40ab-829a-2a3e644d1949 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:50.697964 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 423/837] 10.222.0.16 () {56 vars in 1126 bytes} [Thu Sep 15 12:11:50 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:11:51.242779 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b76136-3090-435b-8bf2-3284600b069f None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:51.243272 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b76136-3090-435b-8bf2-3284600b069f None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:51.243272 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b76136-3090-435b-8bf2-3284600b069f None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:51.244835 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 415/838] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:11:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:11:51.250315 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed0898-a89f-4bdf-8747-3a8ee696c9d4 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:51.250675 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed0898-a89f-4bdf-8747-3a8ee696c9d4 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:51.250994 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed0898-a89f-4bdf-8747-3a8ee696c9d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:51.271191 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-0eed0898-a89f-4bdf-8747-3a8ee696c9d4 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:11:51.272424 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-0eed0898-a89f-4bdf-8747-3a8ee696c9d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:11:51.346832 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 424/839] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:11:51 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:11:51.612501 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b76136-3090-435b-8bf2-3284600b069f None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:51.722204 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b76136-3090-435b-8bf2-3284600b069f None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:51.753028 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:51.759342 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5745e0d3-e68e-485f-93bc-1c67c1fb18fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:51.759973 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745e0d3-e68e-485f-93bc-1c67c1fb18fb None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:51.760253 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745e0d3-e68e-485f-93bc-1c67c1fb18fb None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:51.760528 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745e0d3-e68e-485f-93bc-1c67c1fb18fb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:51.771370 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5745e0d3-e68e-485f-93bc-1c67c1fb18fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:11:51.776104 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-5745e0d3-e68e-485f-93bc-1c67c1fb18fb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 12:11:51.776104 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:51.776104 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:51.776104 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:51.776104 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:51.776104 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:51.776104 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:51.776104 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:51.776104 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:51.776104 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:51.776104 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:51.776104 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:51.776104 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:11:51.776104 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:11:51.776104 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:11:51.776104 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:11:51.777011 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:11:51.777011 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:11:51.777011 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:11:51.777011 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:11:51.777011 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:51.777011 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:51.777011 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:51.777011 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:51.777011 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:51.777011 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:51.777011 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:51.777011 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:51.777011 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:51.777011 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:51.777011 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:51.777011 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:51.777863 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:51.777863 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:51.777863 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:51.777863 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:51.777863 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:11:51.777863 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:11:51.777863 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:11:51.777863 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:11:51.777863 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:11:51.777863 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:11:51.777863 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 12:11:51.777863 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:51.777863 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 416/840] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Sep 15 12:11:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:51.783101 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eed0898-a89f-4bdf-8747-3a8ee696c9d4 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:51.884386 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eed0898-a89f-4bdf-8747-3a8ee696c9d4 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:51.908847 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:51.920046 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b8395d-e4b0-42a0-ac6f-6dc6ebde0137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:51.921181 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b8395d-e4b0-42a0-ac6f-6dc6ebde0137 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:51.921758 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b8395d-e4b0-42a0-ac6f-6dc6ebde0137 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:51.922091 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b8395d-e4b0-42a0-ac6f-6dc6ebde0137 None admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:51.923134 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b8395d-e4b0-42a0-ac6f-6dc6ebde0137 None admin] RBAC: Adding query filter params (name=service) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:51.923441 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b8395d-e4b0-42a0-ac6f-6dc6ebde0137 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:51.924806 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b8395d-e4b0-42a0-ac6f-6dc6ebde0137 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:51.934402 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 425/841] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Sep 15 12:11:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:11:51.940388 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5745e0d3-e68e-485f-93bc-1c67c1fb18fb None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:52.056166 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5745e0d3-e68e-485f-93bc-1c67c1fb18fb None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:52.096907 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1165c7-cc9b-40d8-80c9-4d69f2e41812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:52.097539 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1165c7-cc9b-40d8-80c9-4d69f2e41812 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:52.097817 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1165c7-cc9b-40d8-80c9-4d69f2e41812 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:52.098089 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1165c7-cc9b-40d8-80c9-4d69f2e41812 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:52.109028 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1165c7-cc9b-40d8-80c9-4d69f2e41812 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:52.110471 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1165c7-cc9b-40d8-80c9-4d69f2e41812 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:52.127150 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-eb1165c7-cc9b-40d8-80c9-4d69f2e41812 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:52.127150 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:52.127150 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:52.127150 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:52.127150 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:52.127150 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:52.127150 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:52.127150 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:52.127150 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:52.127150 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:52.127150 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:52.127150 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:52.127150 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:11:52.127150 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:11:52.127150 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:11:52.127150 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:11:52.128124 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:52.128124 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:52.128124 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:52.128124 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:52.128124 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:52.128124 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:52.128124 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:52.128124 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:52.128124 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:52.128124 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:52.128124 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:52.128124 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:52.128124 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:52.128124 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:52.128124 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:52.128124 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:52.128124 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:11:52.129403 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:11:52.129403 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:52.129403 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:52.129403 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 417/842] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:11:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:52.135516 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b8395d-e4b0-42a0-ac6f-6dc6ebde0137 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:52.238957 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b8395d-e4b0-42a0-ac6f-6dc6ebde0137 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:52.274525 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78879557-2eee-4329-be5d-feeb9e312019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:52.275596 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78879557-2eee-4329-be5d-feeb9e312019 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:52.276077 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78879557-2eee-4329-be5d-feeb9e312019 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:52.276571 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78879557-2eee-4329-be5d-feeb9e312019 None admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:52.277407 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78879557-2eee-4329-be5d-feeb9e312019 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:52.277915 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78879557-2eee-4329-be5d-feeb9e312019 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:52.279503 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78879557-2eee-4329-be5d-feeb9e312019 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:52.296042 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 426/843] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 15 12:11:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:52.298942 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1165c7-cc9b-40d8-80c9-4d69f2e41812 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:52.349513 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:52.409685 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1165c7-cc9b-40d8-80c9-4d69f2e41812 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:52.444969 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179fcd3b-8444-462b-8bf0-e5a8695a8af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:52.445984 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179fcd3b-8444-462b-8bf0-e5a8695a8af1 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:52.446464 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179fcd3b-8444-462b-8bf0-e5a8695a8af1 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:52.446967 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179fcd3b-8444-462b-8bf0-e5a8695a8af1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:52.452366 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a9d44b-2da2-4ba9-9bdd-b784d6145f2f None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:52.452644 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a9d44b-2da2-4ba9-9bdd-b784d6145f2f None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:52.452910 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a9d44b-2da2-4ba9-9bdd-b784d6145f2f None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:52.454485 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 427/844] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:11:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 12:11:52.456335 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179fcd3b-8444-462b-8bf0-e5a8695a8af1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:52.458466 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179fcd3b-8444-462b-8bf0-e5a8695a8af1 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:52.459451 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d40bd1-ca48-42eb-b2dd-a91a1e420070 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:52.459730 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d40bd1-ca48-42eb-b2dd-a91a1e420070 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:52.460001 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d40bd1-ca48-42eb-b2dd-a91a1e420070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:52.471893 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-179fcd3b-8444-462b-8bf0-e5a8695a8af1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 15 12:11:52.471893 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:52.471893 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:52.471893 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:52.471893 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:52.471893 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:52.471893 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:52.471893 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:52.471893 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:52.471893 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:52.471893 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:52.471893 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:52.471893 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 12:11:52.471893 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 12:11:52.471893 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 12:11:52.471893 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 12:11:52.472872 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:52.472872 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:52.472872 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 12:11:52.472872 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:11:52.472872 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 12:11:52.472872 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:11:52.472872 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:52.472872 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:52.472872 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:52.472872 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:52.472872 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:52.472872 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:52.472872 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:52.472872 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:52.472872 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:52.472872 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:52.472872 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:52.472872 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:52.473818 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:52.473818 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:52.473818 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 12:11:52.473818 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 12:11:52.473818 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 12:11:52.473818 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 12:11:52.473818 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 12:11:52.473818 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 12:11:52.473818 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 15 12:11:52.473818 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:52.480709 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-b4d40bd1-ca48-42eb-b2dd-a91a1e420070 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:11:52.480709 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-b4d40bd1-ca48-42eb-b2dd-a91a1e420070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:11:52.481083 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 418/845] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Sep 15 12:11:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:11:52.482458 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179fcd3b-8444-462b-8bf0-e5a8695a8af1 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:52.531740 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:52.570805 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 428/846] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:11:52 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 12:11:52.611755 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179fcd3b-8444-462b-8bf0-e5a8695a8af1 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:52.613466 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:52.649322 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f525a0d9-d694-4ba1-869d-a6749c0eda37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:52.649927 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f525a0d9-d694-4ba1-869d-a6749c0eda37 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:52.650200 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f525a0d9-d694-4ba1-869d-a6749c0eda37 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:52.650465 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f525a0d9-d694-4ba1-869d-a6749c0eda37 None admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:52.651270 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f525a0d9-d694-4ba1-869d-a6749c0eda37 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:52.651569 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f525a0d9-d694-4ba1-869d-a6749c0eda37 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:52.653038 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f525a0d9-d694-4ba1-869d-a6749c0eda37 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:52.675990 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 419/847] 10.222.0.16 () {56 vars in 1149 bytes} [Thu Sep 15 12:11:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:11:52.681556 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d40bd1-ca48-42eb-b2dd-a91a1e420070 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:52.683593 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493c578-9618-4316-ad78-81a255a15c27 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:52.683875 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493c578-9618-4316-ad78-81a255a15c27 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:52.684145 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493c578-9618-4316-ad78-81a255a15c27 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:52.685795 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 420/848] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:11:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 12:11:52.690767 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b974f05-9206-451d-8599-6da4d6c9c85a None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:52.691099 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b974f05-9206-451d-8599-6da4d6c9c85a None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:52.691378 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b974f05-9206-451d-8599-6da4d6c9c85a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:52.711183 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-9b974f05-9206-451d-8599-6da4d6c9c85a None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:11:52.712699 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-9b974f05-9206-451d-8599-6da4d6c9c85a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:11:52.793865 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d40bd1-ca48-42eb-b2dd-a91a1e420070 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:52.811895 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 421/849] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:11:52 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 12:11:52.837067 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd3b4a8-bf9c-4ced-810b-225284934433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:52.837699 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3b4a8-bf9c-4ced-810b-225284934433 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:52.837969 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3b4a8-bf9c-4ced-810b-225284934433 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:52.838232 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3b4a8-bf9c-4ced-810b-225284934433 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:52.850859 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b974f05-9206-451d-8599-6da4d6c9c85a None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:52.888735 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:52.914492 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd3b4a8-bf9c-4ced-810b-225284934433 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:52.916121 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd3b4a8-bf9c-4ced-810b-225284934433 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:52.979104 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:52.991209 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b974f05-9206-451d-8599-6da4d6c9c85a None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:53.025329 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 429/850] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 15 12:11:52 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 12:11:53.026844 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d1e93-00af-4a99-b582-9a22e017c84e None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:53.027177 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82288b3-1c1d-43a7-8048-3e5769929474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:53.027518 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d1e93-00af-4a99-b582-9a22e017c84e None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:53.027960 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82288b3-1c1d-43a7-8048-3e5769929474 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:53.028168 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d1e93-00af-4a99-b582-9a22e017c84e None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:53.028310 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82288b3-1c1d-43a7-8048-3e5769929474 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:53.028695 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82288b3-1c1d-43a7-8048-3e5769929474 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:53.029350 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82288b3-1c1d-43a7-8048-3e5769929474 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:53.030904 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 430/851] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:11:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:11:53.031477 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82288b3-1c1d-43a7-8048-3e5769929474 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:53.031970 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d1e93-00af-4a99-b582-9a22e017c84e None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:53.045200 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-d82288b3-1c1d-43a7-8048-3e5769929474 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 15 12:11:53.045200 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:53.045200 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 12:11:53.045200 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 12:11:53.045200 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 12:11:53.045200 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 12:11:53.045200 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 12:11:53.045200 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:11:53.045200 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 15 12:11:53.045200 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:53.045200 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 12:11:53.045200 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:53.045200 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:53.045200 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:53.045200 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:53.045200 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:53.045200 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:53.046252 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:53.046252 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:53.046252 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:53.046252 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:53.046252 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:53.046252 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:53.046252 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 12:11:53.046252 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 12:11:53.046252 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 12:11:53.046252 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 12:11:53.046252 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:53.046252 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:53.046252 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:53.046252 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:53.046252 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:53.046252 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:53.047129 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:53.047129 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:53.047129 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:53.047129 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:53.047129 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:53.047129 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:53.047129 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:53.047129 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:53.047129 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:53.047129 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:53.047129 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 12:11:53.047129 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:11:53.047129 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 15 12:11:53.047129 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:53.047129 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 422/852] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Sep 15 12:11:52 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:11:53.048675 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ef33e-7dc9-425a-91d1-3879ceb91e6b None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:53.048675 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ef33e-7dc9-425a-91d1-3879ceb91e6b None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:53.048834 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ef33e-7dc9-425a-91d1-3879ceb91e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:53.069065 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-7b9ef33e-7dc9-425a-91d1-3879ceb91e6b None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:11:53.070905 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-7b9ef33e-7dc9-425a-91d1-3879ceb91e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:11:53.114547 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:53.136118 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 423/853] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:11:53 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:11:53.136943 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9ef33e-7dc9-425a-91d1-3879ceb91e6b None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:53.138290 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d1e93-00af-4a99-b582-9a22e017c84e None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:53.173310 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d0c50f-4ddf-4ca4-9e73-6698235d0b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:53.174258 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d0c50f-4ddf-4ca4-9e73-6698235d0b3a None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:53.174762 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d0c50f-4ddf-4ca4-9e73-6698235d0b3a None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:53.175240 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d0c50f-4ddf-4ca4-9e73-6698235d0b3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:53.185880 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d0c50f-4ddf-4ca4-9e73-6698235d0b3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:53.187884 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d0c50f-4ddf-4ca4-9e73-6698235d0b3a None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:53.203645 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-63d0c50f-4ddf-4ca4-9e73-6698235d0b3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:53.203645 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:53.203645 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:53.203645 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:53.203645 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:53.203645 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:53.203645 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:53.203645 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:53.203645 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:53.203645 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:53.203645 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:53.203645 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:53.203645 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:11:53.203645 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:11:53.203645 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:11:53.203645 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:11:53.204600 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:53.204600 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:53.204600 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:53.204600 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:53.204600 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:53.204600 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:53.204600 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:53.204600 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:53.204600 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:53.204600 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:53.204600 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:53.204600 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:53.204600 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:53.204600 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:53.204600 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:53.204600 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:53.204600 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:11:53.205480 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:11:53.205480 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:53.205480 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:11:53.205480 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 431/854] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:11:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:53.205480 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d0c50f-4ddf-4ca4-9e73-6698235d0b3a None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:53.246584 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:53.265319 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9ef33e-7dc9-425a-91d1-3879ceb91e6b None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:53.299030 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9648857c-c02f-4ea2-9c27-cb60ed3b5d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:53.299628 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648857c-c02f-4ea2-9c27-cb60ed3b5d2f None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:53.300024 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648857c-c02f-4ea2-9c27-cb60ed3b5d2f None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:53.300294 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648857c-c02f-4ea2-9c27-cb60ed3b5d2f None admin] PATH_INFO: `/v3/services` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:53.300918 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9648857c-c02f-4ea2-9c27-cb60ed3b5d2f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:53.301218 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9648857c-c02f-4ea2-9c27-cb60ed3b5d2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:53.302580 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9648857c-c02f-4ea2-9c27-cb60ed3b5d2f None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:53.310881 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 424/855] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Sep 15 12:11:53 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:53.310881 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9648857c-c02f-4ea2-9c27-cb60ed3b5d2f None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:53.316991 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d0c50f-4ddf-4ca4-9e73-6698235d0b3a None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:53.344610 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:53.354858 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa741e0-328e-417e-ac57-e7765c8ec4d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:53.355430 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa741e0-328e-417e-ac57-e7765c8ec4d5 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:53.355711 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa741e0-328e-417e-ac57-e7765c8ec4d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:53.356192 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa741e0-328e-417e-ac57-e7765c8ec4d5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:53.366442 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa741e0-328e-417e-ac57-e7765c8ec4d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:11:53.371827 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-faa741e0-328e-417e-ac57-e7765c8ec4d5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:11:53.371827 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:53.371827 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:53.371827 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:53.371827 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:53.371827 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:53.371827 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:53.371827 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:53.371827 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:53.371827 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:53.371827 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:53.371827 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:53.371827 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:11:53.371827 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:11:53.371827 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:11:53.371827 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:11:53.372730 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:11:53.372730 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:11:53.372730 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:11:53.372730 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:11:53.372730 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:53.372730 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:53.372730 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:53.372730 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:53.372730 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:53.372730 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:53.372730 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:53.372730 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:53.372730 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:53.372730 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:53.372730 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:53.372730 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:53.374102 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:53.374102 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:53.374102 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:53.374102 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:53.374102 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:11:53.374102 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:11:53.374102 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:11:53.374102 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:11:53.374102 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:11:53.374102 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:11:53.374102 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:11:53.374102 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:11:53.374102 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 432/856] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Sep 15 12:11:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:53.374102 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa741e0-328e-417e-ac57-e7765c8ec4d5 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:53.417679 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9648857c-c02f-4ea2-9c27-cb60ed3b5d2f None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:53.450412 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d0c76f-c4d5-4cd4-82b7-d828a89bb763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:53.451045 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d0c76f-c4d5-4cd4-82b7-d828a89bb763 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:53.451323 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d0c76f-c4d5-4cd4-82b7-d828a89bb763 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:53.452205 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d0c76f-c4d5-4cd4-82b7-d828a89bb763 None admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:53.452847 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d0c76f-c4d5-4cd4-82b7-d828a89bb763 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:53.453150 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d0c76f-c4d5-4cd4-82b7-d828a89bb763 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:53.454522 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d0c76f-c4d5-4cd4-82b7-d828a89bb763 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:53.466140 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 425/857] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 15 12:11:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:53.466947 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d0c76f-c4d5-4cd4-82b7-d828a89bb763 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:53.476723 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:53.477246 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa741e0-328e-417e-ac57-e7765c8ec4d5 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:53.510665 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef418d38-2b30-4514-98ce-da2f1b69ce7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:53.511230 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef418d38-2b30-4514-98ce-da2f1b69ce7a None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:53.511512 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef418d38-2b30-4514-98ce-da2f1b69ce7a None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:53.511782 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef418d38-2b30-4514-98ce-da2f1b69ce7a None admin] PATH_INFO: `/v3/services` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:53.512409 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef418d38-2b30-4514-98ce-da2f1b69ce7a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:53.512714 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef418d38-2b30-4514-98ce-da2f1b69ce7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:53.514113 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef418d38-2b30-4514-98ce-da2f1b69ce7a None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:53.518961 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 433/858] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Sep 15 12:11:53 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:53.519712 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef418d38-2b30-4514-98ce-da2f1b69ce7a None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:53.582000 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:53.583836 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d0c76f-c4d5-4cd4-82b7-d828a89bb763 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:53.624448 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170a71fb-33a9-42ae-86f7-cabdc7176999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:53.625460 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a71fb-33a9-42ae-86f7-cabdc7176999 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:53.625949 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a71fb-33a9-42ae-86f7-cabdc7176999 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:53.627064 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a71fb-33a9-42ae-86f7-cabdc7176999 None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:53.627758 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170a71fb-33a9-42ae-86f7-cabdc7176999 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:53.628134 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170a71fb-33a9-42ae-86f7-cabdc7176999 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:53.629461 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170a71fb-33a9-42ae-86f7-cabdc7176999 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:53.642856 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 426/859] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 15 12:11:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:53.643057 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef418d38-2b30-4514-98ce-da2f1b69ce7a None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:53.643138 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170a71fb-33a9-42ae-86f7-cabdc7176999 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:53.691203 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffb58c5-86bb-45ff-b2ba-559aea24bb59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:53.692091 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb58c5-86bb-45ff-b2ba-559aea24bb59 None admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:53.692374 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb58c5-86bb-45ff-b2ba-559aea24bb59 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:53.693136 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb58c5-86bb-45ff-b2ba-559aea24bb59 None admin] PATH_INFO: `/v3/services` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:53.694097 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffb58c5-86bb-45ff-b2ba-559aea24bb59 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:53.695530 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffb58c5-86bb-45ff-b2ba-559aea24bb59 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:53.717830 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 434/860] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Sep 15 12:11:53 2022] POST /identity/v3/services => generated 269 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:11:53.718638 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffb58c5-86bb-45ff-b2ba-559aea24bb59 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:53.727161 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:53.773380 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170a71fb-33a9-42ae-86f7-cabdc7176999 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:53.823974 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb13f26-82c6-4dc0-a9c9-ab9fc99e368f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:53.825143 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb13f26-82c6-4dc0-a9c9-ab9fc99e368f None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:53.825625 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb13f26-82c6-4dc0-a9c9-ab9fc99e368f None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:53.826186 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb13f26-82c6-4dc0-a9c9-ab9fc99e368f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:53.834839 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb13f26-82c6-4dc0-a9c9-ab9fc99e368f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:53.836774 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb13f26-82c6-4dc0-a9c9-ab9fc99e368f None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:53.845578 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffb58c5-86bb-45ff-b2ba-559aea24bb59 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:53.851560 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-3fb13f26-82c6-4dc0-a9c9-ab9fc99e368f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:11:53.851560 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:53.851560 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:53.851560 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:53.851560 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:53.851560 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:53.851560 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:53.851560 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:53.851560 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:53.851560 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:53.851560 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:53.851560 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:53.851560 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 12:11:53.851560 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 12:11:53.851560 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 12:11:53.852529 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 12:11:53.852529 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:53.852529 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:53.852529 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:53.852529 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:53.852529 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:53.852529 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:53.852529 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:53.852529 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:53.852529 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:53.852529 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:53.852529 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:53.852529 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:53.852529 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:53.852529 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:53.852529 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:53.852529 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:53.853425 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 12:11:53.853425 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 12:11:53.853425 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 12:11:53.853425 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 12:11:53.853425 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 12:11:53.853425 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 12:11:53.853425 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:11:53.853425 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:53.861457 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 427/861] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 15 12:11:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:53.862151 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:53.864263 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb13f26-82c6-4dc0-a9c9-ab9fc99e368f None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:53.890316 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e3f387-c142-41b8-9e53-df5e7a8c02ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:53.890989 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e3f387-c142-41b8-9e53-df5e7a8c02ab None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:53.891266 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e3f387-c142-41b8-9e53-df5e7a8c02ab None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:53.891544 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e3f387-c142-41b8-9e53-df5e7a8c02ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:53.905849 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e3f387-c142-41b8-9e53-df5e7a8c02ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:53.907381 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e3f387-c142-41b8-9e53-df5e7a8c02ab None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:53.924879 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-71e3f387-c142-41b8-9e53-df5e7a8c02ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:53.924879 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:53.924879 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:53.924879 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:53.924879 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:53.924879 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:53.924879 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:53.924879 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:53.924879 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:53.924879 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:53.924879 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:53.924879 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:53.924879 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:11:53.924879 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:11:53.924879 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:11:53.924879 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:11:53.925842 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:53.925842 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:53.925842 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:53.925842 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:53.925842 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:53.925842 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:53.925842 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:53.925842 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:53.925842 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:53.925842 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:53.925842 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:53.925842 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:53.925842 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:53.925842 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:53.925842 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:53.925842 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:53.925842 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:11:53.927560 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:11:53.927560 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:53.927560 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:11:53.927560 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 435/862] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:11:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:53.932471 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e3f387-c142-41b8-9e53-df5e7a8c02ab None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:53.989640 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb13f26-82c6-4dc0-a9c9-ab9fc99e368f None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:54.021382 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:54.034321 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ad1e32-0b8a-48a3-82d4-494cd33cd8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:54.035213 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad1e32-0b8a-48a3-82d4-494cd33cd8d1 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:54.035660 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad1e32-0b8a-48a3-82d4-494cd33cd8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:54.036075 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ad1e32-0b8a-48a3-82d4-494cd33cd8d1 None admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:54.036916 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ad1e32-0b8a-48a3-82d4-494cd33cd8d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:54.037366 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ad1e32-0b8a-48a3-82d4-494cd33cd8d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:54.038997 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ad1e32-0b8a-48a3-82d4-494cd33cd8d1 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:54.057618 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 428/863] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Sep 15 12:11:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:11:54.059387 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ad1e32-0b8a-48a3-82d4-494cd33cd8d1 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:54.073134 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e3f387-c142-41b8-9e53-df5e7a8c02ab None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:54.122201 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61064903-2d6f-4192-848a-c732ac96a778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:54.122849 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61064903-2d6f-4192-848a-c732ac96a778 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:54.123581 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61064903-2d6f-4192-848a-c732ac96a778 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:54.123865 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61064903-2d6f-4192-848a-c732ac96a778 None admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:54.124728 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61064903-2d6f-4192-848a-c732ac96a778 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:54.125128 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61064903-2d6f-4192-848a-c732ac96a778 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:54.127059 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61064903-2d6f-4192-848a-c732ac96a778 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:54.146844 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 436/864] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 15 12:11:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:11:54.150271 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61064903-2d6f-4192-848a-c732ac96a778 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:54.178389 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:54.182090 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ad1e32-0b8a-48a3-82d4-494cd33cd8d1 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:54.223127 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b718dd0c-5f84-4670-8639-40097cc71b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:54.224051 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b718dd0c-5f84-4670-8639-40097cc71b08 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:54.224578 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b718dd0c-5f84-4670-8639-40097cc71b08 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:54.225071 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b718dd0c-5f84-4670-8639-40097cc71b08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:54.226144 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b718dd0c-5f84-4670-8639-40097cc71b08 None admin] RBAC: Adding query filter params (role.id=9c9f10110e12479bb6b3b630dd6412b8, scope.project.id=cab958c081ad4a92939d4469cf4ce1c6, user.id=b4614bede59c47ea813a73fcc0840a2d) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:54.226657 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b718dd0c-5f84-4670-8639-40097cc71b08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:54.228415 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b718dd0c-5f84-4670-8639-40097cc71b08 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:54.242903 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 429/865] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 15 12:11:54 2022] GET /identity/v3/role_assignments?user.id=b4614bede59c47ea813a73fcc0840a2d&scope.project.id=cab958c081ad4a92939d4469cf4ce1c6&role.id=9c9f10110e12479bb6b3b630dd6412b8 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:11:54.274893 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61064903-2d6f-4192-848a-c732ac96a778 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:54.314610 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1790468e-cec7-4166-a4b5-d2b7f915e60c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:54.315212 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1790468e-cec7-4166-a4b5-d2b7f915e60c None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:54.315488 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1790468e-cec7-4166-a4b5-d2b7f915e60c None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:54.315755 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1790468e-cec7-4166-a4b5-d2b7f915e60c None admin] PATH_INFO: `/v3/users/swift` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:54.324147 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1790468e-cec7-4166-a4b5-d2b7f915e60c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:54.325618 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1790468e-cec7-4166-a4b5-d2b7f915e60c None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:54.339021 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-1790468e-cec7-4166-a4b5-d2b7f915e60c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 15 12:11:54.339021 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:54.339021 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:54.339021 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:54.339021 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:54.339021 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:54.339021 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:54.339021 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:54.339021 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:54.339021 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:54.339021 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:54.339021 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:54.339021 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 12:11:54.339021 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 12:11:54.339021 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 12:11:54.339021 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 12:11:54.340036 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:54.340036 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:54.340036 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 12:11:54.340036 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:11:54.340036 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 12:11:54.340036 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:11:54.340036 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:54.340036 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:54.340036 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:54.340036 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:54.340036 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:54.340036 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:54.340036 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:54.340036 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:54.340036 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:54.340036 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:54.340036 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:54.340036 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:54.341375 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:54.341375 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:54.341375 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 12:11:54.341375 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 12:11:54.341375 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 12:11:54.341375 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 12:11:54.341375 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 12:11:54.341375 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 12:11:54.341375 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 15 12:11:54.341375 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:11:54.341375 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 437/866] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Sep 15 12:11:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:11:54.346876 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b718dd0c-5f84-4670-8639-40097cc71b08 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:54.407034 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:54.466580 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b718dd0c-5f84-4670-8639-40097cc71b08 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:54.502334 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3e9a9c-bf83-4a94-b2b6-46728b87e357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:54.502971 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e9a9c-bf83-4a94-b2b6-46728b87e357 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:54.503248 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e9a9c-bf83-4a94-b2b6-46728b87e357 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:54.503514 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e9a9c-bf83-4a94-b2b6-46728b87e357 None admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:54.504241 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3e9a9c-bf83-4a94-b2b6-46728b87e357 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:54.504545 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3e9a9c-bf83-4a94-b2b6-46728b87e357 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:54.505963 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3e9a9c-bf83-4a94-b2b6-46728b87e357 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:54.525093 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 430/867] 10.222.0.16 () {56 vars in 1135 bytes} [Thu Sep 15 12:11:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:54.531256 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1790468e-cec7-4166-a4b5-d2b7f915e60c None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:54.619550 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:54.640981 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1790468e-cec7-4166-a4b5-d2b7f915e60c None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:54.675577 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85500de-21d5-4fde-b59d-30dc89c08e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:54.676182 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85500de-21d5-4fde-b59d-30dc89c08e97 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:54.676459 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85500de-21d5-4fde-b59d-30dc89c08e97 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:54.676730 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85500de-21d5-4fde-b59d-30dc89c08e97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:54.749598 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85500de-21d5-4fde-b59d-30dc89c08e97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:54.751137 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85500de-21d5-4fde-b59d-30dc89c08e97 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:54.836634 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:54.853798 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 438/868] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 15 12:11:54 2022] GET /identity/v3/auth/tokens => generated 1271 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 12:11:54.859450 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3e9a9c-bf83-4a94-b2b6-46728b87e357 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:54.960470 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3e9a9c-bf83-4a94-b2b6-46728b87e357 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:54.971035 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:54.996659 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b615d-0434-4215-a5cc-f154ef107f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:54.997289 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b615d-0434-4215-a5cc-f154ef107f64 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:54.997563 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b615d-0434-4215-a5cc-f154ef107f64 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:54.997832 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b615d-0434-4215-a5cc-f154ef107f64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:55.008780 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977b615d-0434-4215-a5cc-f154ef107f64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:55.010226 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977b615d-0434-4215-a5cc-f154ef107f64 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:55.025590 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-977b615d-0434-4215-a5cc-f154ef107f64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:55.025590 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:55.025590 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:55.025590 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:55.025590 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:55.025590 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:55.025590 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:55.025590 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:55.025590 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:55.025590 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:55.025590 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:55.025590 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:55.025590 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:11:55.025590 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:11:55.025590 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:11:55.025590 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:11:55.026539 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:55.026539 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:55.026539 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:55.026539 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:55.026539 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:55.026539 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:55.026539 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:55.026539 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:55.026539 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:55.026539 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:55.026539 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:55.026539 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:55.026539 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:55.026539 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:55.026539 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:55.026539 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:55.026539 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:11:55.027465 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:11:55.027465 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:55.027465 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:55.031032 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 431/869] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:11:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:55.032707 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85500de-21d5-4fde-b59d-30dc89c08e97 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:55.135341 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85500de-21d5-4fde-b59d-30dc89c08e97 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:55.169996 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539693f3-4b1d-499c-83cd-7ea6c5f463a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:55.171159 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539693f3-4b1d-499c-83cd-7ea6c5f463a5 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:55.171513 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539693f3-4b1d-499c-83cd-7ea6c5f463a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:55.171783 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539693f3-4b1d-499c-83cd-7ea6c5f463a5 None admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:55.172418 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539693f3-4b1d-499c-83cd-7ea6c5f463a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:55.172719 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539693f3-4b1d-499c-83cd-7ea6c5f463a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:55.174145 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539693f3-4b1d-499c-83cd-7ea6c5f463a5 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:55.190847 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 439/870] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 15 12:11:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:55.192373 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b615d-0434-4215-a5cc-f154ef107f64 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:55.307218 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b615d-0434-4215-a5cc-f154ef107f64 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:55.341347 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5707089-4e41-40c9-a69d-cac489f6cc72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:55.341980 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5707089-4e41-40c9-a69d-cac489f6cc72 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:55.342259 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5707089-4e41-40c9-a69d-cac489f6cc72 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:55.342533 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5707089-4e41-40c9-a69d-cac489f6cc72 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:55.349363 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5707089-4e41-40c9-a69d-cac489f6cc72 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:55.350902 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5707089-4e41-40c9-a69d-cac489f6cc72 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:55.363094 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-e5707089-4e41-40c9-a69d-cac489f6cc72 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:11:55.363094 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:55.363094 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:55.363094 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:55.363094 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:55.363094 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:55.363094 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:55.363094 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:55.363094 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:55.363094 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:55.363094 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:55.363094 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:55.363094 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 12:11:55.363094 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 12:11:55.363094 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 12:11:55.363968 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 12:11:55.363968 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:55.363968 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:55.363968 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:55.363968 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:55.363968 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:55.363968 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:55.363968 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:55.363968 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:55.363968 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:55.363968 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:55.363968 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:55.363968 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:55.363968 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:55.363968 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:55.363968 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:55.363968 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:55.365240 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 12:11:55.365240 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 12:11:55.365240 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 12:11:55.365240 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 12:11:55.365240 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 12:11:55.365240 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 12:11:55.365240 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:11:55.365240 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:55.365240 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 432/871] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 15 12:11:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:55.370364 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539693f3-4b1d-499c-83cd-7ea6c5f463a5 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:55.417644 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:55.473601 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539693f3-4b1d-499c-83cd-7ea6c5f463a5 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:55.510796 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b239591-b160-4d74-963b-0d72b85f8bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:55.511407 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b239591-b160-4d74-963b-0d72b85f8bd7 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:55.511690 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b239591-b160-4d74-963b-0d72b85f8bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:55.511964 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b239591-b160-4d74-963b-0d72b85f8bd7 None admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:55.512653 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b239591-b160-4d74-963b-0d72b85f8bd7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:55.512961 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b239591-b160-4d74-963b-0d72b85f8bd7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:55.514434 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b239591-b160-4d74-963b-0d72b85f8bd7 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:55.531049 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 440/872] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Sep 15 12:11:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:55.533538 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5707089-4e41-40c9-a69d-cac489f6cc72 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:55.567263 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:55.642292 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5707089-4e41-40c9-a69d-cac489f6cc72 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:55.680062 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e756e2b-6ff2-41b4-a6cd-9021ae82a9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:55.681046 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e756e2b-6ff2-41b4-a6cd-9021ae82a9d0 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:55.681547 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e756e2b-6ff2-41b4-a6cd-9021ae82a9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:55.682033 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e756e2b-6ff2-41b4-a6cd-9021ae82a9d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:55.682985 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e756e2b-6ff2-41b4-a6cd-9021ae82a9d0 None admin] RBAC: Adding query filter params (role.id=7f53f1c823b746529ba5057bf21b2477, scope.project.id=cab958c081ad4a92939d4469cf4ce1c6, user.id=ee33b730d0ec428ca2cd3af4ebf723e8) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:55.683506 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e756e2b-6ff2-41b4-a6cd-9021ae82a9d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:55.685140 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e756e2b-6ff2-41b4-a6cd-9021ae82a9d0 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:55.691788 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 433/873] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 15 12:11:55 2022] GET /identity/v3/role_assignments?user.id=ee33b730d0ec428ca2cd3af4ebf723e8&scope.project.id=cab958c081ad4a92939d4469cf4ce1c6&role.id=7f53f1c823b746529ba5057bf21b2477 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:55.746793 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872bb83a-b41c-4174-adcb-9c94ed492bd8 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:55.747093 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872bb83a-b41c-4174-adcb-9c94ed492bd8 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:55.747353 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872bb83a-b41c-4174-adcb-9c94ed492bd8 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:55.748991 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 441/874] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:11:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:11:55.754841 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9216f0-c721-42ed-baf1-f7e233cfd9c5 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:55.755451 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9216f0-c721-42ed-baf1-f7e233cfd9c5 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:55.755920 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9216f0-c721-42ed-baf1-f7e233cfd9c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:55.775785 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-9c9216f0-c721-42ed-baf1-f7e233cfd9c5 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:11:55.777330 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-9c9216f0-c721-42ed-baf1-f7e233cfd9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:11:55.853874 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 434/875] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:11:55 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:11:56.134742 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf43c33-ffd3-4eec-bd0e-0392f2398628 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:56.135249 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf43c33-ffd3-4eec-bd0e-0392f2398628 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:56.135249 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf43c33-ffd3-4eec-bd0e-0392f2398628 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:56.136976 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 442/876] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:11:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:11:56.142392 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f8c25-05bf-49a8-9360-8bb661083c53 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:56.142775 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f8c25-05bf-49a8-9360-8bb661083c53 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:56.143297 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f8c25-05bf-49a8-9360-8bb661083c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:56.158532 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf43c33-ffd3-4eec-bd0e-0392f2398628 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:56.164030 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-4f2f8c25-05bf-49a8-9360-8bb661083c53 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:11:56.165222 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-4f2f8c25-05bf-49a8-9360-8bb661083c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:11:56.176032 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:56.258791 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 435/877] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:11:56 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 12:11:56.301477 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf43c33-ffd3-4eec-bd0e-0392f2398628 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:56.304813 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:56.343788 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c88a21-d96a-4c43-a184-b73ddd27a275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:56.344401 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c88a21-d96a-4c43-a184-b73ddd27a275 None admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:56.344669 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c88a21-d96a-4c43-a184-b73ddd27a275 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:56.344940 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c88a21-d96a-4c43-a184-b73ddd27a275 None admin] PATH_INFO: `/v3/services` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:56.345612 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c88a21-d96a-4c43-a184-b73ddd27a275 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:56.347006 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c88a21-d96a-4c43-a184-b73ddd27a275 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:56.368292 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 443/878] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Sep 15 12:11:56 2022] POST /identity/v3/services => generated 251 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 12:11:56.567359 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2f8c25-05bf-49a8-9360-8bb661083c53 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:56.598609 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9125a33-bdcf-4aef-83f0-83d0c234f43e None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:56.599168 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9125a33-bdcf-4aef-83f0-83d0c234f43e None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:56.599775 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9125a33-bdcf-4aef-83f0-83d0c234f43e None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:56.605856 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 444/879] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:11:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 12:11:56.608690 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf88cc43-0341-45ac-bf0e-f450f1a1174e None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:56.609009 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf88cc43-0341-45ac-bf0e-f450f1a1174e None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:56.609254 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf88cc43-0341-45ac-bf0e-f450f1a1174e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:56.635366 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-cf88cc43-0341-45ac-bf0e-f450f1a1174e None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:11:56.636417 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-cf88cc43-0341-45ac-bf0e-f450f1a1174e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:11:56.680760 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2f8c25-05bf-49a8-9360-8bb661083c53 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:56.726628 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00079fd6-0327-4c52-ac55-9ac82ad7a808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:56.727422 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00079fd6-0327-4c52-ac55-9ac82ad7a808 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:56.727775 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00079fd6-0327-4c52-ac55-9ac82ad7a808 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:56.728113 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00079fd6-0327-4c52-ac55-9ac82ad7a808 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:56.728796 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00079fd6-0327-4c52-ac55-9ac82ad7a808 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:56.730407 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00079fd6-0327-4c52-ac55-9ac82ad7a808 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:56.731144 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 445/880] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:11:56 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:11:56.744632 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-00079fd6-0327-4c52-ac55-9ac82ad7a808 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 15 12:11:56.744632 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:56.744632 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 12:11:56.744632 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 12:11:56.744632 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 12:11:56.744632 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 12:11:56.744632 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 12:11:56.744632 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:11:56.744632 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 15 12:11:56.744632 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:56.744632 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 12:11:56.744632 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:56.744632 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:56.744632 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:56.744632 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:56.744632 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:56.745794 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:56.745794 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:56.745794 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:56.745794 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:56.745794 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:56.745794 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:56.745794 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:56.745794 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 12:11:56.745794 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 12:11:56.745794 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 12:11:56.745794 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 12:11:56.745794 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:56.745794 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:56.745794 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:56.745794 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:56.745794 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:56.745794 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:56.746774 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:56.746774 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:56.746774 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:56.746774 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:56.746774 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:56.746774 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:56.746774 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:56.746774 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:56.746774 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:56.746774 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:56.746774 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 12:11:56.746774 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:11:56.746774 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 15 12:11:56.746774 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:56.749880 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 436/881] 10.222.0.16 () {56 vars in 1132 bytes} [Thu Sep 15 12:11:56 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:56.755990 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf88cc43-0341-45ac-bf0e-f450f1a1174e None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:56.859420 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:56.868868 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf88cc43-0341-45ac-bf0e-f450f1a1174e None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:56.906004 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d17a690-77ac-4a1f-8b41-4e82f96ab8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:56.906612 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d17a690-77ac-4a1f-8b41-4e82f96ab8ac None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:56.906928 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d17a690-77ac-4a1f-8b41-4e82f96ab8ac None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:56.907197 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d17a690-77ac-4a1f-8b41-4e82f96ab8ac None admin] PATH_INFO: `/v3/services` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:56.907823 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d17a690-77ac-4a1f-8b41-4e82f96ab8ac None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:56.908123 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d17a690-77ac-4a1f-8b41-4e82f96ab8ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:56.909483 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d17a690-77ac-4a1f-8b41-4e82f96ab8ac None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:56.914489 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 446/882] 10.222.0.16 () {56 vars in 1126 bytes} [Thu Sep 15 12:11:56 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:56.920778 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00079fd6-0327-4c52-ac55-9ac82ad7a808 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:56.932847 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:57.027169 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d17a690-77ac-4a1f-8b41-4e82f96ab8ac None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:57.034616 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00079fd6-0327-4c52-ac55-9ac82ad7a808 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:57.072464 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929536da-dc54-4977-9604-4b2c4c46abfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:57.073072 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929536da-dc54-4977-9604-4b2c4c46abfa None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:57.073349 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929536da-dc54-4977-9604-4b2c4c46abfa None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:57.073621 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929536da-dc54-4977-9604-4b2c4c46abfa None admin] PATH_INFO: `/v3/services` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:57.074833 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929536da-dc54-4977-9604-4b2c4c46abfa None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:57.075140 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929536da-dc54-4977-9604-4b2c4c46abfa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:57.077043 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929536da-dc54-4977-9604-4b2c4c46abfa None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:57.089107 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 437/883] 10.222.0.16 () {56 vars in 1126 bytes} [Thu Sep 15 12:11:56 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:57.090727 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929536da-dc54-4977-9604-4b2c4c46abfa None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:57.145580 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d17a690-77ac-4a1f-8b41-4e82f96ab8ac None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:57.179103 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:57.182864 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae67575-4166-46cf-ae7c-c70c1515e1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:57.184011 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae67575-4166-46cf-ae7c-c70c1515e1a7 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:57.185410 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae67575-4166-46cf-ae7c-c70c1515e1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:57.186427 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae67575-4166-46cf-ae7c-c70c1515e1a7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:57.198318 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae67575-4166-46cf-ae7c-c70c1515e1a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:11:57.204514 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-bae67575-4166-46cf-ae7c-c70c1515e1a7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 15 12:11:57.204514 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:57.204514 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:57.204514 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:57.204514 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:57.204514 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:57.204514 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:57.204514 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:57.204514 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:57.204514 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:57.204514 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:57.204514 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:57.204514 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:11:57.204514 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:11:57.204514 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:11:57.204514 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:11:57.205455 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:11:57.205455 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:11:57.205455 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:11:57.205455 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:11:57.205455 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:57.205455 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:57.205455 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:57.205455 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:57.205455 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:57.205455 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:57.205455 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:57.205455 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:57.205455 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:57.205455 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:57.205455 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:57.205455 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:57.206316 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:57.206316 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:57.206316 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:57.206316 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:57.206316 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:11:57.206316 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:11:57.206316 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:11:57.206316 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:11:57.206316 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:11:57.206316 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:11:57.206316 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 15 12:11:57.206316 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:11:57.209612 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 447/884] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Sep 15 12:11:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:57.216314 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae67575-4166-46cf-ae7c-c70c1515e1a7 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:57.224296 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929536da-dc54-4977-9604-4b2c4c46abfa None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:57.261173 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdf7708-643b-4d86-bb7d-cbc23bce921c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:57.263293 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:57.264907 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf7708-643b-4d86-bb7d-cbc23bce921c None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:57.265490 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf7708-643b-4d86-bb7d-cbc23bce921c None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:57.265955 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf7708-643b-4d86-bb7d-cbc23bce921c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:57.267294 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdf7708-643b-4d86-bb7d-cbc23bce921c None admin] RBAC: Adding query filter params (interface=public, service_id=dfe1ada20e934098aeb62513ff40c0d0, region_id=RegionOne) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:57.267845 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdf7708-643b-4d86-bb7d-cbc23bce921c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:57.269557 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdf7708-643b-4d86-bb7d-cbc23bce921c None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:57.275556 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 438/885] 10.222.0.16 () {56 vars in 1251 bytes} [Thu Sep 15 12:11:57 2022] GET /identity/v3/endpoints?service_id=dfe1ada20e934098aeb62513ff40c0d0&interface=public®ion_id=RegionOne => generated 194 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:11:57.283781 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdf7708-643b-4d86-bb7d-cbc23bce921c None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:57.339547 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae67575-4166-46cf-ae7c-c70c1515e1a7 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:57.383503 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391741b5-9b88-4b63-942b-3582938e7d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:57.384543 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391741b5-9b88-4b63-942b-3582938e7d65 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:57.385195 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391741b5-9b88-4b63-942b-3582938e7d65 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:57.385664 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391741b5-9b88-4b63-942b-3582938e7d65 None admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:57.387139 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391741b5-9b88-4b63-942b-3582938e7d65 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:57.387722 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391741b5-9b88-4b63-942b-3582938e7d65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:57.389462 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391741b5-9b88-4b63-942b-3582938e7d65 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:57.403796 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 448/886] 10.222.0.16 () {56 vars in 1115 bytes} [Thu Sep 15 12:11:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:57.405550 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391741b5-9b88-4b63-942b-3582938e7d65 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:57.408764 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdf7708-643b-4d86-bb7d-cbc23bce921c None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:57.439850 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:57.446377 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547f327b-b7b7-459f-acd4-5735ffa30978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:57.447066 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f327b-b7b7-459f-acd4-5735ffa30978 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:57.447343 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f327b-b7b7-459f-acd4-5735ffa30978 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:57.447665 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f327b-b7b7-459f-acd4-5735ffa30978 None admin] PATH_INFO: `/v3/services` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:57.448292 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547f327b-b7b7-459f-acd4-5735ffa30978 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:57.450069 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547f327b-b7b7-459f-acd4-5735ffa30978 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:57.462713 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 439/887] 10.222.0.16 () {56 vars in 1087 bytes} [Thu Sep 15 12:11:57 2022] GET /identity/v3/services => generated 1268 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 12:11:57.506109 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:57.529172 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391741b5-9b88-4b63-942b-3582938e7d65 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:57.566798 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f698da-bc17-4d06-8fc2-244c0ad2b069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:57.567486 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f698da-bc17-4d06-8fc2-244c0ad2b069 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:57.567762 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f698da-bc17-4d06-8fc2-244c0ad2b069 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:57.568027 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f698da-bc17-4d06-8fc2-244c0ad2b069 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:57.580164 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f698da-bc17-4d06-8fc2-244c0ad2b069 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:57.581695 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f698da-bc17-4d06-8fc2-244c0ad2b069 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:57.597340 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-05f698da-bc17-4d06-8fc2-244c0ad2b069 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:57.597340 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:57.597340 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:57.597340 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:57.597340 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:57.597340 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:57.597340 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:57.597340 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:57.597340 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:57.597340 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:57.597340 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:57.597340 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:57.597340 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:11:57.597340 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:11:57.597340 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:11:57.597340 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:11:57.598364 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:57.598364 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:57.598364 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:57.598364 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:57.598364 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:57.598364 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:57.598364 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:57.598364 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:57.598364 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:57.598364 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:57.598364 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:57.598364 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:57.598364 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:57.598364 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:57.598364 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:57.598364 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:57.598364 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:11:57.599511 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:11:57.599511 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:57.599511 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:11:57.599511 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 449/888] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:11:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:11:57.606209 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547f327b-b7b7-459f-acd4-5735ffa30978 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:57.720225 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547f327b-b7b7-459f-acd4-5735ffa30978 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:57.756722 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51926ab8-0d5a-46d2-b337-753fcbefacbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:57.757333 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51926ab8-0d5a-46d2-b337-753fcbefacbe None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:57.757609 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51926ab8-0d5a-46d2-b337-753fcbefacbe None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:57.757881 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51926ab8-0d5a-46d2-b337-753fcbefacbe None admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:57.758516 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51926ab8-0d5a-46d2-b337-753fcbefacbe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:57.758899 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51926ab8-0d5a-46d2-b337-753fcbefacbe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:57.760266 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51926ab8-0d5a-46d2-b337-753fcbefacbe None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:57.777264 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 440/889] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 15 12:11:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:57.778592 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f698da-bc17-4d06-8fc2-244c0ad2b069 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:57.888935 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f698da-bc17-4d06-8fc2-244c0ad2b069 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:57.917257 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:57.926537 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907a886b-690f-4561-8327-290717bf0509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:57.927656 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907a886b-690f-4561-8327-290717bf0509 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:57.928429 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907a886b-690f-4561-8327-290717bf0509 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:57.928907 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907a886b-690f-4561-8327-290717bf0509 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:57.936984 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907a886b-690f-4561-8327-290717bf0509 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:57.938663 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907a886b-690f-4561-8327-290717bf0509 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:57.951625 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-907a886b-690f-4561-8327-290717bf0509 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 15 12:11:57.951625 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:57.951625 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:57.951625 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:57.951625 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:57.951625 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:57.951625 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:57.951625 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:57.951625 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:57.951625 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:57.951625 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:57.951625 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:57.951625 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 12:11:57.951625 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 12:11:57.951625 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 12:11:57.951625 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 12:11:57.952658 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:57.952658 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:57.952658 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 12:11:57.952658 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:11:57.952658 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 12:11:57.952658 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:11:57.952658 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:57.952658 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:57.952658 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:57.952658 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:57.952658 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:57.952658 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:57.952658 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:57.952658 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:57.952658 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:57.952658 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:57.952658 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:57.952658 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:57.953600 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:57.953600 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:57.953600 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 12:11:57.953600 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 12:11:57.953600 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 12:11:57.953600 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 12:11:57.953600 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 12:11:57.953600 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 12:11:57.953600 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 15 12:11:57.953600 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:11:57.960629 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 450/890] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Sep 15 12:11:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:57.962303 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51926ab8-0d5a-46d2-b337-753fcbefacbe None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:58.026978 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:58.071020 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96784d51-ffd6-4f1e-8389-29e9cfcfe79f None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:58.071346 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96784d51-ffd6-4f1e-8389-29e9cfcfe79f None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:58.071635 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96784d51-ffd6-4f1e-8389-29e9cfcfe79f None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:58.072442 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51926ab8-0d5a-46d2-b337-753fcbefacbe None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:58.073097 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 451/891] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:11:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:11:58.078923 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b8bf0-c2a9-4a49-ba37-50a35f21b824 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:58.079205 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b8bf0-c2a9-4a49-ba37-50a35f21b824 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:58.079482 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b8bf0-c2a9-4a49-ba37-50a35f21b824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:58.099468 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-fc4b8bf0-c2a9-4a49-ba37-50a35f21b824 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:11:58.100866 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-fc4b8bf0-c2a9-4a49-ba37-50a35f21b824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:11:58.108200 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62174f4-cf88-4973-aa79-23af02672257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:58.108806 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62174f4-cf88-4973-aa79-23af02672257 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:58.109080 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62174f4-cf88-4973-aa79-23af02672257 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:58.109346 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62174f4-cf88-4973-aa79-23af02672257 None admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:58.110066 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62174f4-cf88-4973-aa79-23af02672257 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:58.110362 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62174f4-cf88-4973-aa79-23af02672257 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:58.111825 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62174f4-cf88-4973-aa79-23af02672257 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:58.129945 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 441/892] 10.222.0.16 () {56 vars in 1149 bytes} [Thu Sep 15 12:11:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:11:58.137616 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62174f4-cf88-4973-aa79-23af02672257 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:58.182722 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 452/893] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:11:58 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 12:11:58.249554 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62174f4-cf88-4973-aa79-23af02672257 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:58.264804 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:58.286907 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276a9087-c783-49d9-bfb8-11aba1490e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:58.287516 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a9087-c783-49d9-bfb8-11aba1490e2d None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:58.287892 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a9087-c783-49d9-bfb8-11aba1490e2d None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:58.288164 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a9087-c783-49d9-bfb8-11aba1490e2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:58.357696 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276a9087-c783-49d9-bfb8-11aba1490e2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:58.359246 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276a9087-c783-49d9-bfb8-11aba1490e2d None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:58.461412 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 442/894] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 15 12:11:58 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 12:11:58.467262 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4b8bf0-c2a9-4a49-ba37-50a35f21b824 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:58.488269 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276a9087-c783-49d9-bfb8-11aba1490e2d None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:58.504855 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:58.590966 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4b8bf0-c2a9-4a49-ba37-50a35f21b824 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:58.599229 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276a9087-c783-49d9-bfb8-11aba1490e2d None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:58.613356 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:58.635983 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9304fe-10c7-4b74-9557-8d0260db1741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:58.636621 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9304fe-10c7-4b74-9557-8d0260db1741 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:58.636919 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9304fe-10c7-4b74-9557-8d0260db1741 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:58.637251 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9304fe-10c7-4b74-9557-8d0260db1741 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:58.641065 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb6d703-86ef-4341-a162-b4a4137ee0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:58.642275 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb6d703-86ef-4341-a162-b4a4137ee0f1 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:58.642835 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb6d703-86ef-4341-a162-b4a4137ee0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:58.643324 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb6d703-86ef-4341-a162-b4a4137ee0f1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:58.644127 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb6d703-86ef-4341-a162-b4a4137ee0f1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:58.645742 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb6d703-86ef-4341-a162-b4a4137ee0f1 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:58.648176 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9304fe-10c7-4b74-9557-8d0260db1741 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:58.649875 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9304fe-10c7-4b74-9557-8d0260db1741 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:58.656327 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-3eb6d703-86ef-4341-a162-b4a4137ee0f1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 12:11:58.656327 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:58.656327 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 12:11:58.656327 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 12:11:58.656327 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 12:11:58.656327 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 12:11:58.656327 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 12:11:58.656327 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:11:58.656327 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 12:11:58.656327 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:58.656327 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 12:11:58.656327 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:58.656327 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:58.656327 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:58.656327 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:58.656327 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:58.656327 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:58.657330 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:58.657330 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:58.657330 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:58.657330 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:58.657330 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:58.657330 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:58.657330 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 12:11:58.657330 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 12:11:58.657330 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 12:11:58.657330 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 12:11:58.657330 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:58.657330 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:58.657330 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:58.657330 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:58.657330 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:58.657330 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:58.658204 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:58.658204 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:58.658204 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:58.658204 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:58.658204 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:58.658204 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:58.658204 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:58.658204 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:58.658204 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:58.658204 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:58.658204 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 12:11:58.658204 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:11:58.658204 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 12:11:58.658204 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:58.664403 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 443/895] 10.222.0.16 () {56 vars in 1126 bytes} [Thu Sep 15 12:11:58 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:58.664403 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fdc9be-efc0-4964-a59b-d4aa2301d95e None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:58.664403 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fdc9be-efc0-4964-a59b-d4aa2301d95e None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:58.664403 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fdc9be-efc0-4964-a59b-d4aa2301d95e None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:58.664659 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-ea9304fe-10c7-4b74-9557-8d0260db1741 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:58.664659 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:58.664659 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:58.664659 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:58.664659 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:58.664659 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:58.664659 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:58.664659 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:58.664659 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:58.664659 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:58.664659 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:58.664659 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:58.664659 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:11:58.664659 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:11:58.664659 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:11:58.664659 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:11:58.665604 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:58.665604 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:58.665604 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:58.665604 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:58.665604 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:58.665604 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:58.665604 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:58.665604 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:58.665604 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:58.665604 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:58.665604 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:58.665604 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:58.665604 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:58.665604 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:58.665604 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:58.665604 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:58.665604 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:11:58.668167 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:11:58.668167 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:11:58.668167 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:11:58.668572 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 444/896] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:11:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:11:58.668572 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fdc9be-efc0-4964-a59b-d4aa2301d95e None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:58.670894 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 453/897] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:11:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:58.672095 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56026963-a179-4f79-926e-fe6acb3c35b6 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:58.672372 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56026963-a179-4f79-926e-fe6acb3c35b6 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:58.672644 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56026963-a179-4f79-926e-fe6acb3c35b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:58.690332 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-56026963-a179-4f79-926e-fe6acb3c35b6 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:11:58.691662 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-56026963-a179-4f79-926e-fe6acb3c35b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:11:58.752518 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:58.765048 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 454/898] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:11:58 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:11:58.765635 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56026963-a179-4f79-926e-fe6acb3c35b6 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:58.787878 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fdc9be-efc0-4964-a59b-d4aa2301d95e None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:58.825374 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f739cf-6a51-4cf9-87f4-039513034f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:58.825973 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f739cf-6a51-4cf9-87f4-039513034f3b None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:58.826305 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f739cf-6a51-4cf9-87f4-039513034f3b None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:58.827322 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f739cf-6a51-4cf9-87f4-039513034f3b None admin] PATH_INFO: `/v3/services` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:58.827951 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f739cf-6a51-4cf9-87f4-039513034f3b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:58.828253 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f739cf-6a51-4cf9-87f4-039513034f3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:58.829877 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f739cf-6a51-4cf9-87f4-039513034f3b None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:58.835029 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 445/899] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Sep 15 12:11:58 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:58.840433 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f739cf-6a51-4cf9-87f4-039513034f3b None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:58.886588 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:58.892286 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56026963-a179-4f79-926e-fe6acb3c35b6 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:58.941902 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52b9fcf-4078-4c6f-ac50-4bdcab6b737a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:58.943558 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b9fcf-4078-4c6f-ac50-4bdcab6b737a None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:58.944298 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b9fcf-4078-4c6f-ac50-4bdcab6b737a None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:58.944782 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b9fcf-4078-4c6f-ac50-4bdcab6b737a None admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:58.945940 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52b9fcf-4078-4c6f-ac50-4bdcab6b737a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:58.946866 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52b9fcf-4078-4c6f-ac50-4bdcab6b737a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:58.948754 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52b9fcf-4078-4c6f-ac50-4bdcab6b737a None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:58.949270 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f739cf-6a51-4cf9-87f4-039513034f3b None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:58.964753 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 455/900] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 15 12:11:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:58.972462 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52b9fcf-4078-4c6f-ac50-4bdcab6b737a None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:58.997567 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846ad715-a308-46b6-9737-b93d5e531b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:58.998277 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ad715-a308-46b6-9737-b93d5e531b55 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:58.998660 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ad715-a308-46b6-9737-b93d5e531b55 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:58.999058 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ad715-a308-46b6-9737-b93d5e531b55 None admin] PATH_INFO: `/v3/services` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:58.999772 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846ad715-a308-46b6-9737-b93d5e531b55 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:59.000141 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846ad715-a308-46b6-9737-b93d5e531b55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:59.001897 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846ad715-a308-46b6-9737-b93d5e531b55 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:59.011073 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 446/901] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Sep 15 12:11:58 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:59.034814 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846ad715-a308-46b6-9737-b93d5e531b55 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:59.046011 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:59.102208 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52b9fcf-4078-4c6f-ac50-4bdcab6b737a None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:59.139558 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9b0bdf-1703-4099-85e5-4331aa490379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:59.140205 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b0bdf-1703-4099-85e5-4331aa490379 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:59.140486 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b0bdf-1703-4099-85e5-4331aa490379 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:59.140752 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b0bdf-1703-4099-85e5-4331aa490379 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:59.148382 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9b0bdf-1703-4099-85e5-4331aa490379 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:59.149848 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9b0bdf-1703-4099-85e5-4331aa490379 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:59.163007 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-9b9b0bdf-1703-4099-85e5-4331aa490379 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:11:59.163007 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:59.163007 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:59.163007 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:59.163007 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:59.163007 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:59.163007 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:59.163007 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:59.163007 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:59.163007 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:59.163007 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:59.163007 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:59.163007 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 12:11:59.163007 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 12:11:59.163007 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 12:11:59.164011 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 12:11:59.164011 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:59.164011 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:59.164011 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:59.164011 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:59.164011 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:59.164011 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:59.164011 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:59.164011 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:59.164011 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:59.164011 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:59.164011 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:59.164011 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:59.164011 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:59.164011 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:59.164011 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:59.164011 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:59.164906 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 12:11:59.164906 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 12:11:59.164906 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 12:11:59.164906 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 12:11:59.164906 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 12:11:59.164906 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 12:11:59.164906 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:11:59.164906 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:11:59.169018 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 456/902] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 15 12:11:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:11:59.170644 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9b0bdf-1703-4099-85e5-4331aa490379 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:59.174198 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846ad715-a308-46b6-9737-b93d5e531b55 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:59.200826 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:59.215054 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7f1a27-2185-42ea-bc1d-bfeef3507d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:59.215807 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f1a27-2185-42ea-bc1d-bfeef3507d8a None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:59.216103 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f1a27-2185-42ea-bc1d-bfeef3507d8a None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:59.216387 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f1a27-2185-42ea-bc1d-bfeef3507d8a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:59.216948 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7f1a27-2185-42ea-bc1d-bfeef3507d8a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:59.218961 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7f1a27-2185-42ea-bc1d-bfeef3507d8a None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:59.230470 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-4d7f1a27-2185-42ea-bc1d-bfeef3507d8a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 15 12:11:59.230470 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:59.230470 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 12:11:59.230470 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 12:11:59.230470 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 12:11:59.230470 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 12:11:59.230470 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 12:11:59.230470 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:11:59.230470 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 15 12:11:59.230470 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:59.230470 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 12:11:59.230470 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:59.230470 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:11:59.230470 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:11:59.230470 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:11:59.230470 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:11:59.230470 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:11:59.231550 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:11:59.231550 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:11:59.231550 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:11:59.231550 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:11:59.231550 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:11:59.231550 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:11:59.231550 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 12:11:59.231550 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 12:11:59.231550 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 12:11:59.231550 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 12:11:59.231550 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:11:59.231550 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:11:59.231550 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:11:59.231550 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:11:59.231550 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:11:59.231550 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:11:59.232385 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:11:59.232385 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:11:59.232385 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:11:59.232385 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:11:59.232385 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:11:59.232385 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:11:59.232385 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:11:59.232385 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:11:59.232385 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:11:59.232385 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:11:59.232385 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 12:11:59.232385 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:11:59.232385 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 15 12:11:59.232385 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:11:59.234519 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 447/903] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Sep 15 12:11:59 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:11:59.240511 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7f1a27-2185-42ea-bc1d-bfeef3507d8a None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:59.296234 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9b0bdf-1703-4099-85e5-4331aa490379 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:59.333630 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49facc65-949e-41b4-8c68-2aa7ca076f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:59.334297 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:59.334466 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49facc65-949e-41b4-8c68-2aa7ca076f55 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:59.334882 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49facc65-949e-41b4-8c68-2aa7ca076f55 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:59.335245 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49facc65-949e-41b4-8c68-2aa7ca076f55 None admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:59.336275 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49facc65-949e-41b4-8c68-2aa7ca076f55 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:59.336792 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49facc65-949e-41b4-8c68-2aa7ca076f55 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:59.338441 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49facc65-949e-41b4-8c68-2aa7ca076f55 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:59.352916 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 457/904] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Sep 15 12:11:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:11:59.359074 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49facc65-949e-41b4-8c68-2aa7ca076f55 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:59.374628 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7f1a27-2185-42ea-bc1d-bfeef3507d8a None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:59.418727 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d12501c-7e90-452e-87c9-93440401398f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:59.418727 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d12501c-7e90-452e-87c9-93440401398f None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:59.418727 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d12501c-7e90-452e-87c9-93440401398f None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:59.418727 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d12501c-7e90-452e-87c9-93440401398f None admin] PATH_INFO: `/v3/services` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:59.419159 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d12501c-7e90-452e-87c9-93440401398f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:59.419159 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d12501c-7e90-452e-87c9-93440401398f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:59.419159 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d12501c-7e90-452e-87c9-93440401398f None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:59.424170 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 448/905] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Sep 15 12:11:59 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:11:59.429844 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d12501c-7e90-452e-87c9-93440401398f None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:59.471885 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:59.497584 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49facc65-949e-41b4-8c68-2aa7ca076f55 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:59.539894 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d12501c-7e90-452e-87c9-93440401398f None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:59.542988 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847d5431-c3be-4c29-909c-93d24225c102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:59.543607 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d5431-c3be-4c29-909c-93d24225c102 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:59.546223 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d5431-c3be-4c29-909c-93d24225c102 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:59.548219 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d5431-c3be-4c29-909c-93d24225c102 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:59.548849 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847d5431-c3be-4c29-909c-93d24225c102 None admin] RBAC: Adding query filter params (role.id=4ceb69a86bf04a2ebb1f56b197006b3c, scope.project.id=cab958c081ad4a92939d4469cf4ce1c6, user.id=b4614bede59c47ea813a73fcc0840a2d) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:59.549165 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847d5431-c3be-4c29-909c-93d24225c102 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:59.550584 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847d5431-c3be-4c29-909c-93d24225c102 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:59.566416 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 458/906] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 15 12:11:59 2022] GET /identity/v3/role_assignments?user.id=b4614bede59c47ea813a73fcc0840a2d&scope.project.id=cab958c081ad4a92939d4469cf4ce1c6&role.id=4ceb69a86bf04a2ebb1f56b197006b3c => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:59.589904 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62aa94f-9687-481c-95e1-de10d46dff18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:59.590530 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62aa94f-9687-481c-95e1-de10d46dff18 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:59.590837 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62aa94f-9687-481c-95e1-de10d46dff18 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:59.591106 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62aa94f-9687-481c-95e1-de10d46dff18 None admin] PATH_INFO: `/v3/services` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:59.591750 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62aa94f-9687-481c-95e1-de10d46dff18 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:59.592590 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62aa94f-9687-481c-95e1-de10d46dff18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:59.593992 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62aa94f-9687-481c-95e1-de10d46dff18 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:59.595513 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:59.601311 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 449/907] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Sep 15 12:11:59 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:11:59.607299 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847d5431-c3be-4c29-909c-93d24225c102 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:59.723819 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847d5431-c3be-4c29-909c-93d24225c102 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:59.775412 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d3aa8a-5a93-4eb0-9534-23836cb3a59c None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:59.776087 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d3aa8a-5a93-4eb0-9534-23836cb3a59c None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:59.776087 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d3aa8a-5a93-4eb0-9534-23836cb3a59c None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:59.777281 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 450/908] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:11:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:11:59.777768 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5998bde-deea-4b22-9f0d-7fec60aca825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:59.778390 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5998bde-deea-4b22-9f0d-7fec60aca825 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:59.778665 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5998bde-deea-4b22-9f0d-7fec60aca825 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:59.778964 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5998bde-deea-4b22-9f0d-7fec60aca825 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:59.779763 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5998bde-deea-4b22-9f0d-7fec60aca825 None admin] RBAC: Adding query filter params (interface=public, service_id=8488f8e9be52440c81ec5c9fc65723a1, region_id=RegionOne) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:11:59.780066 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5998bde-deea-4b22-9f0d-7fec60aca825 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:59.781506 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5998bde-deea-4b22-9f0d-7fec60aca825 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:59.783568 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93406ae-93e9-403d-ab6b-74709f081f08 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:59.783853 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93406ae-93e9-403d-ab6b-74709f081f08 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:59.784177 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93406ae-93e9-403d-ab6b-74709f081f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:59.789931 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 459/909] 10.222.0.16 () {56 vars in 1251 bytes} [Thu Sep 15 12:11:59 2022] GET /identity/v3/endpoints?service_id=8488f8e9be52440c81ec5c9fc65723a1&interface=public®ion_id=RegionOne => generated 194 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:11:59.796431 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5998bde-deea-4b22-9f0d-7fec60aca825 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:11:59.810204 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:11:59.810807 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-f93406ae-93e9-403d-ab6b-74709f081f08 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:11:59.813514 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-f93406ae-93e9-403d-ab6b-74709f081f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:11:59.898735 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 451/910] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:11:59 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 12:11:59.931010 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5998bde-deea-4b22-9f0d-7fec60aca825 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:11:59.968941 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee35343a-dc0b-4fe2-9396-0f593c62631c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:11:59.970349 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee35343a-dc0b-4fe2-9396-0f593c62631c None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:11:59.970349 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee35343a-dc0b-4fe2-9396-0f593c62631c None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:11:59.970620 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee35343a-dc0b-4fe2-9396-0f593c62631c None admin] PATH_INFO: `/v3/services` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:11:59.978748 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee35343a-dc0b-4fe2-9396-0f593c62631c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:11:59.978748 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee35343a-dc0b-4fe2-9396-0f593c62631c None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:11:59.982459 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 460/911] 10.222.0.16 () {56 vars in 1087 bytes} [Thu Sep 15 12:11:59 2022] GET /identity/v3/services => generated 1268 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 12:12:00.181005 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93406ae-93e9-403d-ab6b-74709f081f08 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:00.285578 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93406ae-93e9-403d-ab6b-74709f081f08 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:00.314273 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:00.323021 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e1ee43-98fd-44b4-8011-a6e1071e00d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:00.323666 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e1ee43-98fd-44b4-8011-a6e1071e00d6 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:00.323943 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e1ee43-98fd-44b4-8011-a6e1071e00d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:00.324214 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e1ee43-98fd-44b4-8011-a6e1071e00d6 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:00.324804 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e1ee43-98fd-44b4-8011-a6e1071e00d6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:00.326184 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e1ee43-98fd-44b4-8011-a6e1071e00d6 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:00.335926 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-e2e1ee43-98fd-44b4-8011-a6e1071e00d6 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 15 12:12:00.335926 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:12:00.335926 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 12:12:00.335926 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 12:12:00.335926 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 12:12:00.335926 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 12:12:00.335926 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 12:12:00.335926 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:12:00.335926 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 15 12:12:00.335926 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:12:00.335926 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 12:12:00.335926 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:12:00.335926 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:12:00.335926 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:12:00.335926 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:12:00.335926 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:12:00.336882 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:12:00.336882 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:12:00.336882 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:12:00.336882 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:12:00.336882 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:12:00.336882 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:12:00.336882 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:12:00.336882 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 12:12:00.336882 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 12:12:00.336882 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 12:12:00.336882 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 12:12:00.336882 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:12:00.336882 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:12:00.336882 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:12:00.336882 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:12:00.336882 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:12:00.336882 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:12:00.337764 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:12:00.337764 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:12:00.337764 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:12:00.337764 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:12:00.337764 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:12:00.337764 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:12:00.337764 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:12:00.337764 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:12:00.337764 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:12:00.337764 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:12:00.337764 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 12:12:00.337764 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:12:00.337764 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 15 12:12:00.337764 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:12:00.342613 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 452/912] 10.222.0.16 () {56 vars in 1132 bytes} [Thu Sep 15 12:12:00 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:12:00.347832 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee35343a-dc0b-4fe2-9396-0f593c62631c None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:00.420608 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:00.453345 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee35343a-dc0b-4fe2-9396-0f593c62631c None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:00.488824 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b0843c-64e9-4e1d-8aae-62e22f361028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:00.489753 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b0843c-64e9-4e1d-8aae-62e22f361028 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:00.490215 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b0843c-64e9-4e1d-8aae-62e22f361028 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:00.490668 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b0843c-64e9-4e1d-8aae-62e22f361028 None admin] PATH_INFO: `/v3/services` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:00.491505 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b0843c-64e9-4e1d-8aae-62e22f361028 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:12:00.492012 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b0843c-64e9-4e1d-8aae-62e22f361028 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:00.493545 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b0843c-64e9-4e1d-8aae-62e22f361028 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:00.499639 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 461/913] 10.222.0.16 () {56 vars in 1126 bytes} [Thu Sep 15 12:12:00 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:12:00.504708 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e1ee43-98fd-44b4-8011-a6e1071e00d6 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:00.609580 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e1ee43-98fd-44b4-8011-a6e1071e00d6 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:00.644700 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b034ac-2afd-4800-89d9-10d8a830c7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:00.645629 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b034ac-2afd-4800-89d9-10d8a830c7d5 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:00.646123 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b034ac-2afd-4800-89d9-10d8a830c7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:00.646587 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b034ac-2afd-4800-89d9-10d8a830c7d5 None admin] PATH_INFO: `/v3/services` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:00.647420 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b034ac-2afd-4800-89d9-10d8a830c7d5 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:12:00.647922 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b034ac-2afd-4800-89d9-10d8a830c7d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:00.649479 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b034ac-2afd-4800-89d9-10d8a830c7d5 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:00.655461 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 453/914] 10.222.0.16 () {56 vars in 1126 bytes} [Thu Sep 15 12:12:00 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:12:00.661490 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b0843c-64e9-4e1d-8aae-62e22f361028 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:00.766795 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b0843c-64e9-4e1d-8aae-62e22f361028 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:00.801612 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae724f9f-c679-4bc6-9d6e-16b20b066f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:00.802544 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae724f9f-c679-4bc6-9d6e-16b20b066f4a None admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:00.803076 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae724f9f-c679-4bc6-9d6e-16b20b066f4a None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:00.803539 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae724f9f-c679-4bc6-9d6e-16b20b066f4a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:00.804382 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae724f9f-c679-4bc6-9d6e-16b20b066f4a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:00.805928 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae724f9f-c679-4bc6-9d6e-16b20b066f4a None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:00.812159 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:00.833476 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 462/915] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:12:00 2022] POST /identity/v3/endpoints => generated 347 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:12:01.262814 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df43069-b18d-4aba-9f4b-a26547622b35 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:01.263345 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df43069-b18d-4aba-9f4b-a26547622b35 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:01.263345 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df43069-b18d-4aba-9f4b-a26547622b35 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:01.264981 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 454/916] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:12:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:12:01.270462 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6004cba-e3c8-436c-8d58-8b3e754f441d None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:01.270767 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6004cba-e3c8-436c-8d58-8b3e754f441d None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:01.271039 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6004cba-e3c8-436c-8d58-8b3e754f441d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:01.289490 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-d6004cba-e3c8-436c-8d58-8b3e754f441d None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:12:01.290711 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-d6004cba-e3c8-436c-8d58-8b3e754f441d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:12:01.368143 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 463/917] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:12:01 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:12:01.633063 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df43069-b18d-4aba-9f4b-a26547622b35 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:01.691751 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:01.741245 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df43069-b18d-4aba-9f4b-a26547622b35 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:01.781452 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f28d1b3-eaa7-423f-b8ab-dfa4892fc20e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:01.782066 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f28d1b3-eaa7-423f-b8ab-dfa4892fc20e None admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:01.782348 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f28d1b3-eaa7-423f-b8ab-dfa4892fc20e None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:01.782620 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f28d1b3-eaa7-423f-b8ab-dfa4892fc20e None admin] PATH_INFO: `/v3/services` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:01.783312 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f28d1b3-eaa7-423f-b8ab-dfa4892fc20e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:01.784675 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f28d1b3-eaa7-423f-b8ab-dfa4892fc20e None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:01.803395 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 455/918] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Sep 15 12:12:01 2022] POST /identity/v3/services => generated 241 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:12:01.877835 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d9e92-ec1a-4020-b653-d16e3b22a2d6 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:01.878470 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d9e92-ec1a-4020-b653-d16e3b22a2d6 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:01.878975 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d9e92-ec1a-4020-b653-d16e3b22a2d6 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:01.880898 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 464/919] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:12:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:12:01.886818 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d0a528-1d33-49c2-964f-1deee4c2f413 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:01.887417 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d0a528-1d33-49c2-964f-1deee4c2f413 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:01.887888 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d0a528-1d33-49c2-964f-1deee4c2f413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:01.908712 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-11d0a528-1d33-49c2-964f-1deee4c2f413 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:12:01.910345 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-11d0a528-1d33-49c2-964f-1deee4c2f413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:12:01.997888 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 456/920] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:12:01 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:12:02.271005 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38d9e92-ec1a-4020-b653-d16e3b22a2d6 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:02.339197 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a642d-0fd7-463c-8b5f-31d2c392a892 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:02.340150 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a642d-0fd7-463c-8b5f-31d2c392a892 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:02.340652 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a642d-0fd7-463c-8b5f-31d2c392a892 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:02.342539 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 457/921] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:12:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:12:02.347663 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba31919-2d04-4f01-a1d1-2b14cd925adb None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:02.348169 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba31919-2d04-4f01-a1d1-2b14cd925adb None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:02.348656 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba31919-2d04-4f01-a1d1-2b14cd925adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:02.367506 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-3ba31919-2d04-4f01-a1d1-2b14cd925adb None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:12:02.369105 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-3ba31919-2d04-4f01-a1d1-2b14cd925adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:12:02.378955 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38d9e92-ec1a-4020-b653-d16e3b22a2d6 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:02.400966 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:02.413917 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:02.429088 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe24962b-8f9c-4b66-96b1-d362df4f7860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:02.430053 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe24962b-8f9c-4b66-96b1-d362df4f7860 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:02.430538 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe24962b-8f9c-4b66-96b1-d362df4f7860 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:02.431284 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe24962b-8f9c-4b66-96b1-d362df4f7860 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:02.445273 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe24962b-8f9c-4b66-96b1-d362df4f7860 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:12:02.450727 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 458/922] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:12:02 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 12:12:02.456723 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-fe24962b-8f9c-4b66-96b1-d362df4f7860 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 15 12:12:02.456723 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:12:02.456723 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:12:02.456723 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:12:02.456723 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:12:02.456723 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:12:02.456723 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:12:02.456723 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:12:02.456723 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:12:02.456723 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:12:02.456723 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:12:02.456723 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:12:02.456723 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:12:02.456723 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:12:02.456723 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:12:02.456723 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:12:02.457635 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:12:02.457635 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:12:02.457635 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:12:02.457635 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:12:02.457635 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:12:02.457635 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:12:02.457635 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:12:02.457635 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:12:02.457635 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:12:02.457635 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:12:02.457635 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:12:02.457635 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:12:02.457635 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:12:02.457635 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:12:02.457635 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:12:02.457635 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:12:02.458532 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:12:02.458532 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:12:02.458532 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:12:02.458532 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:12:02.458532 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:12:02.458532 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:12:02.458532 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:12:02.458532 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:12:02.458532 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:12:02.458532 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:12:02.458532 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 15 12:12:02.458532 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:12:02.460916 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 465/923] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Sep 15 12:12:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:12:02.470820 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba31919-2d04-4f01-a1d1-2b14cd925adb None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:02.581647 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba31919-2d04-4f01-a1d1-2b14cd925adb None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:02.620022 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae00e86-effe-4d50-bd50-272a55730d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:02.620880 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae00e86-effe-4d50-bd50-272a55730d91 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:02.621309 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae00e86-effe-4d50-bd50-272a55730d91 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:02.621732 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae00e86-effe-4d50-bd50-272a55730d91 None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:02.622630 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae00e86-effe-4d50-bd50-272a55730d91 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:12:02.623101 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae00e86-effe-4d50-bd50-272a55730d91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:02.625166 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae00e86-effe-4d50-bd50-272a55730d91 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:02.634407 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 459/924] 10.222.0.16 () {56 vars in 1115 bytes} [Thu Sep 15 12:12:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:12:02.640063 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe24962b-8f9c-4b66-96b1-d362df4f7860 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:02.745943 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe24962b-8f9c-4b66-96b1-d362df4f7860 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:02.783825 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c5eaf8-e536-4514-a87a-d11f01e6d700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:02.784457 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5eaf8-e536-4514-a87a-d11f01e6d700 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:02.784731 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5eaf8-e536-4514-a87a-d11f01e6d700 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:02.785000 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5eaf8-e536-4514-a87a-d11f01e6d700 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:02.790153 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae00e86-effe-4d50-bd50-272a55730d91 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:02.797379 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c5eaf8-e536-4514-a87a-d11f01e6d700 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:02.798853 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c5eaf8-e536-4514-a87a-d11f01e6d700 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:02.817793 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-e5c5eaf8-e536-4514-a87a-d11f01e6d700 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:12:02.817793 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:12:02.817793 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:12:02.817793 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:12:02.817793 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:12:02.817793 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:12:02.817793 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:12:02.817793 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:12:02.817793 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:12:02.817793 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:12:02.817793 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:12:02.817793 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:12:02.817793 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:12:02.817793 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:12:02.817793 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:12:02.817793 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:12:02.818831 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:12:02.818831 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:12:02.818831 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:12:02.818831 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:12:02.818831 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:12:02.818831 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:12:02.818831 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:12:02.818831 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:12:02.818831 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:12:02.818831 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:12:02.818831 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:12:02.818831 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:12:02.818831 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:12:02.818831 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:12:02.818831 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:12:02.818831 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:12:02.818831 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:12:02.823689 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:12:02.823689 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:12:02.823689 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:12:02.823689 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 466/925] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:12:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:12:02.826159 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c5eaf8-e536-4514-a87a-d11f01e6d700 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:02.832613 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:02.860857 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:02.932009 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae00e86-effe-4d50-bd50-272a55730d91 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:02.949669 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c5eaf8-e536-4514-a87a-d11f01e6d700 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:02.989098 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72462b58-3a92-4772-8f85-b8c762f4506a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:02.990120 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72462b58-3a92-4772-8f85-b8c762f4506a None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:02.990397 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72462b58-3a92-4772-8f85-b8c762f4506a None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:02.990667 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72462b58-3a92-4772-8f85-b8c762f4506a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:02.991558 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72462b58-3a92-4772-8f85-b8c762f4506a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:02.993115 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72462b58-3a92-4772-8f85-b8c762f4506a None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:02.995900 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa499a6-d452-4ec1-aed3-90b96153433c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:02.996629 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa499a6-d452-4ec1-aed3-90b96153433c None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:02.997008 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa499a6-d452-4ec1-aed3-90b96153433c None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:02.997385 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa499a6-d452-4ec1-aed3-90b96153433c None admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:02.998147 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa499a6-d452-4ec1-aed3-90b96153433c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:12:02.998552 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa499a6-d452-4ec1-aed3-90b96153433c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:03.000021 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa499a6-d452-4ec1-aed3-90b96153433c None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:03.004273 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-72462b58-3a92-4772-8f85-b8c762f4506a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 15 12:12:03.004273 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:12:03.004273 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 12:12:03.004273 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 12:12:03.004273 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 12:12:03.004273 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 12:12:03.004273 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 12:12:03.004273 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:12:03.004273 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 15 12:12:03.004273 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:12:03.004273 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 12:12:03.004273 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:12:03.004273 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:12:03.004273 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:12:03.004273 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:12:03.004273 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:12:03.004273 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:12:03.005443 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:12:03.005443 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:12:03.005443 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:12:03.005443 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:12:03.005443 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:12:03.005443 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:12:03.005443 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 12:12:03.005443 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 12:12:03.005443 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 12:12:03.005443 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 12:12:03.005443 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:12:03.005443 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:12:03.005443 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:12:03.005443 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:12:03.005443 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:12:03.005443 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:12:03.006433 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:12:03.006433 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:12:03.006433 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:12:03.006433 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:12:03.006433 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:12:03.006433 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:12:03.006433 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:12:03.006433 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:12:03.006433 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:12:03.006433 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:12:03.006433 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 12:12:03.006433 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:12:03.006433 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 15 12:12:03.006433 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:12:03.008770 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 460/926] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Sep 15 12:12:02 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:12:03.015929 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72462b58-3a92-4772-8f85-b8c762f4506a None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:03.025371 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 467/927] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 15 12:12:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:12:03.026964 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa499a6-d452-4ec1-aed3-90b96153433c None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:03.124287 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:03.127931 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:03.132453 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72462b58-3a92-4772-8f85-b8c762f4506a None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:03.135928 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa499a6-d452-4ec1-aed3-90b96153433c None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:03.169549 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb83b85-70f8-4a93-9107-6d8ecc7bd16e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:03.170797 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb83b85-70f8-4a93-9107-6d8ecc7bd16e None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:03.171079 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb83b85-70f8-4a93-9107-6d8ecc7bd16e None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:03.171248 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8672d525-d517-4263-95b2-b76d59b76108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:03.171368 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb83b85-70f8-4a93-9107-6d8ecc7bd16e None admin] PATH_INFO: `/v3/services` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:03.171976 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb83b85-70f8-4a93-9107-6d8ecc7bd16e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:12:03.172112 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672d525-d517-4263-95b2-b76d59b76108 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:03.172280 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb83b85-70f8-4a93-9107-6d8ecc7bd16e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:03.172566 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672d525-d517-4263-95b2-b76d59b76108 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:03.172930 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672d525-d517-4263-95b2-b76d59b76108 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:03.173651 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb83b85-70f8-4a93-9107-6d8ecc7bd16e None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:03.182990 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 461/928] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Sep 15 12:12:03 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:12:03.182990 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a6a7d-85d1-4e60-b945-d8f3c9b848b9 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:03.182990 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a6a7d-85d1-4e60-b945-d8f3c9b848b9 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:03.182990 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a6a7d-85d1-4e60-b945-d8f3c9b848b9 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:03.182990 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 462/929] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:12:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:12:03.184559 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8672d525-d517-4263-95b2-b76d59b76108 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:03.186287 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8672d525-d517-4263-95b2-b76d59b76108 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:03.187053 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0a6a7d-85d1-4e60-b945-d8f3c9b848b9 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:03.199083 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-8672d525-d517-4263-95b2-b76d59b76108 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 15 12:12:03.199083 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:12:03.199083 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:12:03.199083 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:12:03.199083 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:12:03.199083 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:12:03.199083 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:12:03.199083 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:12:03.199083 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:12:03.199083 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:12:03.199083 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:12:03.199083 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:12:03.199083 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 12:12:03.199083 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 12:12:03.199083 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 12:12:03.199083 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 12:12:03.200254 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:12:03.200254 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:12:03.200254 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 12:12:03.200254 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:12:03.200254 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 12:12:03.200254 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:12:03.200254 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:12:03.200254 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:12:03.200254 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:12:03.200254 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:12:03.200254 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:12:03.200254 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:12:03.200254 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:12:03.200254 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:12:03.200254 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:12:03.200254 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:12:03.200254 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:12:03.200254 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:12:03.201257 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:12:03.201257 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:12:03.201257 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 12:12:03.201257 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 12:12:03.201257 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 12:12:03.201257 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 12:12:03.201257 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 12:12:03.201257 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 12:12:03.201257 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 15 12:12:03.201257 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:12:03.202617 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 468/930] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Sep 15 12:12:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:12:03.204775 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097400e-2126-410d-b3ce-b5245b33da1d None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:03.205521 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097400e-2126-410d-b3ce-b5245b33da1d None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:03.205968 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097400e-2126-410d-b3ce-b5245b33da1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:03.231096 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-a097400e-2126-410d-b3ce-b5245b33da1d None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:12:03.233131 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-a097400e-2126-410d-b3ce-b5245b33da1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:12:03.300134 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0a6a7d-85d1-4e60-b945-d8f3c9b848b9 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:03.314724 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 469/931] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:12:03 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:12:03.314724 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a097400e-2126-410d-b3ce-b5245b33da1d None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:03.351019 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c22a9c2-a859-4aab-94e1-e4d31c56eb5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:03.351629 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c22a9c2-a859-4aab-94e1-e4d31c56eb5b None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:03.351912 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c22a9c2-a859-4aab-94e1-e4d31c56eb5b None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:03.352185 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c22a9c2-a859-4aab-94e1-e4d31c56eb5b None admin] PATH_INFO: `/v3/services` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:03.352808 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c22a9c2-a859-4aab-94e1-e4d31c56eb5b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:12:03.353115 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c22a9c2-a859-4aab-94e1-e4d31c56eb5b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:03.355376 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c22a9c2-a859-4aab-94e1-e4d31c56eb5b None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:03.364876 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 463/932] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Sep 15 12:12:03 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:12:03.365808 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c22a9c2-a859-4aab-94e1-e4d31c56eb5b None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:03.404022 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:03.409717 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:03.429488 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a097400e-2126-410d-b3ce-b5245b33da1d None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:03.464054 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf83638-7157-4374-85c2-96c8faa196f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:03.464663 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf83638-7157-4374-85c2-96c8faa196f6 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:03.464940 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf83638-7157-4374-85c2-96c8faa196f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:03.465212 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf83638-7157-4374-85c2-96c8faa196f6 None admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:03.466175 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf83638-7157-4374-85c2-96c8faa196f6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:12:03.466298 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf83638-7157-4374-85c2-96c8faa196f6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:03.468337 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf83638-7157-4374-85c2-96c8faa196f6 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:03.486168 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 470/933] 10.222.0.16 () {56 vars in 1149 bytes} [Thu Sep 15 12:12:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:12:03.491772 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf83638-7157-4374-85c2-96c8faa196f6 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:03.494881 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c22a9c2-a859-4aab-94e1-e4d31c56eb5b None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:03.549769 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a7e8fd-ec49-49fc-a40e-8528fb7f1b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:03.551304 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a7e8fd-ec49-49fc-a40e-8528fb7f1b42 None admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:03.551587 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a7e8fd-ec49-49fc-a40e-8528fb7f1b42 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:03.551862 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a7e8fd-ec49-49fc-a40e-8528fb7f1b42 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:03.552537 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a7e8fd-ec49-49fc-a40e-8528fb7f1b42 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:03.553928 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a7e8fd-ec49-49fc-a40e-8528fb7f1b42 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:03.586768 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 464/934] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:12:03 2022] POST /identity/v3/endpoints => generated 346 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:12:03.608542 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a7e8fd-ec49-49fc-a40e-8528fb7f1b42 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:03.635466 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf83638-7157-4374-85c2-96c8faa196f6 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:03.683473 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9710bfb9-e4d8-44a5-a4f7-77e8083073cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:03.684567 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9710bfb9-e4d8-44a5-a4f7-77e8083073cc None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:03.685091 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9710bfb9-e4d8-44a5-a4f7-77e8083073cc None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:03.685558 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9710bfb9-e4d8-44a5-a4f7-77e8083073cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:03.688806 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:03.700262 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9710bfb9-e4d8-44a5-a4f7-77e8083073cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:03.702320 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9710bfb9-e4d8-44a5-a4f7-77e8083073cc None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:03.720225 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-9710bfb9-e4d8-44a5-a4f7-77e8083073cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:12:03.720225 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:12:03.720225 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:12:03.720225 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:12:03.720225 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:12:03.720225 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:12:03.720225 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:12:03.720225 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:12:03.720225 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:12:03.720225 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:12:03.720225 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:12:03.720225 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:12:03.720225 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:12:03.720225 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:12:03.720225 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:12:03.720225 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:12:03.721291 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:12:03.721291 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:12:03.721291 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:12:03.721291 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:12:03.721291 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:12:03.721291 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:12:03.721291 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:12:03.721291 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:12:03.721291 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:12:03.721291 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:12:03.721291 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:12:03.721291 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:12:03.721291 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:12:03.721291 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:12:03.721291 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:12:03.721291 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:12:03.721291 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:12:03.722168 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:12:03.722168 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:12:03.722168 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:12:03.723986 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:03.725967 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 471/935] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:12:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:12:03.732099 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9710bfb9-e4d8-44a5-a4f7-77e8083073cc None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:03.748873 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a7e8fd-ec49-49fc-a40e-8528fb7f1b42 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:03.789265 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855975a7-526f-403e-bfab-d8e210c28737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:03.790289 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855975a7-526f-403e-bfab-d8e210c28737 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:03.790806 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855975a7-526f-403e-bfab-d8e210c28737 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:03.791280 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855975a7-526f-403e-bfab-d8e210c28737 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:03.792052 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855975a7-526f-403e-bfab-d8e210c28737 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:03.793580 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855975a7-526f-403e-bfab-d8e210c28737 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:03.803375 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-855975a7-526f-403e-bfab-d8e210c28737 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 15 12:12:03.803375 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:12:03.803375 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 12:12:03.803375 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 12:12:03.803375 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 12:12:03.803375 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 12:12:03.803375 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 12:12:03.803375 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:12:03.803375 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 15 12:12:03.803375 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:12:03.803375 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 12:12:03.803375 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:12:03.803375 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:12:03.803375 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:12:03.803375 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:12:03.803375 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:12:03.803375 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:12:03.804390 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:12:03.804390 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:12:03.804390 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:12:03.804390 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:12:03.804390 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:12:03.804390 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:12:03.804390 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 12:12:03.804390 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 12:12:03.804390 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 12:12:03.804390 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 12:12:03.804390 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:12:03.804390 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:12:03.804390 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:12:03.804390 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:12:03.804390 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:12:03.804390 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:12:03.805237 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:12:03.805237 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:12:03.805237 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:12:03.805237 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:12:03.805237 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:12:03.805237 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:12:03.805237 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:12:03.805237 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:12:03.805237 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:12:03.805237 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:12:03.805237 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 12:12:03.805237 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:12:03.805237 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 15 12:12:03.805237 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:12:03.805237 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 465/936] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 15 12:12:03 2022] GET /identity/v3/services/compute => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:12:03.811037 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855975a7-526f-403e-bfab-d8e210c28737 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:03.862515 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9710bfb9-e4d8-44a5-a4f7-77e8083073cc None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:03.909240 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80859302-7f32-49aa-9950-0883e698adbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:03.910327 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80859302-7f32-49aa-9950-0883e698adbb None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:03.910927 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80859302-7f32-49aa-9950-0883e698adbb None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:03.911393 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80859302-7f32-49aa-9950-0883e698adbb None admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:03.912230 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80859302-7f32-49aa-9950-0883e698adbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:12:03.912724 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80859302-7f32-49aa-9950-0883e698adbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:03.915051 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80859302-7f32-49aa-9950-0883e698adbb None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:03.930860 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 472/937] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 15 12:12:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:12:03.935927 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855975a7-526f-403e-bfab-d8e210c28737 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:03.936968 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80859302-7f32-49aa-9950-0883e698adbb None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:03.988319 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc82c9c7-df67-40de-9d5b-172212b3e929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:03.989336 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82c9c7-df67-40de-9d5b-172212b3e929 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:03.989989 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82c9c7-df67-40de-9d5b-172212b3e929 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:03.990501 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82c9c7-df67-40de-9d5b-172212b3e929 None admin] PATH_INFO: `/v3/services` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:03.991473 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc82c9c7-df67-40de-9d5b-172212b3e929 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:12:03.992018 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc82c9c7-df67-40de-9d5b-172212b3e929 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:03.993853 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:03.994819 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc82c9c7-df67-40de-9d5b-172212b3e929 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:04.001879 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 466/938] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Sep 15 12:12:03 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:12:04.007443 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc82c9c7-df67-40de-9d5b-172212b3e929 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:04.021839 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:04.052650 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80859302-7f32-49aa-9950-0883e698adbb None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:04.087850 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38fb767-ec1f-4b6c-abd6-ff3f879bc18d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:04.088512 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38fb767-ec1f-4b6c-abd6-ff3f879bc18d None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:04.088789 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38fb767-ec1f-4b6c-abd6-ff3f879bc18d None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:04.089056 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38fb767-ec1f-4b6c-abd6-ff3f879bc18d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:04.096544 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38fb767-ec1f-4b6c-abd6-ff3f879bc18d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:04.097979 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38fb767-ec1f-4b6c-abd6-ff3f879bc18d None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:04.109466 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-c38fb767-ec1f-4b6c-abd6-ff3f879bc18d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:12:04.109466 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:12:04.109466 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:12:04.109466 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:12:04.109466 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:12:04.109466 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:12:04.109466 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:12:04.109466 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:12:04.109466 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:12:04.109466 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:12:04.109466 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:12:04.109466 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:12:04.109466 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 12:12:04.109466 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 12:12:04.109466 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 12:12:04.110428 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 12:12:04.110428 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:12:04.110428 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:12:04.110428 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:12:04.110428 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:12:04.110428 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:12:04.110428 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:12:04.110428 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:12:04.110428 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:12:04.110428 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:12:04.110428 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:12:04.110428 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:12:04.110428 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:12:04.110428 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:12:04.110428 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:12:04.110428 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:12:04.110428 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:12:04.111367 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 12:12:04.111367 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 12:12:04.111367 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 12:12:04.111367 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 12:12:04.111367 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 12:12:04.111367 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 12:12:04.111367 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:12:04.111367 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:12:04.114801 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 473/939] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 15 12:12:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:12:04.116327 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c2de9-81f0-4b63-a14b-4c4d554dbf09 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:04.116615 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c2de9-81f0-4b63-a14b-4c4d554dbf09 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:04.116891 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c2de9-81f0-4b63-a14b-4c4d554dbf09 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:04.118186 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 474/940] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:12:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:12:04.118903 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3c2de9-81f0-4b63-a14b-4c4d554dbf09 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:04.125794 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc82c9c7-df67-40de-9d5b-172212b3e929 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:04.161074 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4702579a-1e72-4725-b51d-d7738da21d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:04.162046 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702579a-1e72-4725-b51d-d7738da21d35 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:04.162524 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702579a-1e72-4725-b51d-d7738da21d35 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:04.162890 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702579a-1e72-4725-b51d-d7738da21d35 None admin] PATH_INFO: `/v3/services` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:04.163572 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4702579a-1e72-4725-b51d-d7738da21d35 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:12:04.163940 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4702579a-1e72-4725-b51d-d7738da21d35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:04.165362 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4702579a-1e72-4725-b51d-d7738da21d35 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:04.179078 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 467/941] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Sep 15 12:12:04 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:12:04.180436 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd57cb-2a39-4967-b84e-e1baa61b7cdf None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:04.180787 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd57cb-2a39-4967-b84e-e1baa61b7cdf None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:04.181119 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd57cb-2a39-4967-b84e-e1baa61b7cdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:04.209098 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-adcd57cb-2a39-4967-b84e-e1baa61b7cdf None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:12:04.210378 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-adcd57cb-2a39-4967-b84e-e1baa61b7cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:12:04.252257 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3c2de9-81f0-4b63-a14b-4c4d554dbf09 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:04.262200 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:04.291423 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 468/942] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:12:04 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:12:04.301224 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539d1105-0228-4887-a9df-5aebd705d7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:04.302124 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539d1105-0228-4887-a9df-5aebd705d7eb None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:04.302558 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539d1105-0228-4887-a9df-5aebd705d7eb None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:04.303070 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539d1105-0228-4887-a9df-5aebd705d7eb None admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:04.303969 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539d1105-0228-4887-a9df-5aebd705d7eb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:12:04.304418 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539d1105-0228-4887-a9df-5aebd705d7eb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:04.306026 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539d1105-0228-4887-a9df-5aebd705d7eb None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:04.325119 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 475/943] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Sep 15 12:12:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:12:04.327321 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcd57cb-2a39-4967-b84e-e1baa61b7cdf None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:04.331788 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:04.432363 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcd57cb-2a39-4967-b84e-e1baa61b7cdf None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:04.468681 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65006506-e5b3-4175-93f5-cdf2de61224b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:04.469271 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65006506-e5b3-4175-93f5-cdf2de61224b None admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:04.469548 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65006506-e5b3-4175-93f5-cdf2de61224b None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:04.469821 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65006506-e5b3-4175-93f5-cdf2de61224b None admin] PATH_INFO: `/v3/projects/cab958c081ad4a92939d4469cf4ce1c6/users/b4614bede59c47ea813a73fcc0840a2d/roles/4ceb69a86bf04a2ebb1f56b197006b3c` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:04.472025 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65006506-e5b3-4175-93f5-cdf2de61224b None admin] RBAC: Authorizing `identity:create_grant(project_id=cab958c081ad4a92939d4469cf4ce1c6, user_id=b4614bede59c47ea813a73fcc0840a2d, role_id=4ceb69a86bf04a2ebb1f56b197006b3c)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:04.473456 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65006506-e5b3-4175-93f5-cdf2de61224b None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:04.494875 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 469/944] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Sep 15 12:12:04 2022] PUT /identity/v3/projects/cab958c081ad4a92939d4469cf4ce1c6/users/b4614bede59c47ea813a73fcc0840a2d/roles/4ceb69a86bf04a2ebb1f56b197006b3c => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:12:04.566261 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539d1105-0228-4887-a9df-5aebd705d7eb None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:04.681900 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539d1105-0228-4887-a9df-5aebd705d7eb None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:04.720104 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa86db4-386b-4692-a445-5d8cd3ae4c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:04.721106 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa86db4-386b-4692-a445-5d8cd3ae4c0e None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:04.721586 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa86db4-386b-4692-a445-5d8cd3ae4c0e None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:04.722057 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa86db4-386b-4692-a445-5d8cd3ae4c0e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:04.722866 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa86db4-386b-4692-a445-5d8cd3ae4c0e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:04.724530 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa86db4-386b-4692-a445-5d8cd3ae4c0e None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:04.733876 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-8fa86db4-386b-4692-a445-5d8cd3ae4c0e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 12:12:04.733876 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:12:04.733876 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 12:12:04.733876 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 12:12:04.733876 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 12:12:04.733876 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 12:12:04.733876 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 12:12:04.733876 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:12:04.733876 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 12:12:04.733876 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:12:04.733876 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 12:12:04.733876 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:12:04.733876 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:12:04.733876 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:12:04.733876 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:12:04.733876 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:12:04.733876 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:12:04.734881 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:12:04.734881 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:12:04.734881 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:12:04.734881 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:12:04.734881 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:12:04.734881 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:12:04.734881 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 12:12:04.734881 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 12:12:04.734881 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 12:12:04.734881 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 12:12:04.734881 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:12:04.734881 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:12:04.734881 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:12:04.734881 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:12:04.734881 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:12:04.734881 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:12:04.735896 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:12:04.735896 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:12:04.735896 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:12:04.735896 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:12:04.735896 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:12:04.735896 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:12:04.735896 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:12:04.735896 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:12:04.735896 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:12:04.735896 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:12:04.735896 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 12:12:04.735896 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:12:04.735896 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 12:12:04.735896 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:12:04.737258 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 476/945] 10.222.0.16 () {56 vars in 1126 bytes} [Thu Sep 15 12:12:04 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:12:04.743516 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65006506-e5b3-4175-93f5-cdf2de61224b None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:04.811527 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:04.851685 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65006506-e5b3-4175-93f5-cdf2de61224b None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:04.887886 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e14c377-9a9d-450d-bc4e-534d190ffbaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:04.888498 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e14c377-9a9d-450d-bc4e-534d190ffbaa None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:04.888810 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e14c377-9a9d-450d-bc4e-534d190ffbaa None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:04.889088 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e14c377-9a9d-450d-bc4e-534d190ffbaa None admin] PATH_INFO: `/v3/services` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:04.889716 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e14c377-9a9d-450d-bc4e-534d190ffbaa None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:12:04.890074 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e14c377-9a9d-450d-bc4e-534d190ffbaa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:04.891489 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e14c377-9a9d-450d-bc4e-534d190ffbaa None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:04.896805 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 470/946] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Sep 15 12:12:04 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:12:04.902575 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa86db4-386b-4692-a445-5d8cd3ae4c0e None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:04.940178 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:05.020567 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa86db4-386b-4692-a445-5d8cd3ae4c0e None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:05.056461 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e75281f-33a1-4620-805d-f9c7ca361b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:05.057061 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e75281f-33a1-4620-805d-f9c7ca361b6e None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:05.057452 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e75281f-33a1-4620-805d-f9c7ca361b6e None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:05.057615 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e75281f-33a1-4620-805d-f9c7ca361b6e None admin] PATH_INFO: `/v3/services` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:05.058230 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e75281f-33a1-4620-805d-f9c7ca361b6e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:12:05.058531 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e75281f-33a1-4620-805d-f9c7ca361b6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:05.059927 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e75281f-33a1-4620-805d-f9c7ca361b6e None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:05.066106 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 477/947] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Sep 15 12:12:04 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:12:05.071631 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e14c377-9a9d-450d-bc4e-534d190ffbaa None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:05.180468 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e14c377-9a9d-450d-bc4e-534d190ffbaa None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:05.207350 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:05.215289 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abc61cd-3c8a-4dc4-a111-ad32f9bc6746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:05.216264 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc61cd-3c8a-4dc4-a111-ad32f9bc6746 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:05.216541 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc61cd-3c8a-4dc4-a111-ad32f9bc6746 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:05.217564 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc61cd-3c8a-4dc4-a111-ad32f9bc6746 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:05.218616 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abc61cd-3c8a-4dc4-a111-ad32f9bc6746 None admin] RBAC: Adding query filter params (interface=public, service_id=00dd83bd385949d2b44de4a6612aa50d, region_id=RegionOne) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:12:05.218947 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abc61cd-3c8a-4dc4-a111-ad32f9bc6746 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:05.220301 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abc61cd-3c8a-4dc4-a111-ad32f9bc6746 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:05.225480 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 471/948] 10.222.0.16 () {56 vars in 1251 bytes} [Thu Sep 15 12:12:05 2022] GET /identity/v3/endpoints?service_id=00dd83bd385949d2b44de4a6612aa50d&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:12:05.231301 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e75281f-33a1-4620-805d-f9c7ca361b6e None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:05.335200 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e75281f-33a1-4620-805d-f9c7ca361b6e None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:05.339145 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:05.373371 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9ff65b-b4b4-4772-b60e-05759b21b1c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:05.373984 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ff65b-b4b4-4772-b60e-05759b21b1c7 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:05.374262 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ff65b-b4b4-4772-b60e-05759b21b1c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:05.374528 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ff65b-b4b4-4772-b60e-05759b21b1c7 None admin] PATH_INFO: `/v3/services` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:05.375152 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9ff65b-b4b4-4772-b60e-05759b21b1c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:05.376997 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9ff65b-b4b4-4772-b60e-05759b21b1c7 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:05.383393 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 478/949] 10.222.0.16 () {56 vars in 1087 bytes} [Thu Sep 15 12:12:05 2022] GET /identity/v3/services => generated 1497 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:12:05.876870 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c9702b-8dcb-4ee7-a49d-87b87c24d0e7 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:05.877661 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c9702b-8dcb-4ee7-a49d-87b87c24d0e7 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:05.877661 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c9702b-8dcb-4ee7-a49d-87b87c24d0e7 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:05.878957 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 472/950] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:12:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:12:05.884940 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaff759-2cb9-420b-91dd-2c72da09fb52 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:05.885408 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaff759-2cb9-420b-91dd-2c72da09fb52 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:05.885495 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaff759-2cb9-420b-91dd-2c72da09fb52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:05.907073 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-faaff759-2cb9-420b-91dd-2c72da09fb52 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:12:05.908705 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-faaff759-2cb9-420b-91dd-2c72da09fb52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:12:05.983657 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 479/951] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:12:05 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:12:06.251023 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c9702b-8dcb-4ee7-a49d-87b87c24d0e7 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:06.356880 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c9702b-8dcb-4ee7-a49d-87b87c24d0e7 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:06.393552 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea5f705-6a5e-4d3a-87f5-37c22d2e59a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:06.394173 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea5f705-6a5e-4d3a-87f5-37c22d2e59a6 None admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:06.394448 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea5f705-6a5e-4d3a-87f5-37c22d2e59a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:06.394739 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea5f705-6a5e-4d3a-87f5-37c22d2e59a6 None admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:06.395410 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea5f705-6a5e-4d3a-87f5-37c22d2e59a6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:06.396981 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea5f705-6a5e-4d3a-87f5-37c22d2e59a6 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:06.399843 dv-cinder-850836-7-smb devstack@keystone.service[81375]: WARNING keystone.server.flask.common [None req-6ea5f705-6a5e-4d3a-87f5-37c22d2e59a6 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 15 12:12:06.421378 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.sql.core [None req-6ea5f705-6a5e-4d3a-87f5-37c22d2e59a6 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 15 12:12:06.421378 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 15 12:12:06.421378 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [parameters: {'id': '00ef102740c6424eb5b76bfbc48eca37', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 15 12:12:06.421378 dv-cinder-850836-7-smb devstack@keystone.service[81375]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81375) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 15 12:12:06.429192 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-6ea5f705-6a5e-4d3a-87f5-37c22d2e59a6 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 00ef102740c6424eb5b76bfbc48eca37.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 00ef102740c6424eb5b76bfbc48eca37. Sep 15 12:12:06.429192 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:12:06.429192 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 15 12:12:06.429192 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 15 12:12:06.429192 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 15 12:12:06.429192 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 15 12:12:06.429192 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 15 12:12:06.429192 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application result = self._query(query) Sep 15 12:12:06.429192 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 15 12:12:06.429192 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application conn.query(q) Sep 15 12:12:06.429192 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 15 12:12:06.429192 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 15 12:12:06.429192 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 15 12:12:06.429992 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application result.read() Sep 15 12:12:06.429992 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 15 12:12:06.429992 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 15 12:12:06.429992 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 15 12:12:06.429992 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 15 12:12:06.429992 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 15 12:12:06.429992 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 15 12:12:06.429992 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 15 12:12:06.429992 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 15 12:12:06.429992 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 15 12:12:06.429992 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:12:06.429992 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 15 12:12:06.429992 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:12:06.429992 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:12:06.429992 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 15 12:12:06.429992 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 15 12:12:06.429992 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 15 12:12:06.429992 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 15 12:12:06.430980 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 15 12:12:06.430980 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application next(self.gen) Sep 15 12:12:06.430980 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 15 12:12:06.430980 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application yield resource Sep 15 12:12:06.430980 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 15 12:12:06.430980 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application next(self.gen) Sep 15 12:12:06.430980 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 15 12:12:06.430980 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application self.session.rollback() Sep 15 12:12:06.430980 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 15 12:12:06.430980 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application self.force_reraise() Sep 15 12:12:06.430980 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 15 12:12:06.430980 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise self.value Sep 15 12:12:06.430980 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 15 12:12:06.430980 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 15 12:12:06.430980 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 15 12:12:06.430980 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application session.commit() Sep 15 12:12:06.430980 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 15 12:12:06.431869 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 15 12:12:06.431869 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 15 12:12:06.431869 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application self._prepare_impl() Sep 15 12:12:06.431869 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 15 12:12:06.431869 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application self.session.flush() Sep 15 12:12:06.431869 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 15 12:12:06.431869 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application self._flush(objects) Sep 15 12:12:06.431869 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 15 12:12:06.431869 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 15 12:12:06.431869 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 15 12:12:06.431869 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application compat.raise_( Sep 15 12:12:06.431869 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 15 12:12:06.431869 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception Sep 15 12:12:06.431869 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 15 12:12:06.431869 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application flush_context.execute() Sep 15 12:12:06.431869 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 15 12:12:06.431869 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rec.execute(self) Sep 15 12:12:06.432764 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 15 12:12:06.432764 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 15 12:12:06.432764 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 15 12:12:06.432764 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 15 12:12:06.432764 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 15 12:12:06.432764 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 15 12:12:06.432764 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 15 12:12:06.432764 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 15 12:12:06.432764 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 15 12:12:06.432764 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 15 12:12:06.432764 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 15 12:12:06.432764 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 15 12:12:06.432764 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 15 12:12:06.432764 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 15 12:12:06.432764 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 15 12:12:06.433539 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 15 12:12:06.433539 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 15 12:12:06.433539 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception Sep 15 12:12:06.433539 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 15 12:12:06.433539 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 15 12:12:06.433539 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 15 12:12:06.433539 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 15 12:12:06.433539 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 15 12:12:06.433539 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application result = self._query(query) Sep 15 12:12:06.433539 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 15 12:12:06.433539 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application conn.query(q) Sep 15 12:12:06.433539 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 15 12:12:06.433539 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 15 12:12:06.433539 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 15 12:12:06.433539 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application result.read() Sep 15 12:12:06.433539 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 15 12:12:06.433539 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 15 12:12:06.434395 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 15 12:12:06.434395 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 15 12:12:06.434395 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 15 12:12:06.434395 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 15 12:12:06.434395 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 15 12:12:06.434395 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 15 12:12:06.434395 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 15 12:12:06.434395 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 15 12:12:06.434395 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [parameters: {'id': '00ef102740c6424eb5b76bfbc48eca37', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 15 12:12:06.434395 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 15 12:12:06.434395 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:12:06.434395 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 12:12:06.434395 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:12:06.434395 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:12:06.434395 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 15 12:12:06.436812 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 15 12:12:06.436812 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 15 12:12:06.436812 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 15 12:12:06.436812 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 15 12:12:06.436812 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:12:06.436812 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 12:12:06.436812 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:12:06.436812 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:12:06.436812 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:12:06.436812 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:12:06.436812 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:12:06.436812 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:12:06.436812 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:12:06.436812 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:12:06.436812 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:12:06.436812 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:12:06.436812 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:12:06.438956 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:12:06.438956 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 15 12:12:06.438956 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 15 12:12:06.438956 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:12:06.438956 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:12:06.438956 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 15 12:12:06.438956 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 15 12:12:06.438956 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 00ef102740c6424eb5b76bfbc48eca37. Sep 15 12:12:06.438956 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:12:06.438956 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 473/952] 10.222.0.16 () {60 vars in 1140 bytes} [Thu Sep 15 12:12:06 2022] POST /identity/v3/projects => generated 262 bytes in 180 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:12:06.440164 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaff759-2cb9-420b-91dd-2c72da09fb52 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:06.523650 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2bb6c0-42b9-4533-b99a-4270eb8136c1 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:06.524043 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2bb6c0-42b9-4533-b99a-4270eb8136c1 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:06.524451 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2bb6c0-42b9-4533-b99a-4270eb8136c1 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:06.524571 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:06.534287 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 474/953] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:12:06 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 12:12:06.535703 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e9207-f058-4d11-b2fb-a5a6014338ab None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:06.536116 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e9207-f058-4d11-b2fb-a5a6014338ab None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:06.536488 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e9207-f058-4d11-b2fb-a5a6014338ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:06.538123 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaff759-2cb9-420b-91dd-2c72da09fb52 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:06.555726 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-345e9207-f058-4d11-b2fb-a5a6014338ab None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:12:06.557505 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-345e9207-f058-4d11-b2fb-a5a6014338ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:12:06.576700 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9758973-655e-44b1-9abf-258f2225fae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:06.577434 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9758973-655e-44b1-9abf-258f2225fae3 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:06.577717 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9758973-655e-44b1-9abf-258f2225fae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:06.577986 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9758973-655e-44b1-9abf-258f2225fae3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:06.585217 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9758973-655e-44b1-9abf-258f2225fae3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:06.586799 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9758973-655e-44b1-9abf-258f2225fae3 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:06.599288 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-f9758973-655e-44b1-9abf-258f2225fae3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:12:06.599288 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:12:06.599288 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:12:06.599288 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:12:06.599288 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:12:06.599288 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:12:06.599288 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:12:06.599288 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:12:06.599288 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:12:06.599288 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:12:06.599288 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:12:06.599288 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:12:06.599288 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 12:12:06.599288 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 12:12:06.599288 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 12:12:06.601301 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 12:12:06.601301 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:12:06.601301 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:12:06.601301 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:12:06.601301 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:12:06.601301 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:12:06.601301 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:12:06.601301 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:12:06.601301 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:12:06.601301 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:12:06.601301 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:12:06.601301 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:12:06.601301 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:12:06.601301 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:12:06.601301 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:12:06.601301 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:12:06.601301 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:12:06.603406 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 12:12:06.603406 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 12:12:06.603406 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 12:12:06.603406 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 12:12:06.603406 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 12:12:06.603406 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 12:12:06.603406 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:12:06.603406 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:12:06.603406 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 480/954] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 15 12:12:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:12:06.607156 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9758973-655e-44b1-9abf-258f2225fae3 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:06.610096 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:06.642819 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 475/955] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:12:06 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:12:06.722969 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9758973-655e-44b1-9abf-258f2225fae3 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:06.760044 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db503e4-81c6-4b0a-bcca-c183fd7c0474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:06.760960 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db503e4-81c6-4b0a-bcca-c183fd7c0474 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:06.761382 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db503e4-81c6-4b0a-bcca-c183fd7c0474 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:06.761808 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db503e4-81c6-4b0a-bcca-c183fd7c0474 None admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:06.762607 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db503e4-81c6-4b0a-bcca-c183fd7c0474 None admin] RBAC: Adding query filter params (name=service) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:12:06.763071 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db503e4-81c6-4b0a-bcca-c183fd7c0474 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:06.764750 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db503e4-81c6-4b0a-bcca-c183fd7c0474 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:06.786172 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 481/956] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Sep 15 12:12:06 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:12:06.831951 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e09378d-2d8a-42f0-8ae3-d960a5cd7bed None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:06.832578 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e09378d-2d8a-42f0-8ae3-d960a5cd7bed None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:06.833055 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e09378d-2d8a-42f0-8ae3-d960a5cd7bed None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:06.834954 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 476/957] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:12:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:12:06.840305 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c5f6ff-7ea5-468a-81f2-55ec6f94b61b None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:06.840972 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c5f6ff-7ea5-468a-81f2-55ec6f94b61b None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:06.841489 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c5f6ff-7ea5-468a-81f2-55ec6f94b61b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:06.862330 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-51c5f6ff-7ea5-468a-81f2-55ec6f94b61b None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:12:06.863936 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-51c5f6ff-7ea5-468a-81f2-55ec6f94b61b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:12:06.866537 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:06.945174 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 482/958] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:12:06 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:12:06.948557 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e09378d-2d8a-42f0-8ae3-d960a5cd7bed None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:07.072428 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e09378d-2d8a-42f0-8ae3-d960a5cd7bed None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:07.109866 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34865fe-e15f-486a-80d0-1eddced49802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:07.110855 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34865fe-e15f-486a-80d0-1eddced49802 None admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:07.111341 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34865fe-e15f-486a-80d0-1eddced49802 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:07.111813 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34865fe-e15f-486a-80d0-1eddced49802 None admin] PATH_INFO: `/v3/services` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:07.112674 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34865fe-e15f-486a-80d0-1eddced49802 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:07.114486 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34865fe-e15f-486a-80d0-1eddced49802 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:07.133350 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 477/959] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Sep 15 12:12:06 2022] POST /identity/v3/services => generated 242 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:12:07.238716 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c5f6ff-7ea5-468a-81f2-55ec6f94b61b None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:07.346837 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c5f6ff-7ea5-468a-81f2-55ec6f94b61b None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:07.389475 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9652a71-2ea4-4a00-b051-a9d0e739dbbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:07.390104 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9652a71-2ea4-4a00-b051-a9d0e739dbbb None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:07.390373 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9652a71-2ea4-4a00-b051-a9d0e739dbbb None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:07.390633 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9652a71-2ea4-4a00-b051-a9d0e739dbbb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:07.392565 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:07.402089 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9652a71-2ea4-4a00-b051-a9d0e739dbbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:12:07.407520 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-d9652a71-2ea4-4a00-b051-a9d0e739dbbb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 15 12:12:07.407520 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:12:07.407520 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:12:07.407520 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:12:07.407520 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:12:07.407520 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:12:07.407520 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:12:07.407520 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:12:07.407520 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:12:07.407520 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:12:07.407520 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:12:07.407520 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:12:07.407520 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:12:07.407520 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:12:07.407520 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:12:07.407520 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:12:07.408640 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:12:07.408640 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:12:07.408640 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:12:07.408640 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:12:07.408640 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:12:07.408640 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:12:07.408640 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:12:07.408640 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:12:07.408640 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:12:07.408640 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:12:07.408640 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:12:07.408640 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:12:07.408640 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:12:07.408640 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:12:07.408640 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:12:07.408640 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:12:07.409855 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:12:07.409855 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:12:07.409855 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:12:07.409855 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:12:07.409855 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:12:07.409855 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:12:07.409855 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:12:07.409855 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:12:07.409855 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:12:07.409855 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:12:07.409855 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 15 12:12:07.409855 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:12:07.409855 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 483/960] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Sep 15 12:12:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:12:07.416742 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34865fe-e15f-486a-80d0-1eddced49802 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:07.458920 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:07.525291 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34865fe-e15f-486a-80d0-1eddced49802 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:07.565392 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c88c094-3dec-4354-8a40-cd6bcaad699b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:07.566457 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88c094-3dec-4354-8a40-cd6bcaad699b None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:07.566973 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88c094-3dec-4354-8a40-cd6bcaad699b None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:07.567522 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88c094-3dec-4354-8a40-cd6bcaad699b None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:07.568476 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c88c094-3dec-4354-8a40-cd6bcaad699b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:12:07.569001 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c88c094-3dec-4354-8a40-cd6bcaad699b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:07.570622 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c88c094-3dec-4354-8a40-cd6bcaad699b None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:07.585465 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 478/961] 10.222.0.16 () {56 vars in 1115 bytes} [Thu Sep 15 12:12:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:12:07.588047 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9652a71-2ea4-4a00-b051-a9d0e739dbbb None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:07.675979 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e372626a-e11e-4b6d-970b-f257963e0217 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:07.676188 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e372626a-e11e-4b6d-970b-f257963e0217 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:07.676441 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e372626a-e11e-4b6d-970b-f257963e0217 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:07.678012 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 479/962] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:12:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 12:12:07.683058 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6364b292-5c4a-4bd4-bd1e-32b43686dda5 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:07.683364 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6364b292-5c4a-4bd4-bd1e-32b43686dda5 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:07.683668 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6364b292-5c4a-4bd4-bd1e-32b43686dda5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:07.695486 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9652a71-2ea4-4a00-b051-a9d0e739dbbb None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:07.703431 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-6364b292-5c4a-4bd4-bd1e-32b43686dda5 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:12:07.704749 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-6364b292-5c4a-4bd4-bd1e-32b43686dda5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:12:07.745329 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581b82b2-3591-45ed-93eb-8b6843220367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:07.746282 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b82b2-3591-45ed-93eb-8b6843220367 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:07.746572 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b82b2-3591-45ed-93eb-8b6843220367 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:07.746886 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b82b2-3591-45ed-93eb-8b6843220367 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:07.760561 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581b82b2-3591-45ed-93eb-8b6843220367 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:07.762546 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581b82b2-3591-45ed-93eb-8b6843220367 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:07.783470 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-581b82b2-3591-45ed-93eb-8b6843220367 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:12:07.783470 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:12:07.783470 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:12:07.783470 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:12:07.783470 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:12:07.783470 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:12:07.783470 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:12:07.783470 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:12:07.783470 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:12:07.783470 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:12:07.783470 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:12:07.783470 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:12:07.783470 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:12:07.783470 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:12:07.783470 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:12:07.783470 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:12:07.784458 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:12:07.784458 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:12:07.784458 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:12:07.784458 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:12:07.784458 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:12:07.784458 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:12:07.784458 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:12:07.784458 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:12:07.784458 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:12:07.784458 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:12:07.784458 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:12:07.784458 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:12:07.784458 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:12:07.784458 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:12:07.784458 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:12:07.784458 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:12:07.784458 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:12:07.790648 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:12:07.790648 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:12:07.790648 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:12:07.790648 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 484/963] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:12:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:12:07.790947 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 480/964] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:12:07 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:12:07.792353 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581b82b2-3591-45ed-93eb-8b6843220367 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:07.847612 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:07.906542 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581b82b2-3591-45ed-93eb-8b6843220367 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:07.942994 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34462898-81f4-42c2-9b50-246ea87e916f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:07.943600 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34462898-81f4-42c2-9b50-246ea87e916f None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:07.943879 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34462898-81f4-42c2-9b50-246ea87e916f None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:07.944150 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34462898-81f4-42c2-9b50-246ea87e916f None admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:07.944788 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34462898-81f4-42c2-9b50-246ea87e916f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:12:07.945086 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34462898-81f4-42c2-9b50-246ea87e916f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:07.946436 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34462898-81f4-42c2-9b50-246ea87e916f None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:07.962876 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 485/965] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 15 12:12:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:12:07.964607 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6364b292-5c4a-4bd4-bd1e-32b43686dda5 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:08.010014 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:08.067193 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34462898-81f4-42c2-9b50-246ea87e916f None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:08.088284 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6364b292-5c4a-4bd4-bd1e-32b43686dda5 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:08.136546 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce10b7f0-1566-4277-91ae-302695003bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:08.137191 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce10b7f0-1566-4277-91ae-302695003bbd None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:08.137469 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce10b7f0-1566-4277-91ae-302695003bbd None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:08.137738 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce10b7f0-1566-4277-91ae-302695003bbd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:08.147424 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce10b7f0-1566-4277-91ae-302695003bbd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:08.149431 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce10b7f0-1566-4277-91ae-302695003bbd None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:08.165077 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-ce10b7f0-1566-4277-91ae-302695003bbd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 15 12:12:08.165077 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:12:08.165077 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:12:08.165077 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:12:08.165077 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:12:08.165077 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:12:08.165077 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:12:08.165077 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:12:08.165077 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:12:08.165077 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:12:08.165077 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:12:08.165077 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:12:08.165077 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 12:12:08.165077 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 12:12:08.165077 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 12:12:08.165077 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 12:12:08.166031 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:12:08.166031 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:12:08.166031 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 12:12:08.166031 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:12:08.166031 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 12:12:08.166031 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:12:08.166031 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:12:08.166031 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:12:08.166031 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:12:08.166031 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:12:08.166031 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:12:08.166031 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:12:08.166031 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:12:08.166031 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:12:08.166031 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:12:08.166031 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:12:08.166031 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:12:08.166031 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:12:08.167010 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:12:08.167010 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:12:08.167010 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 12:12:08.167010 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 12:12:08.167010 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 12:12:08.167010 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 12:12:08.167010 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 12:12:08.167010 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 12:12:08.167010 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 15 12:12:08.167010 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:12:08.167010 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 481/966] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Sep 15 12:12:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:12:08.172959 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce10b7f0-1566-4277-91ae-302695003bbd None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:08.180143 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34462898-81f4-42c2-9b50-246ea87e916f None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:08.188488 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:08.225290 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b485382-d397-478f-98f2-c922975cf8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:08.226140 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b485382-d397-478f-98f2-c922975cf8e9 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:08.226424 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b485382-d397-478f-98f2-c922975cf8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:08.226718 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b485382-d397-478f-98f2-c922975cf8e9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:08.227505 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b485382-d397-478f-98f2-c922975cf8e9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:08.229556 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b485382-d397-478f-98f2-c922975cf8e9 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:08.242675 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-2b485382-d397-478f-98f2-c922975cf8e9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 12:12:08.242675 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:12:08.242675 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 12:12:08.242675 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 12:12:08.242675 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 12:12:08.242675 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 12:12:08.242675 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 12:12:08.242675 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:12:08.242675 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 12:12:08.242675 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:12:08.242675 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 12:12:08.242675 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:12:08.242675 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:12:08.242675 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:12:08.242675 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:12:08.242675 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:12:08.242675 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:12:08.243813 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:12:08.243813 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:12:08.243813 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:12:08.243813 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:12:08.243813 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:12:08.243813 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:12:08.243813 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 12:12:08.243813 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 12:12:08.243813 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 12:12:08.243813 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 12:12:08.243813 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:12:08.243813 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:12:08.243813 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:12:08.243813 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:12:08.243813 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:12:08.243813 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:12:08.244654 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:12:08.244654 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:12:08.244654 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:12:08.244654 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:12:08.244654 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:12:08.244654 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:12:08.244654 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:12:08.244654 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:12:08.244654 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:12:08.244654 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:12:08.244654 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 12:12:08.244654 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:12:08.244654 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 12:12:08.244654 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:12:08.244654 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 486/967] 10.222.0.16 () {56 vars in 1126 bytes} [Thu Sep 15 12:12:08 2022] GET /identity/v3/services/object-store => generated 93 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:12:08.251315 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b485382-d397-478f-98f2-c922975cf8e9 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:08.280925 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:08.293000 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce10b7f0-1566-4277-91ae-302695003bbd None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:08.333576 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bf19cc-dab6-4945-bbac-a06d375df010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:08.334988 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf19cc-dab6-4945-bbac-a06d375df010 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:08.335790 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf19cc-dab6-4945-bbac-a06d375df010 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:08.336369 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf19cc-dab6-4945-bbac-a06d375df010 None admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:08.337548 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bf19cc-dab6-4945-bbac-a06d375df010 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:12:08.338529 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bf19cc-dab6-4945-bbac-a06d375df010 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:08.340698 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bf19cc-dab6-4945-bbac-a06d375df010 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:08.357341 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b485382-d397-478f-98f2-c922975cf8e9 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:08.365850 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 482/968] 10.222.0.16 () {56 vars in 1149 bytes} [Thu Sep 15 12:12:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:12:08.372446 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bf19cc-dab6-4945-bbac-a06d375df010 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:08.397524 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8894e8c-f635-42a0-9ffa-b2e69016acd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:08.398125 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8894e8c-f635-42a0-9ffa-b2e69016acd4 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:08.398401 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8894e8c-f635-42a0-9ffa-b2e69016acd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:08.398670 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8894e8c-f635-42a0-9ffa-b2e69016acd4 None admin] PATH_INFO: `/v3/services` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:08.399318 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8894e8c-f635-42a0-9ffa-b2e69016acd4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:12:08.399616 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8894e8c-f635-42a0-9ffa-b2e69016acd4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:08.400963 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8894e8c-f635-42a0-9ffa-b2e69016acd4 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:08.410949 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 487/969] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Sep 15 12:12:08 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:12:08.412290 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8894e8c-f635-42a0-9ffa-b2e69016acd4 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:08.458580 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:08.496762 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bf19cc-dab6-4945-bbac-a06d375df010 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:08.531628 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9494c962-cd4b-4283-bc3b-406f8324a322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:08.532381 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9494c962-cd4b-4283-bc3b-406f8324a322 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:08.532510 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9494c962-cd4b-4283-bc3b-406f8324a322 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:08.532750 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9494c962-cd4b-4283-bc3b-406f8324a322 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:08.551381 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:08.553992 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8894e8c-f635-42a0-9ffa-b2e69016acd4 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:08.600220 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98270af-969a-4a9b-8c15-8c054e58124b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:08.601683 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98270af-969a-4a9b-8c15-8c054e58124b None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:08.602345 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98270af-969a-4a9b-8c15-8c054e58124b None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:08.602889 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98270af-969a-4a9b-8c15-8c054e58124b None admin] PATH_INFO: `/v3/services` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:08.603514 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9494c962-cd4b-4283-bc3b-406f8324a322 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:08.603851 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98270af-969a-4a9b-8c15-8c054e58124b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:12:08.604308 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98270af-969a-4a9b-8c15-8c054e58124b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:08.605237 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9494c962-cd4b-4283-bc3b-406f8324a322 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:08.605962 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98270af-969a-4a9b-8c15-8c054e58124b None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:08.612768 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 488/970] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Sep 15 12:12:08 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:12:08.618055 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98270af-969a-4a9b-8c15-8c054e58124b None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:08.716622 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 483/971] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 15 12:12:08 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 15 12:12:08.718323 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9494c962-cd4b-4283-bc3b-406f8324a322 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:08.754148 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:08.758957 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98270af-969a-4a9b-8c15-8c054e58124b None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:08.768361 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:08.806793 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e7f5ae-15eb-4b23-8c44-29a9b195d4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:08.807923 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e7f5ae-15eb-4b23-8c44-29a9b195d4fe None admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:08.808385 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e7f5ae-15eb-4b23-8c44-29a9b195d4fe None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:08.809093 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e7f5ae-15eb-4b23-8c44-29a9b195d4fe None admin] PATH_INFO: `/v3/endpoints` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:08.809973 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e7f5ae-15eb-4b23-8c44-29a9b195d4fe None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:08.811594 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e7f5ae-15eb-4b23-8c44-29a9b195d4fe None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:08.824500 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9494c962-cd4b-4283-bc3b-406f8324a322 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:08.838902 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 489/972] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:12:08 2022] POST /identity/v3/endpoints => generated 349 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:12:08.883000 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dc156a-9bdc-49c2-a7da-2f405227ae8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:08.884036 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc156a-9bdc-49c2-a7da-2f405227ae8d None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:08.884498 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc156a-9bdc-49c2-a7da-2f405227ae8d None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:08.884942 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc156a-9bdc-49c2-a7da-2f405227ae8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:08.897991 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dc156a-9bdc-49c2-a7da-2f405227ae8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:08.899814 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dc156a-9bdc-49c2-a7da-2f405227ae8d None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:08.919626 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-93dc156a-9bdc-49c2-a7da-2f405227ae8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:12:08.919626 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:12:08.919626 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:12:08.919626 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:12:08.919626 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:12:08.919626 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:12:08.919626 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:12:08.919626 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:12:08.919626 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:12:08.919626 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:12:08.919626 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:12:08.919626 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:12:08.919626 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:12:08.919626 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:12:08.919626 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:12:08.919626 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:12:08.920720 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:12:08.920720 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:12:08.920720 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:12:08.920720 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:12:08.920720 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:12:08.920720 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:12:08.920720 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:12:08.920720 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:12:08.920720 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:12:08.920720 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:12:08.920720 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:12:08.920720 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:12:08.920720 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:12:08.920720 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:12:08.920720 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:12:08.920720 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:12:08.920720 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:12:08.921641 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:12:08.921641 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:12:08.921641 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:12:08.923686 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 484/973] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:12:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:12:08.929622 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e7f5ae-15eb-4b23-8c44-29a9b195d4fe None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:09.052668 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e7f5ae-15eb-4b23-8c44-29a9b195d4fe None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:09.093673 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b007354b-8005-4eb3-baa9-a00dcfa25cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:09.094301 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b007354b-8005-4eb3-baa9-a00dcfa25cc9 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:09.094576 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b007354b-8005-4eb3-baa9-a00dcfa25cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:09.094883 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b007354b-8005-4eb3-baa9-a00dcfa25cc9 None admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:09.095546 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b007354b-8005-4eb3-baa9-a00dcfa25cc9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:12:09.095847 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b007354b-8005-4eb3-baa9-a00dcfa25cc9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:09.097265 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b007354b-8005-4eb3-baa9-a00dcfa25cc9 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:09.111379 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 490/974] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 15 12:12:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:12:09.117042 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dc156a-9bdc-49c2-a7da-2f405227ae8d None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:09.203845 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4e726-fde1-4729-a854-655e273a7137 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:09.204470 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4e726-fde1-4729-a854-655e273a7137 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:09.204936 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4e726-fde1-4729-a854-655e273a7137 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:09.206469 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 491/975] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:12:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 12:12:09.211924 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34023eb8-31f9-464d-b36a-8c23e1803cda None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:09.212204 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34023eb8-31f9-464d-b36a-8c23e1803cda None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:09.212480 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34023eb8-31f9-464d-b36a-8c23e1803cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:09.223602 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:09.231172 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dc156a-9bdc-49c2-a7da-2f405227ae8d None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:09.235900 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-34023eb8-31f9-464d-b36a-8c23e1803cda None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:12:09.237711 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-34023eb8-31f9-464d-b36a-8c23e1803cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:12:09.254834 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:09.274549 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1ff66a-9bff-4bc5-9040-531709035bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:09.275540 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ff66a-9bff-4bc5-9040-531709035bc8 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:09.275970 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ff66a-9bff-4bc5-9040-531709035bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:09.276408 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ff66a-9bff-4bc5-9040-531709035bc8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:09.284622 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1ff66a-9bff-4bc5-9040-531709035bc8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:09.286494 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1ff66a-9bff-4bc5-9040-531709035bc8 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:09.299292 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-4b1ff66a-9bff-4bc5-9040-531709035bc8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:12:09.299292 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:12:09.299292 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:12:09.299292 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:12:09.299292 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:12:09.299292 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:12:09.299292 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:12:09.299292 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:12:09.299292 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:12:09.299292 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:12:09.299292 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:12:09.299292 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:12:09.299292 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 12:12:09.299292 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 12:12:09.299292 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 12:12:09.300389 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 12:12:09.300389 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:12:09.300389 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:12:09.300389 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:12:09.300389 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:12:09.300389 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:12:09.300389 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:12:09.300389 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:12:09.300389 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:12:09.300389 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:12:09.300389 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:12:09.300389 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:12:09.300389 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:12:09.300389 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:12:09.300389 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:12:09.300389 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:12:09.300389 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:12:09.301471 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 12:12:09.301471 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 12:12:09.301471 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 12:12:09.301471 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 12:12:09.301471 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 12:12:09.301471 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 12:12:09.301471 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:12:09.301471 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:12:09.306785 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 485/976] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 15 12:12:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:12:09.309471 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1ff66a-9bff-4bc5-9040-531709035bc8 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:09.326776 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 492/977] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:12:09 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 12:12:09.376926 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d227db51-4136-48a1-aaeb-417cf4a87199 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:09.377273 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d227db51-4136-48a1-aaeb-417cf4a87199 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:09.377473 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d227db51-4136-48a1-aaeb-417cf4a87199 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:09.379094 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 493/978] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:12:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 12:12:09.388340 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1762d93-de68-4786-9ca4-fe6ec699eecf None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:09.388651 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1762d93-de68-4786-9ca4-fe6ec699eecf None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:09.388923 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1762d93-de68-4786-9ca4-fe6ec699eecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:09.412796 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-e1762d93-de68-4786-9ca4-fe6ec699eecf None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:12:09.414381 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-e1762d93-de68-4786-9ca4-fe6ec699eecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:12:09.429504 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1ff66a-9bff-4bc5-9040-531709035bc8 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:09.464945 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf793b4-cdbb-4af3-b0e5-0ae9f14c051e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:09.465586 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf793b4-cdbb-4af3-b0e5-0ae9f14c051e None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:09.465867 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf793b4-cdbb-4af3-b0e5-0ae9f14c051e None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:09.466138 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf793b4-cdbb-4af3-b0e5-0ae9f14c051e None admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:09.466908 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf793b4-cdbb-4af3-b0e5-0ae9f14c051e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:12:09.467217 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf793b4-cdbb-4af3-b0e5-0ae9f14c051e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:09.468650 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf793b4-cdbb-4af3-b0e5-0ae9f14c051e None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:09.481630 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 486/979] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Sep 15 12:12:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:12:09.488428 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf793b4-cdbb-4af3-b0e5-0ae9f14c051e None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:09.509809 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:09.510926 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 494/980] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:12:09 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 12:12:09.597163 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf793b4-cdbb-4af3-b0e5-0ae9f14c051e None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:09.613062 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1762d93-de68-4786-9ca4-fe6ec699eecf None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:09.637519 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faac8bc-7839-4eb3-899e-bb72dc269942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:09.638197 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faac8bc-7839-4eb3-899e-bb72dc269942 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:09.638481 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faac8bc-7839-4eb3-899e-bb72dc269942 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:09.638815 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faac8bc-7839-4eb3-899e-bb72dc269942 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:09.639551 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faac8bc-7839-4eb3-899e-bb72dc269942 None admin] RBAC: Adding query filter params (role.id=4ceb69a86bf04a2ebb1f56b197006b3c, scope.project.id=cab958c081ad4a92939d4469cf4ce1c6, user.id=b4614bede59c47ea813a73fcc0840a2d) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:12:09.639859 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faac8bc-7839-4eb3-899e-bb72dc269942 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:09.641304 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faac8bc-7839-4eb3-899e-bb72dc269942 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:09.650738 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 487/981] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 15 12:12:09 2022] GET /identity/v3/role_assignments?user.id=b4614bede59c47ea813a73fcc0840a2d&scope.project.id=cab958c081ad4a92939d4469cf4ce1c6&role.id=4ceb69a86bf04a2ebb1f56b197006b3c => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:12:09.710622 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:09.740860 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1762d93-de68-4786-9ca4-fe6ec699eecf None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:09.778736 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512aaffa-76a2-4053-88bf-274fe895b0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:09.780204 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512aaffa-76a2-4053-88bf-274fe895b0d7 None admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:09.780656 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512aaffa-76a2-4053-88bf-274fe895b0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:09.781068 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512aaffa-76a2-4053-88bf-274fe895b0d7 None admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:09.781872 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512aaffa-76a2-4053-88bf-274fe895b0d7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:09.783502 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512aaffa-76a2-4053-88bf-274fe895b0d7 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:09.786493 dv-cinder-850836-7-smb devstack@keystone.service[81374]: WARNING keystone.server.flask.common [None req-512aaffa-76a2-4053-88bf-274fe895b0d7 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 15 12:12:09.791202 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faac8bc-7839-4eb3-899e-bb72dc269942 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:09.802320 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.sql.core [None req-512aaffa-76a2-4053-88bf-274fe895b0d7 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 15 12:12:09.802320 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 15 12:12:09.802320 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [parameters: {'user_id': 'e47bbc09fe244af996c58c774eeb863f', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 15 12:12:09.802320 dv-cinder-850836-7-smb devstack@keystone.service[81374]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81374) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 15 12:12:09.819957 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-512aaffa-76a2-4053-88bf-274fe895b0d7 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 15 12:12:09.819957 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:12:09.819957 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 15 12:12:09.819957 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 15 12:12:09.819957 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 15 12:12:09.819957 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 15 12:12:09.819957 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 15 12:12:09.819957 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application result = self._query(query) Sep 15 12:12:09.819957 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 15 12:12:09.819957 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application conn.query(q) Sep 15 12:12:09.819957 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 15 12:12:09.819957 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 15 12:12:09.819957 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 15 12:12:09.819957 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application result.read() Sep 15 12:12:09.819957 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 15 12:12:09.821093 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 15 12:12:09.821093 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 15 12:12:09.821093 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 15 12:12:09.821093 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 15 12:12:09.821093 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 15 12:12:09.821093 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 15 12:12:09.821093 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 15 12:12:09.821093 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 15 12:12:09.821093 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:12:09.821093 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 15 12:12:09.821093 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:12:09.821093 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:12:09.821093 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 15 12:12:09.821093 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 15 12:12:09.821093 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 15 12:12:09.821093 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 15 12:12:09.821093 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 15 12:12:09.821093 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application next(self.gen) Sep 15 12:12:09.822343 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 15 12:12:09.822343 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application yield resource Sep 15 12:12:09.822343 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 15 12:12:09.822343 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application next(self.gen) Sep 15 12:12:09.822343 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 15 12:12:09.822343 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application self.session.rollback() Sep 15 12:12:09.822343 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 15 12:12:09.822343 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application self.force_reraise() Sep 15 12:12:09.822343 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 15 12:12:09.822343 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise self.value Sep 15 12:12:09.822343 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 15 12:12:09.822343 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 15 12:12:09.822343 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 15 12:12:09.822343 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application session.commit() Sep 15 12:12:09.822343 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 15 12:12:09.822343 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 15 12:12:09.822343 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 15 12:12:09.823465 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application self._prepare_impl() Sep 15 12:12:09.823465 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 15 12:12:09.823465 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application self.session.flush() Sep 15 12:12:09.823465 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 15 12:12:09.823465 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application self._flush(objects) Sep 15 12:12:09.823465 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 15 12:12:09.823465 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 15 12:12:09.823465 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 15 12:12:09.823465 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application compat.raise_( Sep 15 12:12:09.823465 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 15 12:12:09.823465 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception Sep 15 12:12:09.823465 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 15 12:12:09.823465 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application flush_context.execute() Sep 15 12:12:09.823465 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 15 12:12:09.823465 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rec.execute(self) Sep 15 12:12:09.823465 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 15 12:12:09.823465 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 15 12:12:09.824543 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 15 12:12:09.824543 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 15 12:12:09.824543 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 15 12:12:09.824543 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 15 12:12:09.824543 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 15 12:12:09.824543 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 15 12:12:09.824543 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 15 12:12:09.824543 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 15 12:12:09.824543 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 15 12:12:09.824543 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 15 12:12:09.824543 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 15 12:12:09.824543 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 15 12:12:09.824543 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 15 12:12:09.824543 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 15 12:12:09.824543 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 15 12:12:09.824543 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception Sep 15 12:12:09.825586 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 15 12:12:09.825586 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 15 12:12:09.825586 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 15 12:12:09.825586 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 15 12:12:09.825586 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 15 12:12:09.825586 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application result = self._query(query) Sep 15 12:12:09.825586 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 15 12:12:09.825586 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application conn.query(q) Sep 15 12:12:09.825586 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 15 12:12:09.825586 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 15 12:12:09.825586 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 15 12:12:09.825586 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application result.read() Sep 15 12:12:09.825586 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 15 12:12:09.825586 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 15 12:12:09.825586 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 15 12:12:09.825586 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 15 12:12:09.826812 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 15 12:12:09.826812 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 15 12:12:09.826812 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 15 12:12:09.826812 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 15 12:12:09.826812 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 15 12:12:09.826812 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 15 12:12:09.826812 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [parameters: {'user_id': 'e47bbc09fe244af996c58c774eeb863f', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 15 12:12:09.826812 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 15 12:12:09.826812 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:12:09.826812 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 12:12:09.826812 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:12:09.826812 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:12:09.826812 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:12:09.826812 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:12:09.826812 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:12:09.827815 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:12:09.827815 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:12:09.827815 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:12:09.827815 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:12:09.827815 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:12:09.827815 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:12:09.827815 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:12:09.827815 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 15 12:12:09.827815 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 15 12:12:09.827815 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:12:09.827815 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:12:09.827815 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 12:12:09.827815 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:12:09.827815 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 12:12:09.827815 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:12:09.827815 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 15 12:12:09.827815 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 15 12:12:09.828922 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 15 12:12:09.828922 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 15 12:12:09.828922 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 15 12:12:09.828922 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 15 12:12:09.828922 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 15 12:12:09.828922 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:12:09.831407 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 495/982] 10.222.0.16 () {60 vars in 1131 bytes} [Thu Sep 15 12:12:09 2022] POST /identity/v3/users => generated 160 bytes in 219 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:12:09.838051 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512aaffa-76a2-4053-88bf-274fe895b0d7 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:09.908513 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:09.934103 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faac8bc-7839-4eb3-899e-bb72dc269942 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:09.968087 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512aaffa-76a2-4053-88bf-274fe895b0d7 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:09.986108 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc5b236-8710-4acb-9fd9-f3105b217d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:09.986789 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5b236-8710-4acb-9fd9-f3105b217d22 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:09.987076 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5b236-8710-4acb-9fd9-f3105b217d22 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:09.987446 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5b236-8710-4acb-9fd9-f3105b217d22 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:09.988039 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc5b236-8710-4acb-9fd9-f3105b217d22 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:09.989418 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc5b236-8710-4acb-9fd9-f3105b217d22 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:09.998682 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-ffc5b236-8710-4acb-9fd9-f3105b217d22 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 15 12:12:09.998682 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:12:09.998682 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 12:12:09.998682 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 12:12:09.998682 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 12:12:09.998682 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 12:12:09.998682 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 12:12:09.998682 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:12:09.998682 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 15 12:12:09.998682 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:12:09.998682 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 12:12:09.998682 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:12:09.998682 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:12:09.998682 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:12:09.998682 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:12:09.998682 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:12:09.998682 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:12:09.999711 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:12:09.999711 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:12:09.999711 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:12:09.999711 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:12:09.999711 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:12:09.999711 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:12:09.999711 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 12:12:09.999711 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 12:12:09.999711 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 12:12:09.999711 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 12:12:09.999711 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:12:09.999711 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:12:09.999711 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:12:09.999711 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:12:09.999711 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:12:09.999711 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:12:10.000578 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:12:10.000578 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:12:10.000578 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:12:10.000578 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:12:10.000578 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:12:10.000578 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:12:10.000578 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:12:10.000578 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:12:10.000578 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:12:10.000578 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:12:10.000578 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 12:12:10.000578 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:12:10.000578 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 15 12:12:10.000578 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:12:10.004974 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 488/983] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 15 12:12:09 2022] GET /identity/v3/services/compute => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:12:10.006314 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc5b236-8710-4acb-9fd9-f3105b217d22 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:10.014762 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7004e7b0-156d-4376-ab22-b5a5b5ef110e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:10.016357 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7004e7b0-156d-4376-ab22-b5a5b5ef110e None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:10.016841 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7004e7b0-156d-4376-ab22-b5a5b5ef110e None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:10.017322 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7004e7b0-156d-4376-ab22-b5a5b5ef110e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:10.021665 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:10.032495 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7004e7b0-156d-4376-ab22-b5a5b5ef110e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:10.035503 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7004e7b0-156d-4376-ab22-b5a5b5ef110e None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:10.051421 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-7004e7b0-156d-4376-ab22-b5a5b5ef110e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 15 12:12:10.051421 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:12:10.051421 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:12:10.051421 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:12:10.051421 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:12:10.051421 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:12:10.051421 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:12:10.051421 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:12:10.051421 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:12:10.051421 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:12:10.051421 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:12:10.051421 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:12:10.051421 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 12:12:10.051421 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 12:12:10.051421 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 12:12:10.051421 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 12:12:10.052480 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:12:10.052480 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:12:10.052480 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 12:12:10.052480 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:12:10.052480 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 12:12:10.052480 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:12:10.052480 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:12:10.052480 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:12:10.052480 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:12:10.052480 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:12:10.052480 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:12:10.052480 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:12:10.052480 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:12:10.052480 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:12:10.052480 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:12:10.052480 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:12:10.052480 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:12:10.052480 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:12:10.053835 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:12:10.053835 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:12:10.053835 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 12:12:10.053835 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 12:12:10.053835 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 12:12:10.053835 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 12:12:10.053835 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 12:12:10.053835 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 12:12:10.053835 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 15 12:12:10.053835 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:12:10.059083 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 496/984] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 15 12:12:09 2022] GET /identity/v3/users/cinder => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:12:10.062252 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7004e7b0-156d-4376-ab22-b5a5b5ef110e None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:10.123648 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc5b236-8710-4acb-9fd9-f3105b217d22 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:10.167178 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f02b71-566e-4330-b9bf-937fc2804fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:10.168435 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f02b71-566e-4330-b9bf-937fc2804fba None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:10.168920 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f02b71-566e-4330-b9bf-937fc2804fba None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:10.169414 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f02b71-566e-4330-b9bf-937fc2804fba None admin] PATH_INFO: `/v3/services` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:10.170793 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f02b71-566e-4330-b9bf-937fc2804fba None admin] RBAC: Adding query filter params (name=compute) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:12:10.171739 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f02b71-566e-4330-b9bf-937fc2804fba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:10.173576 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f02b71-566e-4330-b9bf-937fc2804fba None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:10.180763 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 489/985] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Sep 15 12:12:10 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:12:10.184334 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7004e7b0-156d-4376-ab22-b5a5b5ef110e None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:10.186887 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f02b71-566e-4330-b9bf-937fc2804fba None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:10.201204 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:10.227117 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3122dc-2c50-494b-8fa7-b38b0088e1e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:10.227730 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3122dc-2c50-494b-8fa7-b38b0088e1e3 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:10.228060 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3122dc-2c50-494b-8fa7-b38b0088e1e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:10.228336 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3122dc-2c50-494b-8fa7-b38b0088e1e3 None admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:10.229037 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3122dc-2c50-494b-8fa7-b38b0088e1e3 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:12:10.229347 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3122dc-2c50-494b-8fa7-b38b0088e1e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:10.231025 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3122dc-2c50-494b-8fa7-b38b0088e1e3 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:10.274737 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 497/986] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Sep 15 12:12:10 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:12:10.308354 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f02b71-566e-4330-b9bf-937fc2804fba None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:10.347443 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c78204-e45a-4725-939b-908990c7f5cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:10.348323 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c78204-e45a-4725-939b-908990c7f5cf None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:10.348750 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c78204-e45a-4725-939b-908990c7f5cf None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:10.349203 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c78204-e45a-4725-939b-908990c7f5cf None admin] PATH_INFO: `/v3/services` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:10.349995 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c78204-e45a-4725-939b-908990c7f5cf None admin] RBAC: Adding query filter params (type=compute) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:12:10.350447 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c78204-e45a-4725-939b-908990c7f5cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:10.352152 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c78204-e45a-4725-939b-908990c7f5cf None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:10.359053 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 490/987] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Sep 15 12:12:10 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:12:10.367868 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3122dc-2c50-494b-8fa7-b38b0088e1e3 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:10.431537 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:10.479701 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3122dc-2c50-494b-8fa7-b38b0088e1e3 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:10.517661 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39356b11-a578-45b9-a247-54948bdb752f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:10.518267 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39356b11-a578-45b9-a247-54948bdb752f None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:10.518540 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39356b11-a578-45b9-a247-54948bdb752f None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:10.518830 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39356b11-a578-45b9-a247-54948bdb752f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:10.519527 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39356b11-a578-45b9-a247-54948bdb752f None admin] RBAC: Adding query filter params (interface=public, service_id=c5cfebbbdbf84effb5565172d3bab029, region_id=RegionOne) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:12:10.519828 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39356b11-a578-45b9-a247-54948bdb752f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:10.521170 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39356b11-a578-45b9-a247-54948bdb752f None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:10.526756 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 498/988] 10.222.0.16 () {56 vars in 1251 bytes} [Thu Sep 15 12:12:10 2022] GET /identity/v3/endpoints?service_id=c5cfebbbdbf84effb5565172d3bab029&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:12:10.532843 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c78204-e45a-4725-939b-908990c7f5cf None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:10.609153 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:10.643116 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c78204-e45a-4725-939b-908990c7f5cf None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:10.678151 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a53fb2-d639-4bcd-a9fe-c458602813ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:10.678920 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a53fb2-d639-4bcd-a9fe-c458602813ea None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:10.679304 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a53fb2-d639-4bcd-a9fe-c458602813ea None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:10.679710 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a53fb2-d639-4bcd-a9fe-c458602813ea None admin] PATH_INFO: `/v3/services` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:10.680412 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a53fb2-d639-4bcd-a9fe-c458602813ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:10.681934 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a53fb2-d639-4bcd-a9fe-c458602813ea None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:10.688503 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 491/989] 10.222.0.16 () {56 vars in 1087 bytes} [Thu Sep 15 12:12:10 2022] GET /identity/v3/services => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:12:11.221694 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3852150f-afe6-474b-aa41-7a84e7142951 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:11.222214 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3852150f-afe6-474b-aa41-7a84e7142951 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:11.222214 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3852150f-afe6-474b-aa41-7a84e7142951 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:11.223700 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 499/990] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:12:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:12:11.228826 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe78228-4184-42e8-884d-7660512aff10 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:11.229215 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe78228-4184-42e8-884d-7660512aff10 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:11.229390 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe78228-4184-42e8-884d-7660512aff10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:11.247755 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-7fe78228-4184-42e8-884d-7660512aff10 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:12:11.248961 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-7fe78228-4184-42e8-884d-7660512aff10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:12:11.318784 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 492/991] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:12:11 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:12:11.584754 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3852150f-afe6-474b-aa41-7a84e7142951 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:11.686844 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3852150f-afe6-474b-aa41-7a84e7142951 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:11.704534 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:11.722952 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134d1594-bb3d-4f78-aa88-d178086b93be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:11.723583 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134d1594-bb3d-4f78-aa88-d178086b93be None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:11.723862 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134d1594-bb3d-4f78-aa88-d178086b93be None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:11.724133 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134d1594-bb3d-4f78-aa88-d178086b93be None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:11.724712 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134d1594-bb3d-4f78-aa88-d178086b93be None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:11.726136 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134d1594-bb3d-4f78-aa88-d178086b93be None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:11.734865 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-134d1594-bb3d-4f78-aa88-d178086b93be None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 12:12:11.734865 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:12:11.734865 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 12:12:11.734865 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 12:12:11.734865 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 12:12:11.734865 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 12:12:11.734865 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 12:12:11.734865 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:12:11.734865 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 12:12:11.734865 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:12:11.734865 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 12:12:11.734865 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:12:11.734865 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:12:11.734865 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:12:11.734865 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:12:11.734865 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:12:11.734865 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:12:11.735837 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:12:11.735837 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:12:11.735837 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:12:11.735837 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:12:11.735837 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:12:11.735837 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:12:11.735837 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 12:12:11.735837 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 12:12:11.735837 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 12:12:11.735837 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 12:12:11.735837 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:12:11.735837 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:12:11.735837 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:12:11.735837 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:12:11.735837 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:12:11.735837 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:12:11.736686 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:12:11.736686 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:12:11.736686 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:12:11.736686 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:12:11.736686 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:12:11.736686 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:12:11.736686 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:12:11.736686 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:12:11.736686 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:12:11.736686 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:12:11.736686 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 12:12:11.736686 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:12:11.736686 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 12:12:11.736686 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:12:11.738771 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 500/992] 10.222.0.16 () {56 vars in 1126 bytes} [Thu Sep 15 12:12:11 2022] GET /identity/v3/services/object-store => generated 93 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:12:11.742210 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe78228-4184-42e8-884d-7660512aff10 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:11.814021 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:11.850653 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe78228-4184-42e8-884d-7660512aff10 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:11.882433 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b22cf2-54e6-4d32-a38e-36fe4d57de32 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:11.882747 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b22cf2-54e6-4d32-a38e-36fe4d57de32 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:11.883093 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b22cf2-54e6-4d32-a38e-36fe4d57de32 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:11.884661 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 501/993] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:12:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 12:12:11.889569 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b1f894-690c-4006-b5d1-19e20d5b87f1 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:11.889850 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b1f894-690c-4006-b5d1-19e20d5b87f1 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:11.890222 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b1f894-690c-4006-b5d1-19e20d5b87f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:11.892709 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11f8025-16dd-40fe-b028-25833f4a879f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:11.893320 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11f8025-16dd-40fe-b028-25833f4a879f None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:11.893604 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11f8025-16dd-40fe-b028-25833f4a879f None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:11.893874 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11f8025-16dd-40fe-b028-25833f4a879f None admin] PATH_INFO: `/v3/services` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:11.894506 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11f8025-16dd-40fe-b028-25833f4a879f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:12:11.894834 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11f8025-16dd-40fe-b028-25833f4a879f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:11.896201 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11f8025-16dd-40fe-b028-25833f4a879f None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:11.906143 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 493/994] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Sep 15 12:12:11 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:12:11.909587 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-63b1f894-690c-4006-b5d1-19e20d5b87f1 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:12:11.911394 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-63b1f894-690c-4006-b5d1-19e20d5b87f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:12:11.911605 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11f8025-16dd-40fe-b028-25833f4a879f None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:11.991205 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 502/995] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:12:11 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:12:12.018836 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11f8025-16dd-40fe-b028-25833f4a879f None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:12.047997 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:12.055190 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311df3c7-66dd-4bbe-a765-0b370fbfeebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:12.055794 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311df3c7-66dd-4bbe-a765-0b370fbfeebc None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:12.056076 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311df3c7-66dd-4bbe-a765-0b370fbfeebc None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:12.056349 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311df3c7-66dd-4bbe-a765-0b370fbfeebc None admin] PATH_INFO: `/v3/services` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:12.057032 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311df3c7-66dd-4bbe-a765-0b370fbfeebc None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:12:12.057338 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311df3c7-66dd-4bbe-a765-0b370fbfeebc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:12.058725 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311df3c7-66dd-4bbe-a765-0b370fbfeebc None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:12.068509 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 494/996] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Sep 15 12:12:11 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:12:12.069408 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b1f894-690c-4006-b5d1-19e20d5b87f1 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:12.169467 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b1f894-690c-4006-b5d1-19e20d5b87f1 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:12.182756 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:12.205446 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23988473-feba-4eb8-b00e-e858ee5fb13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:12.206052 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23988473-feba-4eb8-b00e-e858ee5fb13b None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:12.206344 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23988473-feba-4eb8-b00e-e858ee5fb13b None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:12.206602 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23988473-feba-4eb8-b00e-e858ee5fb13b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:12.207353 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23988473-feba-4eb8-b00e-e858ee5fb13b None admin] RBAC: Adding query filter params (interface=admin, service_id=00dd83bd385949d2b44de4a6612aa50d, region_id=RegionOne) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:12:12.207663 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23988473-feba-4eb8-b00e-e858ee5fb13b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:12.209013 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23988473-feba-4eb8-b00e-e858ee5fb13b None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:12.214124 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 503/997] 10.222.0.16 () {56 vars in 1249 bytes} [Thu Sep 15 12:12:12 2022] GET /identity/v3/endpoints?service_id=00dd83bd385949d2b44de4a6612aa50d&interface=admin®ion_id=RegionOne => generated 193 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:12:12.220526 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311df3c7-66dd-4bbe-a765-0b370fbfeebc None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:12.256237 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23988473-feba-4eb8-b00e-e858ee5fb13b None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:12.327670 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311df3c7-66dd-4bbe-a765-0b370fbfeebc None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:12.361496 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27436eaa-c5ba-43ac-b5e5-5a336c9336ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:12.362186 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27436eaa-c5ba-43ac-b5e5-5a336c9336ec None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:12.362475 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27436eaa-c5ba-43ac-b5e5-5a336c9336ec None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:12.362768 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27436eaa-c5ba-43ac-b5e5-5a336c9336ec None admin] PATH_INFO: `/v3/services` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:12.363374 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27436eaa-c5ba-43ac-b5e5-5a336c9336ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:12.364741 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27436eaa-c5ba-43ac-b5e5-5a336c9336ec None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:12.366932 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23988473-feba-4eb8-b00e-e858ee5fb13b None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:12.378738 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 495/998] 10.222.0.16 () {56 vars in 1087 bytes} [Thu Sep 15 12:12:12 2022] GET /identity/v3/services => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:12:12.409698 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd46b092-f35c-4765-94ba-bbe2c91d0386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:12.410359 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd46b092-f35c-4765-94ba-bbe2c91d0386 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:12.410730 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd46b092-f35c-4765-94ba-bbe2c91d0386 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:12.411014 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd46b092-f35c-4765-94ba-bbe2c91d0386 None admin] PATH_INFO: `/v3/services/image` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:12.411616 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd46b092-f35c-4765-94ba-bbe2c91d0386 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:12.413031 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd46b092-f35c-4765-94ba-bbe2c91d0386 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:12.423520 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-bd46b092-f35c-4765-94ba-bbe2c91d0386 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 15 12:12:12.423520 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:12:12.423520 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 12:12:12.423520 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 12:12:12.423520 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 12:12:12.423520 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 12:12:12.423520 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 12:12:12.423520 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:12:12.423520 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 15 12:12:12.423520 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:12:12.423520 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 12:12:12.423520 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:12:12.423520 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:12:12.423520 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:12:12.423520 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:12:12.423520 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:12:12.423520 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:12:12.424576 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:12:12.424576 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:12:12.424576 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:12:12.424576 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:12:12.424576 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:12:12.424576 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:12:12.424576 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 12:12:12.424576 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 12:12:12.424576 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 12:12:12.424576 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 12:12:12.424576 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:12:12.424576 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:12:12.424576 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:12:12.424576 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:12:12.424576 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:12:12.424576 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:12:12.425445 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:12:12.425445 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:12:12.425445 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:12:12.425445 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:12:12.425445 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:12:12.425445 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:12:12.425445 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:12:12.425445 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:12:12.425445 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:12:12.425445 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:12:12.425445 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 12:12:12.425445 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:12:12.425445 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 15 12:12:12.425445 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:12:12.425445 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 504/999] 10.222.0.16 () {56 vars in 1105 bytes} [Thu Sep 15 12:12:12 2022] GET /identity/v3/services/image => generated 86 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:12:12.434725 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27436eaa-c5ba-43ac-b5e5-5a336c9336ec None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:12.499923 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:12.546948 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27436eaa-c5ba-43ac-b5e5-5a336c9336ec None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:12.584333 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96181849-90c3-4ad6-af7a-9dc877d8e557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:12.584942 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96181849-90c3-4ad6-af7a-9dc877d8e557 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:12.585220 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96181849-90c3-4ad6-af7a-9dc877d8e557 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:12.585492 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96181849-90c3-4ad6-af7a-9dc877d8e557 None admin] PATH_INFO: `/v3/services` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:12.586123 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96181849-90c3-4ad6-af7a-9dc877d8e557 None admin] RBAC: Adding query filter params (name=image) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:12:12.586426 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96181849-90c3-4ad6-af7a-9dc877d8e557 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:12.587822 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96181849-90c3-4ad6-af7a-9dc877d8e557 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:12.593033 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 496/1000] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:12:12 2022] GET /identity/v3/services?name=image => generated 122 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:12:12.598507 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd46b092-f35c-4765-94ba-bbe2c91d0386 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:12.643862 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:12.704405 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd46b092-f35c-4765-94ba-bbe2c91d0386 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:12.738799 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93dc1e0-6b86-416b-8e32-09b4ac452c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:12.739429 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93dc1e0-6b86-416b-8e32-09b4ac452c4b None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:12.739707 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93dc1e0-6b86-416b-8e32-09b4ac452c4b None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:12.739975 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93dc1e0-6b86-416b-8e32-09b4ac452c4b None admin] PATH_INFO: `/v3/services` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:12.740622 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93dc1e0-6b86-416b-8e32-09b4ac452c4b None admin] RBAC: Adding query filter params (type=image) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:12:12.740921 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93dc1e0-6b86-416b-8e32-09b4ac452c4b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:12.742331 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93dc1e0-6b86-416b-8e32-09b4ac452c4b None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:12.754717 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 505/1001] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:12:12 2022] GET /identity/v3/services?type=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:12:12.871048 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa429256-aaeb-4426-89d7-c577d50ec103 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:12.871328 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa429256-aaeb-4426-89d7-c577d50ec103 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:12.871605 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa429256-aaeb-4426-89d7-c577d50ec103 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:12.873521 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 497/1002] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:12:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:12:12.879713 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b449d276-791b-437e-80a8-5f6872e4b61a None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:12.880014 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b449d276-791b-437e-80a8-5f6872e4b61a None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:12.880267 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b449d276-791b-437e-80a8-5f6872e4b61a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:12.899781 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-b449d276-791b-437e-80a8-5f6872e4b61a None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:12:12.900994 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-b449d276-791b-437e-80a8-5f6872e4b61a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:12:12.976537 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 506/1003] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:12:12 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:12:13.249129 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa429256-aaeb-4426-89d7-c577d50ec103 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:13.353388 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa429256-aaeb-4426-89d7-c577d50ec103 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:13.376122 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:13.389141 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fb1cde-11a9-4d07-8c18-c7ee7d9e9ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:13.389763 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fb1cde-11a9-4d07-8c18-c7ee7d9e9ff1 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:13.390038 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fb1cde-11a9-4d07-8c18-c7ee7d9e9ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:13.390306 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fb1cde-11a9-4d07-8c18-c7ee7d9e9ff1 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:13.390904 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fb1cde-11a9-4d07-8c18-c7ee7d9e9ff1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:13.392253 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fb1cde-11a9-4d07-8c18-c7ee7d9e9ff1 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:13.400886 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-d9fb1cde-11a9-4d07-8c18-c7ee7d9e9ff1 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 15 12:12:13.400886 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:12:13.400886 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 12:12:13.400886 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 12:12:13.400886 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 12:12:13.400886 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 12:12:13.400886 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 12:12:13.400886 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:12:13.400886 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 15 12:12:13.400886 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:12:13.400886 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 12:12:13.400886 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:12:13.400886 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:12:13.400886 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:12:13.400886 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:12:13.400886 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:12:13.400886 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:12:13.401873 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:12:13.401873 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:12:13.401873 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:12:13.401873 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:12:13.401873 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:12:13.401873 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:12:13.401873 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 12:12:13.401873 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 12:12:13.401873 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 12:12:13.401873 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 12:12:13.401873 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:12:13.401873 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:12:13.401873 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:12:13.401873 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:12:13.401873 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:12:13.401873 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:12:13.402754 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:12:13.402754 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:12:13.402754 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:12:13.402754 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:12:13.402754 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:12:13.402754 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:12:13.402754 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:12:13.402754 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:12:13.402754 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:12:13.402754 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:12:13.402754 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 12:12:13.402754 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:12:13.402754 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 15 12:12:13.402754 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:12:13.406920 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 498/1004] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 15 12:12:13 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:12:13.408124 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b449d276-791b-437e-80a8-5f6872e4b61a None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:13.442785 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:13.511969 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b449d276-791b-437e-80a8-5f6872e4b61a None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:13.546468 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc55bf47-0c3d-40aa-aaf4-cda7e30a8c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:13.547136 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc55bf47-0c3d-40aa-aaf4-cda7e30a8c4c None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:13.547409 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc55bf47-0c3d-40aa-aaf4-cda7e30a8c4c None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:13.547676 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc55bf47-0c3d-40aa-aaf4-cda7e30a8c4c None admin] PATH_INFO: `/v3/services` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:13.548295 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc55bf47-0c3d-40aa-aaf4-cda7e30a8c4c None admin] RBAC: Adding query filter params (name=compute) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:12:13.548591 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc55bf47-0c3d-40aa-aaf4-cda7e30a8c4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:13.549996 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc55bf47-0c3d-40aa-aaf4-cda7e30a8c4c None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:13.558759 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 507/1005] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Sep 15 12:12:13 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:12:13.560580 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fb1cde-11a9-4d07-8c18-c7ee7d9e9ff1 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:13.665227 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fb1cde-11a9-4d07-8c18-c7ee7d9e9ff1 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:13.698122 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5726b528-ecd4-41d7-a3f7-c5cf97c8f173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:13.698737 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5726b528-ecd4-41d7-a3f7-c5cf97c8f173 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:13.699015 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5726b528-ecd4-41d7-a3f7-c5cf97c8f173 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:13.699280 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5726b528-ecd4-41d7-a3f7-c5cf97c8f173 None admin] PATH_INFO: `/v3/services` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:13.699895 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5726b528-ecd4-41d7-a3f7-c5cf97c8f173 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:12:13.700188 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5726b528-ecd4-41d7-a3f7-c5cf97c8f173 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:13.701746 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5726b528-ecd4-41d7-a3f7-c5cf97c8f173 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:13.706490 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 499/1006] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Sep 15 12:12:13 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:12:13.711886 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc55bf47-0c3d-40aa-aaf4-cda7e30a8c4c None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:13.806570 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:13.811108 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc55bf47-0c3d-40aa-aaf4-cda7e30a8c4c None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:13.844898 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb75bc2e-360c-4cde-badc-48282444a15c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:13.845486 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb75bc2e-360c-4cde-badc-48282444a15c None admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:13.845758 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb75bc2e-360c-4cde-badc-48282444a15c None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:13.846024 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb75bc2e-360c-4cde-badc-48282444a15c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:13.846681 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb75bc2e-360c-4cde-badc-48282444a15c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:13.848037 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb75bc2e-360c-4cde-badc-48282444a15c None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:13.867884 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 508/1007] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:12:13 2022] POST /identity/v3/endpoints => generated 334 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:12:14.557576 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8178d46b-9644-4435-854a-9590651b2b2c None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:14.558139 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8178d46b-9644-4435-854a-9590651b2b2c None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:14.558139 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8178d46b-9644-4435-854a-9590651b2b2c None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:14.559541 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 500/1008] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:12:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:12:14.564917 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1adeeb-b374-42cf-baf4-868a8a08b072 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:14.565313 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1adeeb-b374-42cf-baf4-868a8a08b072 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:14.565510 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1adeeb-b374-42cf-baf4-868a8a08b072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:14.584214 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-dc1adeeb-b374-42cf-baf4-868a8a08b072 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:12:14.585403 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-dc1adeeb-b374-42cf-baf4-868a8a08b072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:12:14.662797 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 509/1009] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:12:14 2022] POST /identity/v3/auth/tokens => generated 1726 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:12:14.907333 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e19a6-058c-43a4-90d3-f88ac4495931 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:14.907520 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e19a6-058c-43a4-90d3-f88ac4495931 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:14.907800 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e19a6-058c-43a4-90d3-f88ac4495931 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:14.909259 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 501/1010] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:12:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:12:14.914201 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df5943-d526-4ef2-aee4-67873f348bca None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:14.914489 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df5943-d526-4ef2-aee4-67873f348bca None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:14.914784 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df5943-d526-4ef2-aee4-67873f348bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:14.932668 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-f6df5943-d526-4ef2-aee4-67873f348bca None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:12:14.933059 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938e19a6-058c-43a4-90d3-f88ac4495931 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:14.933846 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-f6df5943-d526-4ef2-aee4-67873f348bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:12:14.987854 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:15.019148 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 510/1011] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:12:14 2022] POST /identity/v3/auth/tokens => generated 1726 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:12:15.043358 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938e19a6-058c-43a4-90d3-f88ac4495931 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:15.077682 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22f9d98-ef5b-4cd1-a530-3ba0b54ca44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:15.078309 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f9d98-ef5b-4cd1-a530-3ba0b54ca44c None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:15.078582 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f9d98-ef5b-4cd1-a530-3ba0b54ca44c None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:15.078882 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f9d98-ef5b-4cd1-a530-3ba0b54ca44c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:15.079454 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22f9d98-ef5b-4cd1-a530-3ba0b54ca44c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:15.080850 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22f9d98-ef5b-4cd1-a530-3ba0b54ca44c None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:15.089882 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-c22f9d98-ef5b-4cd1-a530-3ba0b54ca44c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 12:12:15.089882 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:12:15.089882 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 12:12:15.089882 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 12:12:15.089882 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 12:12:15.089882 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 12:12:15.089882 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 12:12:15.089882 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:12:15.089882 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 12:12:15.089882 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:12:15.089882 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 12:12:15.089882 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:12:15.089882 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:12:15.089882 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:12:15.089882 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:12:15.089882 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:12:15.089882 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:12:15.090916 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:12:15.090916 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:12:15.090916 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:12:15.090916 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:12:15.090916 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:12:15.090916 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:12:15.090916 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 12:12:15.090916 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 12:12:15.090916 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 12:12:15.090916 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 12:12:15.090916 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:12:15.090916 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:12:15.090916 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:12:15.090916 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:12:15.090916 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:12:15.090916 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:12:15.092312 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:12:15.092312 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:12:15.092312 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:12:15.092312 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:12:15.092312 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:12:15.092312 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:12:15.092312 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:12:15.092312 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:12:15.092312 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:12:15.092312 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:12:15.092312 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 12:12:15.092312 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:12:15.092312 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 12:12:15.092312 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:12:15.092312 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 502/1012] 10.222.0.16 () {56 vars in 1126 bytes} [Thu Sep 15 12:12:14 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:12:15.097911 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6df5943-d526-4ef2-aee4-67873f348bca None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:15.110614 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:15.203072 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6df5943-d526-4ef2-aee4-67873f348bca None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:15.237425 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d02229-99a4-4720-a275-590a560deeb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:15.238029 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d02229-99a4-4720-a275-590a560deeb8 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:15.238307 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d02229-99a4-4720-a275-590a560deeb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:15.238581 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d02229-99a4-4720-a275-590a560deeb8 None admin] PATH_INFO: `/v3/services` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:15.239250 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d02229-99a4-4720-a275-590a560deeb8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:12:15.239553 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d02229-99a4-4720-a275-590a560deeb8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:15.240915 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d02229-99a4-4720-a275-590a560deeb8 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:15.245786 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 511/1013] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Sep 15 12:12:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:12:15.251771 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22f9d98-ef5b-4cd1-a530-3ba0b54ca44c None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:15.287851 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d02229-99a4-4720-a275-590a560deeb8 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:15.370870 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:15.373295 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22f9d98-ef5b-4cd1-a530-3ba0b54ca44c None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:15.391217 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:15.400297 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d02229-99a4-4720-a275-590a560deeb8 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:15.417650 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738612fc-67d9-483d-900d-d8327af1c51b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:15.418259 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738612fc-67d9-483d-900d-d8327af1c51b None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:15.418537 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738612fc-67d9-483d-900d-d8327af1c51b None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:15.418843 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738612fc-67d9-483d-900d-d8327af1c51b None admin] PATH_INFO: `/v3/services` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:15.419457 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738612fc-67d9-483d-900d-d8327af1c51b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:12:15.419789 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738612fc-67d9-483d-900d-d8327af1c51b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:15.421151 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738612fc-67d9-483d-900d-d8327af1c51b None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:15.430627 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 503/1014] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Sep 15 12:12:15 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:12:15.431555 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738612fc-67d9-483d-900d-d8327af1c51b None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:15.442988 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584bc13e-b1b6-413a-98cb-4a521710daa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:15.443909 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584bc13e-b1b6-413a-98cb-4a521710daa1 None admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:15.444467 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584bc13e-b1b6-413a-98cb-4a521710daa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:15.444742 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584bc13e-b1b6-413a-98cb-4a521710daa1 None admin] PATH_INFO: `/v3/services` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:15.445394 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584bc13e-b1b6-413a-98cb-4a521710daa1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:15.446779 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584bc13e-b1b6-413a-98cb-4a521710daa1 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:15.464882 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 512/1015] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Sep 15 12:12:15 2022] POST /identity/v3/services => generated 242 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 12:12:15.539585 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738612fc-67d9-483d-900d-d8327af1c51b None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:15.582214 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b92e06-fd66-415e-9ff9-256aa64cce54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:15.582888 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b92e06-fd66-415e-9ff9-256aa64cce54 None admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:15.583128 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b92e06-fd66-415e-9ff9-256aa64cce54 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:15.583397 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b92e06-fd66-415e-9ff9-256aa64cce54 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:15.584062 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b92e06-fd66-415e-9ff9-256aa64cce54 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:15.585438 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b92e06-fd66-415e-9ff9-256aa64cce54 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:15.610383 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 504/1016] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:12:15 2022] POST /identity/v3/endpoints => generated 325 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 12:12:16.133420 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3199179-e7b8-4e98-b6d3-47008fc93bcc None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:16.133928 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3199179-e7b8-4e98-b6d3-47008fc93bcc None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:16.133928 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3199179-e7b8-4e98-b6d3-47008fc93bcc None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:16.135458 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 513/1017] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:12:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:12:16.140465 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69564db1-49de-463d-980f-f03de1a12fdd None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:16.140750 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69564db1-49de-463d-980f-f03de1a12fdd None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:16.141016 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69564db1-49de-463d-980f-f03de1a12fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:16.158928 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-69564db1-49de-463d-980f-f03de1a12fdd None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:12:16.160091 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-69564db1-49de-463d-980f-f03de1a12fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:12:16.188137 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:16.234856 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 505/1018] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:12:16 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:12:16.499470 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3199179-e7b8-4e98-b6d3-47008fc93bcc None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:16.603906 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3199179-e7b8-4e98-b6d3-47008fc93bcc None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:16.637330 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218d6d72-ffa0-47d0-9405-215d6ee96d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:16.637941 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d6d72-ffa0-47d0-9405-215d6ee96d32 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:16.638219 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d6d72-ffa0-47d0-9405-215d6ee96d32 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:16.639064 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d6d72-ffa0-47d0-9405-215d6ee96d32 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:16.640858 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:16.651399 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218d6d72-ffa0-47d0-9405-215d6ee96d32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:12:16.656129 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-218d6d72-ffa0-47d0-9405-215d6ee96d32 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 15 12:12:16.656129 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:12:16.656129 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:12:16.656129 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:12:16.656129 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:12:16.656129 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:12:16.656129 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:12:16.656129 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:12:16.656129 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:12:16.656129 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:12:16.656129 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:12:16.656129 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:12:16.656129 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:12:16.656129 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:12:16.656129 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:12:16.656129 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:12:16.657037 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:12:16.657037 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:12:16.657037 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:12:16.657037 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:12:16.657037 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:12:16.657037 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:12:16.657037 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:12:16.657037 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:12:16.657037 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:12:16.657037 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:12:16.657037 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:12:16.657037 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:12:16.657037 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:12:16.657037 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:12:16.657037 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:12:16.657037 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:12:16.657889 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:12:16.657889 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:12:16.657889 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:12:16.657889 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:12:16.657889 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:12:16.657889 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:12:16.657889 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:12:16.657889 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:12:16.657889 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:12:16.657889 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:12:16.657889 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 15 12:12:16.657889 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:12:16.659324 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 514/1019] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Sep 15 12:12:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:12:16.663140 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69564db1-49de-463d-980f-f03de1a12fdd None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:16.766122 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69564db1-49de-463d-980f-f03de1a12fdd None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:16.800584 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6442a61-2f76-49e6-bee9-10d9fe1e999c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:16.801190 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6442a61-2f76-49e6-bee9-10d9fe1e999c None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:16.801469 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6442a61-2f76-49e6-bee9-10d9fe1e999c None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:16.801739 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6442a61-2f76-49e6-bee9-10d9fe1e999c None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:16.802402 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6442a61-2f76-49e6-bee9-10d9fe1e999c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:12:16.802718 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6442a61-2f76-49e6-bee9-10d9fe1e999c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:16.804092 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6442a61-2f76-49e6-bee9-10d9fe1e999c None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:16.817581 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 506/1020] 10.222.0.16 () {56 vars in 1115 bytes} [Thu Sep 15 12:12:16 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:12:16.819457 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218d6d72-ffa0-47d0-9405-215d6ee96d32 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:16.923876 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218d6d72-ffa0-47d0-9405-215d6ee96d32 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:16.956444 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c0a824-7b54-4ecf-bbd7-b6ac4bfc7fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:16.957058 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c0a824-7b54-4ecf-bbd7-b6ac4bfc7fe4 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:16.957331 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c0a824-7b54-4ecf-bbd7-b6ac4bfc7fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:16.957594 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c0a824-7b54-4ecf-bbd7-b6ac4bfc7fe4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:16.968745 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c0a824-7b54-4ecf-bbd7-b6ac4bfc7fe4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:16.970442 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c0a824-7b54-4ecf-bbd7-b6ac4bfc7fe4 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:16.985385 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-66c0a824-7b54-4ecf-bbd7-b6ac4bfc7fe4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:12:16.985385 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:12:16.985385 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:12:16.985385 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:12:16.985385 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:12:16.985385 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:12:16.985385 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:12:16.985385 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:12:16.985385 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:12:16.985385 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:12:16.985385 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:12:16.985385 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:12:16.985385 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:12:16.985385 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:12:16.985385 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:12:16.985385 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:12:16.986384 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:12:16.986384 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:12:16.986384 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:12:16.986384 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:12:16.986384 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:12:16.986384 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:12:16.986384 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:12:16.986384 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:12:16.986384 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:12:16.986384 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:12:16.986384 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:12:16.986384 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:12:16.986384 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:12:16.986384 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:12:16.986384 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:12:16.986384 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:12:16.986384 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:12:16.987331 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:12:16.987331 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:12:16.987331 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:12:16.987331 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 515/1021] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:12:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:12:16.992156 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6442a61-2f76-49e6-bee9-10d9fe1e999c None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:17.018480 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:17.093925 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6442a61-2f76-49e6-bee9-10d9fe1e999c None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:17.127063 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a07ec3-8263-4372-9369-a1f84e2cffbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:17.127665 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a07ec3-8263-4372-9369-a1f84e2cffbf None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:17.127941 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a07ec3-8263-4372-9369-a1f84e2cffbf None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:17.128211 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a07ec3-8263-4372-9369-a1f84e2cffbf None admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:17.128843 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a07ec3-8263-4372-9369-a1f84e2cffbf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:12:17.129146 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a07ec3-8263-4372-9369-a1f84e2cffbf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:17.130504 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a07ec3-8263-4372-9369-a1f84e2cffbf None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:17.146520 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 507/1022] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 15 12:12:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:12:17.147907 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c0a824-7b54-4ecf-bbd7-b6ac4bfc7fe4 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:17.200738 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:17.257667 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c0a824-7b54-4ecf-bbd7-b6ac4bfc7fe4 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:17.294090 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfde6fe-b906-4c84-9527-95988486a398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:17.295378 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfde6fe-b906-4c84-9527-95988486a398 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:17.295872 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfde6fe-b906-4c84-9527-95988486a398 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:17.296364 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfde6fe-b906-4c84-9527-95988486a398 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:17.306194 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfde6fe-b906-4c84-9527-95988486a398 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:17.307864 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfde6fe-b906-4c84-9527-95988486a398 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:17.319844 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-ccfde6fe-b906-4c84-9527-95988486a398 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 15 12:12:17.319844 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:12:17.319844 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:12:17.319844 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:12:17.319844 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:12:17.319844 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:12:17.319844 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:12:17.319844 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:12:17.319844 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:12:17.319844 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:12:17.319844 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:12:17.319844 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:12:17.319844 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 12:12:17.319844 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 12:12:17.319844 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 12:12:17.319844 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 12:12:17.320832 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:12:17.320832 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:12:17.320832 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 12:12:17.320832 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:12:17.320832 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 12:12:17.320832 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:12:17.320832 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:12:17.320832 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:12:17.320832 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:12:17.320832 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:12:17.320832 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:12:17.320832 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:12:17.320832 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:12:17.320832 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:12:17.320832 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:12:17.320832 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:12:17.320832 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:12:17.320832 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:12:17.326487 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:12:17.326487 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:12:17.326487 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 12:12:17.326487 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 12:12:17.326487 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 12:12:17.326487 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 12:12:17.326487 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 12:12:17.326487 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 12:12:17.326487 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 15 12:12:17.326487 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:12:17.326487 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 516/1023] 10.222.0.16 () {56 vars in 1093 bytes} [Thu Sep 15 12:12:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:12:17.327600 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a07ec3-8263-4372-9369-a1f84e2cffbf None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:17.411232 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:17.431456 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a07ec3-8263-4372-9369-a1f84e2cffbf None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:17.465132 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9184f7-3254-4fbc-8dfc-d8ab37cd1400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:17.465737 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9184f7-3254-4fbc-8dfc-d8ab37cd1400 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:17.466012 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9184f7-3254-4fbc-8dfc-d8ab37cd1400 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:17.466282 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9184f7-3254-4fbc-8dfc-d8ab37cd1400 None admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:17.467547 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9184f7-3254-4fbc-8dfc-d8ab37cd1400 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:12:17.467849 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9184f7-3254-4fbc-8dfc-d8ab37cd1400 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:17.469266 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9184f7-3254-4fbc-8dfc-d8ab37cd1400 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:17.491338 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 508/1024] 10.222.0.16 () {56 vars in 1133 bytes} [Thu Sep 15 12:12:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:12:17.492553 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfde6fe-b906-4c84-9527-95988486a398 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:17.597326 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfde6fe-b906-4c84-9527-95988486a398 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:17.604273 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:17.633359 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a12dc2-630e-492b-8607-55269e1ae800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:17.633967 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a12dc2-630e-492b-8607-55269e1ae800 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:17.634244 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a12dc2-630e-492b-8607-55269e1ae800 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:17.634516 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a12dc2-630e-492b-8607-55269e1ae800 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:17.683416 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390dbce-f870-468e-b1dc-d1e31fafc6b5 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:17.684101 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390dbce-f870-468e-b1dc-d1e31fafc6b5 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:17.684101 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390dbce-f870-468e-b1dc-d1e31fafc6b5 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:17.685571 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 509/1025] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:12:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 12:12:17.690447 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d453699e-ee11-49fd-a39d-f27152d4de93 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:17.690761 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d453699e-ee11-49fd-a39d-f27152d4de93 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:17.691033 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d453699e-ee11-49fd-a39d-f27152d4de93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:17.710526 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-d453699e-ee11-49fd-a39d-f27152d4de93 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:12:17.711821 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-d453699e-ee11-49fd-a39d-f27152d4de93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:12:17.711951 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a12dc2-630e-492b-8607-55269e1ae800 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:17.713428 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a12dc2-630e-492b-8607-55269e1ae800 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:17.783036 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 510/1026] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:12:17 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 12:12:17.824103 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 517/1027] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 15 12:12:17 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 15 12:12:17.827944 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a12dc2-630e-492b-8607-55269e1ae800 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:17.828084 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a19c163-8159-4037-a312-c1eb7adab4d0 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:17.828084 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a19c163-8159-4037-a312-c1eb7adab4d0 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:17.828084 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a19c163-8159-4037-a312-c1eb7adab4d0 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:17.828654 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 511/1028] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:12:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:12:17.833813 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb92dffa-f4a8-4cff-a3c5-2c9fd42fb510 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:17.834099 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb92dffa-f4a8-4cff-a3c5-2c9fd42fb510 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:17.834375 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb92dffa-f4a8-4cff-a3c5-2c9fd42fb510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:17.834790 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:17.852939 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-eb92dffa-f4a8-4cff-a3c5-2c9fd42fb510 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:12:17.854043 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-eb92dffa-f4a8-4cff-a3c5-2c9fd42fb510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:12:17.921187 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:17.934755 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 512/1029] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:12:17 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 12:12:17.934935 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a12dc2-630e-492b-8607-55269e1ae800 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:17.978599 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef26d2-7f8d-428c-8fdb-cfa8604997da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:17.979262 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef26d2-7f8d-428c-8fdb-cfa8604997da None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:17.979531 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef26d2-7f8d-428c-8fdb-cfa8604997da None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:17.979792 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef26d2-7f8d-428c-8fdb-cfa8604997da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:17.990447 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ef26d2-7f8d-428c-8fdb-cfa8604997da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:17.991896 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ef26d2-7f8d-428c-8fdb-cfa8604997da None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:18.009681 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-d7ef26d2-7f8d-428c-8fdb-cfa8604997da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:12:18.009681 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:12:18.009681 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:12:18.009681 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:12:18.009681 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:12:18.009681 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:12:18.009681 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:12:18.009681 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:12:18.009681 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:12:18.009681 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:12:18.009681 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:12:18.009681 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:12:18.009681 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:12:18.009681 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:12:18.009681 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:12:18.009681 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:12:18.010636 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:12:18.010636 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:12:18.010636 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:12:18.010636 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:12:18.010636 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:12:18.010636 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:12:18.010636 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:12:18.010636 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:12:18.010636 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:12:18.010636 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:12:18.010636 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:12:18.010636 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:12:18.010636 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:12:18.010636 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:12:18.010636 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:12:18.010636 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:12:18.010636 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:12:18.016504 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:12:18.016504 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:12:18.016504 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:12:18.016504 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 518/1030] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:12:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:12:18.016955 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb92dffa-f4a8-4cff-a3c5-2c9fd42fb510 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:18.057940 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef26d2-7f8d-428c-8fdb-cfa8604997da None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:18.125028 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb92dffa-f4a8-4cff-a3c5-2c9fd42fb510 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:18.125218 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:18.160838 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a70dd9d-1c84-4dec-a620-3b2289061e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:18.161560 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a70dd9d-1c84-4dec-a620-3b2289061e05 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:18.161847 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a70dd9d-1c84-4dec-a620-3b2289061e05 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:18.162124 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a70dd9d-1c84-4dec-a620-3b2289061e05 None admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:18.162792 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a70dd9d-1c84-4dec-a620-3b2289061e05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:12:18.163096 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a70dd9d-1c84-4dec-a620-3b2289061e05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:18.164459 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a70dd9d-1c84-4dec-a620-3b2289061e05 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:18.171823 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef26d2-7f8d-428c-8fdb-cfa8604997da None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:18.177289 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 513/1031] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 15 12:12:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:12:18.182902 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a70dd9d-1c84-4dec-a620-3b2289061e05 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:18.211365 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd43bb8-8eae-4903-9099-f4e8bbc1c08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:18.211992 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd43bb8-8eae-4903-9099-f4e8bbc1c08e None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:18.212370 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd43bb8-8eae-4903-9099-f4e8bbc1c08e None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:18.212642 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd43bb8-8eae-4903-9099-f4e8bbc1c08e None admin] PATH_INFO: `/v3/services/image` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:18.213229 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd43bb8-8eae-4903-9099-f4e8bbc1c08e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:18.214581 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd43bb8-8eae-4903-9099-f4e8bbc1c08e None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:18.224050 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-8dd43bb8-8eae-4903-9099-f4e8bbc1c08e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 15 12:12:18.224050 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:12:18.224050 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 12:12:18.224050 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 12:12:18.224050 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 12:12:18.224050 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 12:12:18.224050 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 12:12:18.224050 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:12:18.224050 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 15 12:12:18.224050 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:12:18.224050 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 12:12:18.224050 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:12:18.224050 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:12:18.224050 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:12:18.224050 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:12:18.224050 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:12:18.224050 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:12:18.225050 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:12:18.225050 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:12:18.225050 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:12:18.225050 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:12:18.225050 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:12:18.225050 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:12:18.225050 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 12:12:18.225050 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 12:12:18.225050 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 12:12:18.225050 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 12:12:18.225050 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:12:18.225050 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:12:18.225050 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:12:18.225050 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:12:18.225050 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:12:18.225050 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:12:18.225883 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:12:18.225883 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:12:18.225883 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:12:18.225883 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:12:18.225883 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:12:18.225883 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:12:18.225883 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:12:18.225883 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:12:18.225883 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:12:18.225883 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:12:18.225883 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 12:12:18.225883 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:12:18.225883 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 15 12:12:18.225883 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:12:18.225883 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 519/1032] 10.222.0.16 () {56 vars in 1105 bytes} [Thu Sep 15 12:12:18 2022] GET /identity/v3/services/image => generated 86 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:12:18.226708 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd43bb8-8eae-4903-9099-f4e8bbc1c08e None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:18.247219 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:18.287965 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a70dd9d-1c84-4dec-a620-3b2289061e05 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:18.320752 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb504a3e-3b14-4ad4-b1a7-4d5d2053a2bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:18.321364 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb504a3e-3b14-4ad4-b1a7-4d5d2053a2bd None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:18.321639 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb504a3e-3b14-4ad4-b1a7-4d5d2053a2bd None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:18.321904 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb504a3e-3b14-4ad4-b1a7-4d5d2053a2bd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:18.328774 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb504a3e-3b14-4ad4-b1a7-4d5d2053a2bd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:18.328905 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd43bb8-8eae-4903-9099-f4e8bbc1c08e None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:18.330189 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb504a3e-3b14-4ad4-b1a7-4d5d2053a2bd None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:18.341154 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-fb504a3e-3b14-4ad4-b1a7-4d5d2053a2bd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:12:18.341154 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:12:18.341154 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:12:18.341154 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:12:18.341154 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:12:18.341154 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:12:18.341154 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:12:18.341154 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:12:18.341154 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:12:18.341154 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:12:18.341154 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:12:18.341154 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:12:18.341154 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 12:12:18.341154 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 12:12:18.341154 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 12:12:18.342811 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 12:12:18.342811 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:12:18.342811 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:12:18.342811 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:12:18.342811 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:12:18.342811 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:12:18.342811 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:12:18.342811 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:12:18.342811 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:12:18.342811 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:12:18.342811 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:12:18.342811 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:12:18.342811 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:12:18.342811 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:12:18.342811 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:12:18.342811 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:12:18.342811 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:12:18.343901 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 12:12:18.343901 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 12:12:18.343901 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 12:12:18.343901 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 12:12:18.343901 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 12:12:18.343901 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 12:12:18.343901 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:12:18.343901 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:12:18.347695 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 514/1033] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 15 12:12:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:12:18.348370 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb504a3e-3b14-4ad4-b1a7-4d5d2053a2bd None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:18.351515 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:18.366486 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60489016-edcf-4935-a30c-4ba4c6209c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:18.367175 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60489016-edcf-4935-a30c-4ba4c6209c29 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:18.367448 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60489016-edcf-4935-a30c-4ba4c6209c29 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:18.367716 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60489016-edcf-4935-a30c-4ba4c6209c29 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:18.369210 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60489016-edcf-4935-a30c-4ba4c6209c29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:18.371105 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60489016-edcf-4935-a30c-4ba4c6209c29 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:18.372715 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 520/1034] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:12:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:12:18.373475 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60489016-edcf-4935-a30c-4ba4c6209c29 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:18.457753 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb504a3e-3b14-4ad4-b1a7-4d5d2053a2bd None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:18.477182 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:18.479618 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60489016-edcf-4935-a30c-4ba4c6209c29 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:18.491654 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394ef783-154f-4459-b317-e60ac3747591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:18.492267 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ef783-154f-4459-b317-e60ac3747591 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:18.492544 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ef783-154f-4459-b317-e60ac3747591 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:18.492821 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ef783-154f-4459-b317-e60ac3747591 None admin] PATH_INFO: `/v3/services` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:18.493443 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394ef783-154f-4459-b317-e60ac3747591 None admin] RBAC: Adding query filter params (name=image) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:12:18.493745 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394ef783-154f-4459-b317-e60ac3747591 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:18.495147 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394ef783-154f-4459-b317-e60ac3747591 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:18.499809 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 515/1035] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:12:18 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:12:18.500558 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394ef783-154f-4459-b317-e60ac3747591 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:18.515864 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fb95cb-2dd0-4db7-9391-6f2761314317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:18.516469 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb95cb-2dd0-4db7-9391-6f2761314317 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:18.516748 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb95cb-2dd0-4db7-9391-6f2761314317 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:18.517021 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb95cb-2dd0-4db7-9391-6f2761314317 None admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:18.517716 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fb95cb-2dd0-4db7-9391-6f2761314317 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:12:18.518022 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fb95cb-2dd0-4db7-9391-6f2761314317 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:18.519473 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fb95cb-2dd0-4db7-9391-6f2761314317 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:18.532821 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 521/1036] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Sep 15 12:12:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:12:18.533611 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fb95cb-2dd0-4db7-9391-6f2761314317 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:18.582317 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:18.602675 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394ef783-154f-4459-b317-e60ac3747591 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:18.632891 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fb95cb-2dd0-4db7-9391-6f2761314317 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:18.635950 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146ffdc6-a0b2-4bd9-ab49-dbe49203df70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:18.636547 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ffdc6-a0b2-4bd9-ab49-dbe49203df70 None admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:18.636825 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ffdc6-a0b2-4bd9-ab49-dbe49203df70 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:18.637097 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ffdc6-a0b2-4bd9-ab49-dbe49203df70 None admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:18.637765 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146ffdc6-a0b2-4bd9-ab49-dbe49203df70 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:18.639805 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146ffdc6-a0b2-4bd9-ab49-dbe49203df70 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:18.666324 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 516/1037] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Sep 15 12:12:18 2022] POST /identity/v3/projects => generated 311 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:12:18.667157 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146ffdc6-a0b2-4bd9-ab49-dbe49203df70 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:18.672075 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e84616-6731-42b8-86c5-99101b7bd96f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:18.672656 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e84616-6731-42b8-86c5-99101b7bd96f None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:18.672934 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e84616-6731-42b8-86c5-99101b7bd96f None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:18.673198 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e84616-6731-42b8-86c5-99101b7bd96f None admin] PATH_INFO: `/v3/services` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:18.673844 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e84616-6731-42b8-86c5-99101b7bd96f None admin] RBAC: Adding query filter params (type=image) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:12:18.674146 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e84616-6731-42b8-86c5-99101b7bd96f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:18.675588 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e84616-6731-42b8-86c5-99101b7bd96f None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:18.681195 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 522/1038] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:12:18 2022] GET /identity/v3/services?type=image => generated 350 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:12:18.687965 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e84616-6731-42b8-86c5-99101b7bd96f None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:18.709857 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:18.794317 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146ffdc6-a0b2-4bd9-ab49-dbe49203df70 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:18.811317 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e84616-6731-42b8-86c5-99101b7bd96f None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:18.827306 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:18.835706 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf70888-2b58-4179-94a0-88ef79e9153a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:18.836336 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf70888-2b58-4179-94a0-88ef79e9153a None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:18.836617 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf70888-2b58-4179-94a0-88ef79e9153a None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:18.836999 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf70888-2b58-4179-94a0-88ef79e9153a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:18.837737 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf70888-2b58-4179-94a0-88ef79e9153a None admin] RBAC: Adding query filter params (role.id=4ceb69a86bf04a2ebb1f56b197006b3c, scope.project.id=cab958c081ad4a92939d4469cf4ce1c6, user.id=9d05c52570474820b4ba0e2cdad5c13f) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:12:18.838046 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf70888-2b58-4179-94a0-88ef79e9153a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:18.839702 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf70888-2b58-4179-94a0-88ef79e9153a None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:18.846184 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 517/1039] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 15 12:12:18 2022] GET /identity/v3/role_assignments?user.id=9d05c52570474820b4ba0e2cdad5c13f&scope.project.id=cab958c081ad4a92939d4469cf4ce1c6&role.id=4ceb69a86bf04a2ebb1f56b197006b3c => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:12:18.856806 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009318fb-d355-472a-9241-f1dc9e5d6857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:18.857433 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009318fb-d355-472a-9241-f1dc9e5d6857 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:18.857710 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009318fb-d355-472a-9241-f1dc9e5d6857 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:18.857981 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009318fb-d355-472a-9241-f1dc9e5d6857 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:18.858761 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009318fb-d355-472a-9241-f1dc9e5d6857 None admin] RBAC: Adding query filter params (interface=public, service_id=062686ceaf764eef9b9d85c7309bee74, region_id=RegionOne) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:12:18.859080 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009318fb-d355-472a-9241-f1dc9e5d6857 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:18.860473 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009318fb-d355-472a-9241-f1dc9e5d6857 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:18.867078 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 523/1040] 10.222.0.16 () {56 vars in 1251 bytes} [Thu Sep 15 12:12:18 2022] GET /identity/v3/endpoints?service_id=062686ceaf764eef9b9d85c7309bee74&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:12:18.873706 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf70888-2b58-4179-94a0-88ef79e9153a None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:18.988775 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:18.991944 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf70888-2b58-4179-94a0-88ef79e9153a None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:19.033536 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4102db-c952-4033-bfdd-1599e347ab26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:19.034157 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4102db-c952-4033-bfdd-1599e347ab26 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:19.034435 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4102db-c952-4033-bfdd-1599e347ab26 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:19.034730 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4102db-c952-4033-bfdd-1599e347ab26 None admin] PATH_INFO: `/v3/services` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:19.035345 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4102db-c952-4033-bfdd-1599e347ab26 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:19.036710 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4102db-c952-4033-bfdd-1599e347ab26 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:19.044127 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 518/1041] 10.222.0.16 () {56 vars in 1087 bytes} [Thu Sep 15 12:12:18 2022] GET /identity/v3/services => generated 1957 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:12:20.926617 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd87bf-d6b5-4f1e-9610-e421a7ec3763 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:20.927159 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd87bf-d6b5-4f1e-9610-e421a7ec3763 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:20.927159 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd87bf-d6b5-4f1e-9610-e421a7ec3763 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:20.928674 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 524/1042] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:12:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:12:20.933611 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb04089-9ec4-49b0-bfad-e02b3d44c47d None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:20.933981 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb04089-9ec4-49b0-bfad-e02b3d44c47d None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:20.934147 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb04089-9ec4-49b0-bfad-e02b3d44c47d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:20.953817 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-bfb04089-9ec4-49b0-bfad-e02b3d44c47d None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:12:20.955015 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-bfb04089-9ec4-49b0-bfad-e02b3d44c47d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:12:20.984895 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88b9f61-03e3-486d-9131-ace9a075de6e None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:20.985167 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88b9f61-03e3-486d-9131-ace9a075de6e None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:20.985666 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88b9f61-03e3-486d-9131-ace9a075de6e None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:20.987027 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 525/1043] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:12:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 12:12:20.991884 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b882c85-4483-42e3-8cff-57bfa539fb16 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:20.992227 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b882c85-4483-42e3-8cff-57bfa539fb16 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:20.992568 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b882c85-4483-42e3-8cff-57bfa539fb16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:21.013033 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-0b882c85-4483-42e3-8cff-57bfa539fb16 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:12:21.015090 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-0b882c85-4483-42e3-8cff-57bfa539fb16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:12:21.032844 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 519/1044] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:12:20 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:12:21.090829 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 526/1045] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:12:20 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:12:21.243201 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5242304d-4d92-4d6c-b614-ce220ed79732 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:21.243486 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5242304d-4d92-4d6c-b614-ce220ed79732 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:21.243936 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5242304d-4d92-4d6c-b614-ce220ed79732 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:21.245405 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 520/1046] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:12:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:12:21.251205 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78226ce1-f96e-412b-9ac6-23c51f95f7ae None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:21.251762 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78226ce1-f96e-412b-9ac6-23c51f95f7ae None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:21.252031 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78226ce1-f96e-412b-9ac6-23c51f95f7ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:21.270722 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-78226ce1-f96e-412b-9ac6-23c51f95f7ae None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:12:21.271896 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-78226ce1-f96e-412b-9ac6-23c51f95f7ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:12:21.305829 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5242304d-4d92-4d6c-b614-ce220ed79732 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:21.340058 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 527/1047] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:12:21 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:12:21.362778 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78226ce1-f96e-412b-9ac6-23c51f95f7ae None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:21.402704 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:21.410516 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:21.412206 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5242304d-4d92-4d6c-b614-ce220ed79732 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:21.446858 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768ee6f8-991c-4c99-b644-ba8ac6a1a71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:21.447481 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768ee6f8-991c-4c99-b644-ba8ac6a1a71f None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:21.447756 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768ee6f8-991c-4c99-b644-ba8ac6a1a71f None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:21.448027 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768ee6f8-991c-4c99-b644-ba8ac6a1a71f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:21.449124 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768ee6f8-991c-4c99-b644-ba8ac6a1a71f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:21.450537 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768ee6f8-991c-4c99-b644-ba8ac6a1a71f None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:21.452791 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 521/1048] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:12:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:12:21.458086 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768ee6f8-991c-4c99-b644-ba8ac6a1a71f None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:21.475802 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78226ce1-f96e-412b-9ac6-23c51f95f7ae None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:21.511117 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a291a1-c613-41a1-85a2-b772f4cb2560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:21.511668 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a291a1-c613-41a1-85a2-b772f4cb2560 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:21.511939 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a291a1-c613-41a1-85a2-b772f4cb2560 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:21.512205 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a291a1-c613-41a1-85a2-b772f4cb2560 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:21.523643 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a291a1-c613-41a1-85a2-b772f4cb2560 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:12:21.528336 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-01a291a1-c613-41a1-85a2-b772f4cb2560 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 15 12:12:21.528336 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:12:21.528336 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:12:21.528336 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:12:21.528336 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:12:21.528336 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:12:21.528336 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:12:21.528336 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:12:21.528336 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:12:21.528336 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:12:21.528336 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:12:21.528336 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:12:21.528336 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:12:21.528336 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:12:21.528336 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:12:21.528336 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:12:21.530002 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:12:21.530002 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:12:21.530002 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:12:21.530002 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:12:21.530002 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:12:21.530002 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:12:21.530002 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:12:21.530002 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:12:21.530002 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:12:21.530002 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:12:21.530002 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:12:21.530002 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:12:21.530002 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:12:21.530002 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:12:21.530002 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:12:21.530002 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:12:21.531266 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:12:21.531266 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:12:21.531266 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:12:21.531266 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:12:21.531266 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:12:21.531266 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:12:21.531266 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:12:21.531266 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:12:21.531266 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:12:21.531266 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:12:21.531266 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 15 12:12:21.531266 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:12:21.531266 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 528/1049] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Sep 15 12:12:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:12:21.535793 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a291a1-c613-41a1-85a2-b772f4cb2560 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:21.561536 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768ee6f8-991c-4c99-b644-ba8ac6a1a71f None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:21.598175 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b1dfd-5ad1-489f-980d-ffc2b22a92ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:21.598815 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b1dfd-5ad1-489f-980d-ffc2b22a92ac None admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:21.599094 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b1dfd-5ad1-489f-980d-ffc2b22a92ac None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:21.599370 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b1dfd-5ad1-489f-980d-ffc2b22a92ac None admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:21.600014 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7b1dfd-5ad1-489f-980d-ffc2b22a92ac None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:21.601437 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7b1dfd-5ad1-489f-980d-ffc2b22a92ac None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:21.628361 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 522/1050] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Sep 15 12:12:21 2022] POST /identity/v3/users => generated 285 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 12:12:21.629139 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b1dfd-5ad1-489f-980d-ffc2b22a92ac None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:21.649558 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:21.657582 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:21.662930 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a291a1-c613-41a1-85a2-b772f4cb2560 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:21.704649 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb56bc6-b21d-46c4-8f49-d269503ca945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:21.705274 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb56bc6-b21d-46c4-8f49-d269503ca945 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:21.705548 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb56bc6-b21d-46c4-8f49-d269503ca945 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:21.705818 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb56bc6-b21d-46c4-8f49-d269503ca945 None admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:21.706489 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb56bc6-b21d-46c4-8f49-d269503ca945 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:12:21.706829 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb56bc6-b21d-46c4-8f49-d269503ca945 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:21.708215 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb56bc6-b21d-46c4-8f49-d269503ca945 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:21.718729 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 529/1051] 10.222.0.16 () {56 vars in 1115 bytes} [Thu Sep 15 12:12:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:12:21.724101 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb56bc6-b21d-46c4-8f49-d269503ca945 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:21.751941 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b1dfd-5ad1-489f-980d-ffc2b22a92ac None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:21.789384 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1308d5-f58b-4b69-975c-22e1a24f385a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:21.790056 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1308d5-f58b-4b69-975c-22e1a24f385a None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:21.790339 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1308d5-f58b-4b69-975c-22e1a24f385a None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:21.790743 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1308d5-f58b-4b69-975c-22e1a24f385a None admin] PATH_INFO: `/v3/services/image` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:21.791340 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1308d5-f58b-4b69-975c-22e1a24f385a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:21.792727 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1308d5-f58b-4b69-975c-22e1a24f385a None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:21.803038 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-8e1308d5-f58b-4b69-975c-22e1a24f385a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 15 12:12:21.803038 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:12:21.803038 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 12:12:21.803038 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 12:12:21.803038 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 12:12:21.803038 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 12:12:21.803038 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 12:12:21.803038 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:12:21.803038 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 15 12:12:21.803038 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:12:21.803038 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 12:12:21.803038 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:12:21.803038 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:12:21.803038 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:12:21.803038 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:12:21.803038 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:12:21.803038 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:12:21.804064 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:12:21.804064 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:12:21.804064 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:12:21.804064 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:12:21.804064 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:12:21.804064 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:12:21.804064 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 12:12:21.804064 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 12:12:21.804064 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 12:12:21.804064 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 12:12:21.804064 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:12:21.804064 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:12:21.804064 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:12:21.804064 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:12:21.804064 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:12:21.804064 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:12:21.807497 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:12:21.807497 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:12:21.807497 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:12:21.807497 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:12:21.807497 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:12:21.807497 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:12:21.807497 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:12:21.807497 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:12:21.807497 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:12:21.807497 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:12:21.807497 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 12:12:21.807497 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:12:21.807497 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 15 12:12:21.807497 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:12:21.807497 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 523/1052] 10.222.0.16 () {56 vars in 1105 bytes} [Thu Sep 15 12:12:21 2022] GET /identity/v3/services/image => generated 86 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:12:21.811834 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1308d5-f58b-4b69-975c-22e1a24f385a None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:21.838894 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb56bc6-b21d-46c4-8f49-d269503ca945 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:21.879852 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3208b4f-9464-4160-8d07-c0e8a0969865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:21.880486 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3208b4f-9464-4160-8d07-c0e8a0969865 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:21.880755 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3208b4f-9464-4160-8d07-c0e8a0969865 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:21.881063 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3208b4f-9464-4160-8d07-c0e8a0969865 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:21.893362 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3208b4f-9464-4160-8d07-c0e8a0969865 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:21.894828 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3208b4f-9464-4160-8d07-c0e8a0969865 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:21.903461 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:21.909902 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-f3208b4f-9464-4160-8d07-c0e8a0969865 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:12:21.909902 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:12:21.909902 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:12:21.909902 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:12:21.909902 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:12:21.909902 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:12:21.909902 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:12:21.909902 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:12:21.909902 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:12:21.909902 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:12:21.909902 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:12:21.909902 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:12:21.909902 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:12:21.909902 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:12:21.909902 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:12:21.909902 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:12:21.910912 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:12:21.910912 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:12:21.910912 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:12:21.910912 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:12:21.910912 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:12:21.910912 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:12:21.910912 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:12:21.910912 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:12:21.910912 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:12:21.910912 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:12:21.910912 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:12:21.910912 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:12:21.910912 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:12:21.910912 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:12:21.910912 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:12:21.910912 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:12:21.910912 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:12:21.911847 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:12:21.911847 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:12:21.911847 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:12:21.911847 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 530/1053] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:12:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:12:21.917477 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3208b4f-9464-4160-8d07-c0e8a0969865 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:21.926474 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1308d5-f58b-4b69-975c-22e1a24f385a None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:21.932724 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:21.962649 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937be03e-3133-4d93-86ad-fea34617fc1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:21.963324 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937be03e-3133-4d93-86ad-fea34617fc1f None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:21.963559 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937be03e-3133-4d93-86ad-fea34617fc1f None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:21.964076 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937be03e-3133-4d93-86ad-fea34617fc1f None admin] PATH_INFO: `/v3/services` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:21.964455 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937be03e-3133-4d93-86ad-fea34617fc1f None admin] RBAC: Adding query filter params (name=image) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:12:21.968024 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937be03e-3133-4d93-86ad-fea34617fc1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:21.968024 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937be03e-3133-4d93-86ad-fea34617fc1f None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:21.971821 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 524/1054] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:12:21 2022] GET /identity/v3/services?name=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:12:21.977516 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937be03e-3133-4d93-86ad-fea34617fc1f None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:22.037991 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3208b4f-9464-4160-8d07-c0e8a0969865 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:22.076388 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b49fae4-f2af-4170-ad4b-2dff60b5021b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:22.077027 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b49fae4-f2af-4170-ad4b-2dff60b5021b None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:22.077303 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b49fae4-f2af-4170-ad4b-2dff60b5021b None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:22.077751 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b49fae4-f2af-4170-ad4b-2dff60b5021b None admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:22.078314 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b49fae4-f2af-4170-ad4b-2dff60b5021b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:12:22.078642 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b49fae4-f2af-4170-ad4b-2dff60b5021b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:22.080129 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b49fae4-f2af-4170-ad4b-2dff60b5021b None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:22.083426 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937be03e-3133-4d93-86ad-fea34617fc1f None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:22.098069 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 531/1055] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 15 12:12:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:12:22.098769 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b49fae4-f2af-4170-ad4b-2dff60b5021b None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:22.117836 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc87200a-dca7-4e93-bc15-ed0a38f47dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:22.118446 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc87200a-dca7-4e93-bc15-ed0a38f47dbd None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:22.118741 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc87200a-dca7-4e93-bc15-ed0a38f47dbd None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:22.119015 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc87200a-dca7-4e93-bc15-ed0a38f47dbd None admin] PATH_INFO: `/v3/services` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:22.119644 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc87200a-dca7-4e93-bc15-ed0a38f47dbd None admin] RBAC: Adding query filter params (type=image) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:12:22.119945 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc87200a-dca7-4e93-bc15-ed0a38f47dbd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:22.121308 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc87200a-dca7-4e93-bc15-ed0a38f47dbd None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:22.131099 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 525/1056] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:12:21 2022] GET /identity/v3/services?type=image => generated 350 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:12:22.132071 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc87200a-dca7-4e93-bc15-ed0a38f47dbd None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:22.144761 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:22.179721 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:22.212157 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b49fae4-f2af-4170-ad4b-2dff60b5021b None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:22.241760 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc87200a-dca7-4e93-bc15-ed0a38f47dbd None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:22.252144 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131deb40-d46d-4630-82e1-7e9fa3eaa53b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:22.253546 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131deb40-d46d-4630-82e1-7e9fa3eaa53b None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:22.254298 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131deb40-d46d-4630-82e1-7e9fa3eaa53b None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:22.254846 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131deb40-d46d-4630-82e1-7e9fa3eaa53b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:22.264682 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131deb40-d46d-4630-82e1-7e9fa3eaa53b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:22.266522 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131deb40-d46d-4630-82e1-7e9fa3eaa53b None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:22.277758 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dc41cb-cf5d-4bcf-8938-a3170883cfd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:22.278546 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc41cb-cf5d-4bcf-8938-a3170883cfd9 None admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:22.279545 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc41cb-cf5d-4bcf-8938-a3170883cfd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:22.279968 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc41cb-cf5d-4bcf-8938-a3170883cfd9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:22.280189 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-131deb40-d46d-4630-82e1-7e9fa3eaa53b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 15 12:12:22.280189 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:12:22.280189 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:12:22.280189 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:12:22.280189 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:12:22.280189 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:12:22.280189 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:12:22.280189 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:12:22.280189 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:12:22.280189 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:12:22.280189 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:12:22.280189 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:12:22.280189 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 12:12:22.280189 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 12:12:22.280189 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 12:12:22.280189 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 12:12:22.281301 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:12:22.281301 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:12:22.281301 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 12:12:22.281301 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:12:22.281301 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 12:12:22.281301 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:12:22.281301 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:12:22.281301 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:12:22.281301 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:12:22.281301 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:12:22.281301 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:12:22.281301 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:12:22.281301 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:12:22.281301 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:12:22.281301 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:12:22.281301 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:12:22.281301 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:12:22.281301 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:12:22.282269 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:12:22.282269 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:12:22.282269 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 12:12:22.282269 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 12:12:22.282269 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 12:12:22.282269 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 12:12:22.282269 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 12:12:22.282269 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 12:12:22.282269 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 15 12:12:22.282269 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:12:22.282269 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 532/1057] 10.222.0.16 () {56 vars in 1093 bytes} [Thu Sep 15 12:12:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:12:22.283383 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dc41cb-cf5d-4bcf-8938-a3170883cfd9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:22.284752 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dc41cb-cf5d-4bcf-8938-a3170883cfd9 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:22.286820 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131deb40-d46d-4630-82e1-7e9fa3eaa53b None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:22.310747 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 526/1058] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:12:22 2022] POST /identity/v3/endpoints => generated 327 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:12:22.399276 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131deb40-d46d-4630-82e1-7e9fa3eaa53b None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:22.430958 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:22.445285 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2326eab7-32f6-4f05-806d-aa54ba8ecda9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:22.445900 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2326eab7-32f6-4f05-806d-aa54ba8ecda9 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:22.446177 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2326eab7-32f6-4f05-806d-aa54ba8ecda9 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:22.446443 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2326eab7-32f6-4f05-806d-aa54ba8ecda9 None admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:22.447206 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2326eab7-32f6-4f05-806d-aa54ba8ecda9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:12:22.447513 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2326eab7-32f6-4f05-806d-aa54ba8ecda9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:22.448986 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2326eab7-32f6-4f05-806d-aa54ba8ecda9 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:22.473659 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 533/1059] 10.222.0.16 () {56 vars in 1133 bytes} [Thu Sep 15 12:12:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:12:22.474931 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dc41cb-cf5d-4bcf-8938-a3170883cfd9 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:22.549151 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:22.590004 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dc41cb-cf5d-4bcf-8938-a3170883cfd9 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:22.624640 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2e9c5e-9360-4162-aab9-ec81c4b55109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:22.625290 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e9c5e-9360-4162-aab9-ec81c4b55109 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:22.625565 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e9c5e-9360-4162-aab9-ec81c4b55109 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:22.625831 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e9c5e-9360-4162-aab9-ec81c4b55109 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:22.636495 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2e9c5e-9360-4162-aab9-ec81c4b55109 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:22.637928 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2e9c5e-9360-4162-aab9-ec81c4b55109 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:22.652299 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-dc2e9c5e-9360-4162-aab9-ec81c4b55109 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:12:22.652299 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:12:22.652299 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:12:22.652299 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:12:22.652299 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:12:22.652299 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:12:22.652299 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:12:22.652299 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:12:22.652299 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:12:22.652299 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:12:22.652299 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:12:22.652299 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:12:22.652299 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:12:22.652299 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:12:22.652299 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:12:22.652299 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:12:22.653223 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:12:22.653223 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:12:22.653223 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:12:22.653223 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:12:22.653223 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:12:22.653223 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:12:22.653223 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:12:22.653223 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:12:22.653223 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:12:22.653223 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:12:22.653223 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:12:22.653223 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:12:22.653223 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:12:22.653223 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:12:22.653223 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:12:22.653223 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:12:22.653223 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:12:22.654132 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:12:22.654132 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:12:22.654132 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:12:22.654132 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 527/1060] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:12:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:12:22.659220 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2326eab7-32f6-4f05-806d-aa54ba8ecda9 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:22.759570 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2326eab7-32f6-4f05-806d-aa54ba8ecda9 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:22.793087 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41d6f27-a371-47c2-acbe-7175d44812a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:22.793695 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d6f27-a371-47c2-acbe-7175d44812a7 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:22.793974 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d6f27-a371-47c2-acbe-7175d44812a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:22.794244 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d6f27-a371-47c2-acbe-7175d44812a7 None admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:22.795427 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41d6f27-a371-47c2-acbe-7175d44812a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:12:22.795729 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41d6f27-a371-47c2-acbe-7175d44812a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:22.797095 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41d6f27-a371-47c2-acbe-7175d44812a7 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:22.813481 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 534/1061] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 15 12:12:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:12:22.814726 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2e9c5e-9360-4162-aab9-ec81c4b55109 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:22.918396 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2e9c5e-9360-4162-aab9-ec81c4b55109 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:22.936390 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:22.954194 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263bc763-36a2-460e-94f7-334536cd54d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:22.954855 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263bc763-36a2-460e-94f7-334536cd54d1 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:22.955137 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263bc763-36a2-460e-94f7-334536cd54d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:22.955408 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263bc763-36a2-460e-94f7-334536cd54d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:22.962107 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263bc763-36a2-460e-94f7-334536cd54d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:22.963579 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263bc763-36a2-460e-94f7-334536cd54d1 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:22.978190 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-263bc763-36a2-460e-94f7-334536cd54d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:12:22.978190 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:12:22.978190 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:12:22.978190 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:12:22.978190 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:12:22.978190 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:12:22.978190 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:12:22.978190 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:12:22.978190 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:12:22.978190 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:12:22.978190 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:12:22.978190 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:12:22.978190 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 12:12:22.978190 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 12:12:22.978190 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 12:12:22.979155 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 12:12:22.979155 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:12:22.979155 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:12:22.979155 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:12:22.979155 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:12:22.979155 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:12:22.979155 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:12:22.979155 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:12:22.979155 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:12:22.979155 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:12:22.979155 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:12:22.979155 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:12:22.979155 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:12:22.979155 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:12:22.979155 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:12:22.979155 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:12:22.979155 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:12:22.980051 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 12:12:22.980051 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 12:12:22.980051 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 12:12:22.980051 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 12:12:22.980051 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 12:12:22.980051 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 12:12:22.980051 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:12:22.980051 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:12:22.981106 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 528/1062] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 15 12:12:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:12:22.985713 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41d6f27-a371-47c2-acbe-7175d44812a7 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:23.034273 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:23.090017 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41d6f27-a371-47c2-acbe-7175d44812a7 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:23.123430 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea110e3-e5a1-43ee-ad78-4c8998a332c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:23.124025 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea110e3-e5a1-43ee-ad78-4c8998a332c4 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:23.124299 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea110e3-e5a1-43ee-ad78-4c8998a332c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:23.124565 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea110e3-e5a1-43ee-ad78-4c8998a332c4 None admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:23.125356 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea110e3-e5a1-43ee-ad78-4c8998a332c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:12:23.125663 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea110e3-e5a1-43ee-ad78-4c8998a332c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:23.127357 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea110e3-e5a1-43ee-ad78-4c8998a332c4 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:23.139221 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 535/1063] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Sep 15 12:12:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:12:23.144905 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263bc763-36a2-460e-94f7-334536cd54d1 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:23.250542 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263bc763-36a2-460e-94f7-334536cd54d1 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:23.284122 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ecb328-ae60-48cb-a318-404212a0e3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:23.284782 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ecb328-ae60-48cb-a318-404212a0e3a6 None admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:23.285062 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ecb328-ae60-48cb-a318-404212a0e3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:23.285336 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ecb328-ae60-48cb-a318-404212a0e3a6 None admin] PATH_INFO: `/v3/projects/cab958c081ad4a92939d4469cf4ce1c6/users/9d05c52570474820b4ba0e2cdad5c13f/roles/4ceb69a86bf04a2ebb1f56b197006b3c` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:23.287500 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ecb328-ae60-48cb-a318-404212a0e3a6 None admin] RBAC: Authorizing `identity:create_grant(project_id=cab958c081ad4a92939d4469cf4ce1c6, user_id=9d05c52570474820b4ba0e2cdad5c13f, role_id=4ceb69a86bf04a2ebb1f56b197006b3c)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:23.288932 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ecb328-ae60-48cb-a318-404212a0e3a6 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:23.302816 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 529/1064] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Sep 15 12:12:23 2022] PUT /identity/v3/projects/cab958c081ad4a92939d4469cf4ce1c6/users/9d05c52570474820b4ba0e2cdad5c13f/roles/4ceb69a86bf04a2ebb1f56b197006b3c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:12:23.856207 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58578c45-3127-4842-9c02-6a74a2cc5bf0 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:23.856537 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58578c45-3127-4842-9c02-6a74a2cc5bf0 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:23.856765 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58578c45-3127-4842-9c02-6a74a2cc5bf0 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:23.858451 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 536/1065] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:12:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:12:23.863684 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ae7d4-2139-4f98-b2c7-7c9fa07e543e None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:23.863974 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ae7d4-2139-4f98-b2c7-7c9fa07e543e None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:23.864244 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ae7d4-2139-4f98-b2c7-7c9fa07e543e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:23.882446 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-801ae7d4-2139-4f98-b2c7-7c9fa07e543e None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:12:23.883659 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-801ae7d4-2139-4f98-b2c7-7c9fa07e543e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:12:23.914276 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:23.958793 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 530/1066] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:12:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:12:24.224222 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58578c45-3127-4842-9c02-6a74a2cc5bf0 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:24.330386 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58578c45-3127-4842-9c02-6a74a2cc5bf0 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:24.337626 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:24.366567 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e74b704-4de4-4d90-be00-22faef21950b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:24.367255 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e74b704-4de4-4d90-be00-22faef21950b None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:24.367535 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e74b704-4de4-4d90-be00-22faef21950b None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:24.367806 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e74b704-4de4-4d90-be00-22faef21950b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:24.380238 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e74b704-4de4-4d90-be00-22faef21950b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:12:24.385249 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-5e74b704-4de4-4d90-be00-22faef21950b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:12:24.385249 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:12:24.385249 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:12:24.385249 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:12:24.385249 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:12:24.385249 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:12:24.385249 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:12:24.385249 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:12:24.385249 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:12:24.385249 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:12:24.385249 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:12:24.385249 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:12:24.385249 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:12:24.385249 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:12:24.385249 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:12:24.385249 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:12:24.386284 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:12:24.386284 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:12:24.386284 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:12:24.386284 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:12:24.386284 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:12:24.386284 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:12:24.386284 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:12:24.386284 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:12:24.386284 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:12:24.386284 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:12:24.386284 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:12:24.386284 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:12:24.386284 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:12:24.386284 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:12:24.386284 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:12:24.386284 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:12:24.387186 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:12:24.387186 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:12:24.387186 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:12:24.387186 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:12:24.387186 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:12:24.387186 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:12:24.387186 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:12:24.387186 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:12:24.387186 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:12:24.387186 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:12:24.387186 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:12:24.387186 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:12:24.390823 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 537/1067] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Sep 15 12:12:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:12:24.393558 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801ae7d4-2139-4f98-b2c7-7c9fa07e543e None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:24.481362 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288465ce-35df-48e1-895d-142cf2aed6a1 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:24.481539 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288465ce-35df-48e1-895d-142cf2aed6a1 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:24.481852 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288465ce-35df-48e1-895d-142cf2aed6a1 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:24.483964 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 538/1068] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:12:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 12:12:24.488615 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e19c6e1-3f4c-4fdb-9062-040caf252b95 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:24.488894 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e19c6e1-3f4c-4fdb-9062-040caf252b95 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:24.489163 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e19c6e1-3f4c-4fdb-9062-040caf252b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:24.498591 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801ae7d4-2139-4f98-b2c7-7c9fa07e543e None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:24.506884 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-1e19c6e1-3f4c-4fdb-9062-040caf252b95 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:12:24.508052 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-1e19c6e1-3f4c-4fdb-9062-040caf252b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:12:24.536575 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2de3da-469f-4f85-ac61-dcfaffe72687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:24.537200 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2de3da-469f-4f85-ac61-dcfaffe72687 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:24.537475 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2de3da-469f-4f85-ac61-dcfaffe72687 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:24.537748 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2de3da-469f-4f85-ac61-dcfaffe72687 None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:24.538411 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2de3da-469f-4f85-ac61-dcfaffe72687 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:12:24.538739 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2de3da-469f-4f85-ac61-dcfaffe72687 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:24.540109 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2de3da-469f-4f85-ac61-dcfaffe72687 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:24.548437 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 531/1069] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 15 12:12:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:12:24.555054 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2de3da-469f-4f85-ac61-dcfaffe72687 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:24.583231 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 539/1070] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:12:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 12:12:24.591004 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:24.663981 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2de3da-469f-4f85-ac61-dcfaffe72687 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:24.697596 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9abb25d-4b71-4d0b-b5ba-f59a55266b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:24.698219 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9abb25d-4b71-4d0b-b5ba-f59a55266b72 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:24.698497 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9abb25d-4b71-4d0b-b5ba-f59a55266b72 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:24.698793 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9abb25d-4b71-4d0b-b5ba-f59a55266b72 None admin] PATH_INFO: `/v3/users/26f2ac2338a843bbbe4fcc5c8ca69a77` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:24.719419 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9abb25d-4b71-4d0b-b5ba-f59a55266b72 None admin] RBAC: Authorizing `identity:get_user(user_id=26f2ac2338a843bbbe4fcc5c8ca69a77)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:24.721759 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9abb25d-4b71-4d0b-b5ba-f59a55266b72 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:24.728231 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 532/1071] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 15 12:12:24 2022] GET /identity/v3/users/26f2ac2338a843bbbe4fcc5c8ca69a77 => generated 285 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:12:24.729812 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e19c6e1-3f4c-4fdb-9062-040caf252b95 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:24.823826 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:24.831814 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e19c6e1-3f4c-4fdb-9062-040caf252b95 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:24.866032 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89301b55-24e2-4dfe-88e7-cfabc33b469e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:24.866643 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89301b55-24e2-4dfe-88e7-cfabc33b469e None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:24.866946 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89301b55-24e2-4dfe-88e7-cfabc33b469e None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:24.867217 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89301b55-24e2-4dfe-88e7-cfabc33b469e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:24.880629 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9abb25d-4b71-4d0b-b5ba-f59a55266b72 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:24.940956 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89301b55-24e2-4dfe-88e7-cfabc33b469e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:24.942397 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89301b55-24e2-4dfe-88e7-cfabc33b469e None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:24.979425 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:24.992361 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9abb25d-4b71-4d0b-b5ba-f59a55266b72 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:25.028759 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5421adda-4c31-4d01-8a50-e4e069eb1f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:25.029367 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5421adda-4c31-4d01-8a50-e4e069eb1f06 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:25.029643 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5421adda-4c31-4d01-8a50-e4e069eb1f06 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:25.030265 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5421adda-4c31-4d01-8a50-e4e069eb1f06 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:25.049361 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:25.056676 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 540/1072] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 15 12:12:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 15 12:12:25.063244 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89301b55-24e2-4dfe-88e7-cfabc33b469e None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:25.107514 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5421adda-4c31-4d01-8a50-e4e069eb1f06 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:25.108617 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5421adda-4c31-4d01-8a50-e4e069eb1f06 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:25.179070 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89301b55-24e2-4dfe-88e7-cfabc33b469e None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:25.193390 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:25.206454 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 533/1073] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 15 12:12:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 12:12:25.212184 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5421adda-4c31-4d01-8a50-e4e069eb1f06 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:25.223525 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31f10c2-a56f-4ba4-a4e1-d622d7ce377b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:25.224156 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f10c2-a56f-4ba4-a4e1-d622d7ce377b None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:25.224431 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f10c2-a56f-4ba4-a4e1-d622d7ce377b None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:25.224957 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f10c2-a56f-4ba4-a4e1-d622d7ce377b None admin] PATH_INFO: `/v3/projects/d73662fc0d3c413bb78e2fa054345895` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:25.225792 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31f10c2-a56f-4ba4-a4e1-d622d7ce377b None admin] RBAC: Authorizing `identity:get_project(project_id=d73662fc0d3c413bb78e2fa054345895)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:25.227265 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31f10c2-a56f-4ba4-a4e1-d622d7ce377b None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:25.228880 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 541/1074] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 15 12:12:25 2022] GET /identity/v3/projects/d73662fc0d3c413bb78e2fa054345895 => generated 311 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:12:25.235747 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31f10c2-a56f-4ba4-a4e1-d622d7ce377b None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:25.297321 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:25.330141 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5421adda-4c31-4d01-8a50-e4e069eb1f06 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:25.338968 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31f10c2-a56f-4ba4-a4e1-d622d7ce377b None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:25.370891 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ae3e70-6d4c-402d-b73c-91995dfc94ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:25.371718 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae3e70-6d4c-402d-b73c-91995dfc94ff None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:25.371999 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae3e70-6d4c-402d-b73c-91995dfc94ff None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:25.372417 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae3e70-6d4c-402d-b73c-91995dfc94ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:25.378083 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b3942c-4e32-460e-9441-a7f96b0aa62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:25.378684 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b3942c-4e32-460e-9441-a7f96b0aa62d None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:25.378985 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b3942c-4e32-460e-9441-a7f96b0aa62d None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:25.379255 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b3942c-4e32-460e-9441-a7f96b0aa62d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:25.379977 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b3942c-4e32-460e-9441-a7f96b0aa62d None admin] RBAC: Adding query filter params (role.id=7f53f1c823b746529ba5057bf21b2477, scope.project.id=d73662fc0d3c413bb78e2fa054345895, user.id=26f2ac2338a843bbbe4fcc5c8ca69a77) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:12:25.380293 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b3942c-4e32-460e-9441-a7f96b0aa62d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:25.381707 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b3942c-4e32-460e-9441-a7f96b0aa62d None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:25.384849 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ae3e70-6d4c-402d-b73c-91995dfc94ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:25.386808 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ae3e70-6d4c-402d-b73c-91995dfc94ff None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:25.387444 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 542/1075] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 15 12:12:25 2022] GET /identity/v3/role_assignments?user.id=26f2ac2338a843bbbe4fcc5c8ca69a77&scope.project.id=d73662fc0d3c413bb78e2fa054345895&role.id=7f53f1c823b746529ba5057bf21b2477 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:12:25.415786 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-81ae3e70-6d4c-402d-b73c-91995dfc94ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:12:25.415786 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:12:25.415786 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:12:25.415786 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:12:25.415786 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:12:25.415786 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:12:25.415786 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:12:25.415786 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:12:25.415786 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:12:25.415786 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:12:25.415786 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:12:25.415786 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:12:25.415786 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:12:25.415786 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:12:25.415786 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:12:25.415786 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:12:25.417137 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:12:25.417137 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:12:25.417137 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:12:25.417137 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:12:25.417137 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:12:25.417137 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:12:25.417137 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:12:25.417137 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:12:25.417137 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:12:25.417137 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:12:25.417137 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:12:25.417137 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:12:25.417137 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:12:25.417137 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:12:25.417137 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:12:25.417137 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:12:25.417137 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:12:25.418312 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:12:25.418312 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:12:25.418312 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:12:25.419140 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 534/1076] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:12:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:12:25.423210 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b3942c-4e32-460e-9441-a7f96b0aa62d None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:25.455346 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d99ec-7c57-47a2-827a-bafc9f650268 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:25.455619 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d99ec-7c57-47a2-827a-bafc9f650268 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:25.455922 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d99ec-7c57-47a2-827a-bafc9f650268 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:25.457274 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 535/1077] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:12:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:12:25.463660 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564395ac-003f-40ae-a57e-e068797e3334 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:25.463936 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564395ac-003f-40ae-a57e-e068797e3334 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:25.464205 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564395ac-003f-40ae-a57e-e068797e3334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:25.482716 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-564395ac-003f-40ae-a57e-e068797e3334 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:12:25.483960 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-564395ac-003f-40ae-a57e-e068797e3334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:12:25.523677 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:25.547964 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b3942c-4e32-460e-9441-a7f96b0aa62d None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:25.564291 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 536/1078] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:12:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 12:12:25.581022 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:25.589907 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7fa616-bdf1-43c5-9843-0a6e00fd2c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:25.590510 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7fa616-bdf1-43c5-9843-0a6e00fd2c66 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:25.590840 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7fa616-bdf1-43c5-9843-0a6e00fd2c66 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:25.591110 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7fa616-bdf1-43c5-9843-0a6e00fd2c66 None admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:25.592251 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7fa616-bdf1-43c5-9843-0a6e00fd2c66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:12:25.592550 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7fa616-bdf1-43c5-9843-0a6e00fd2c66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:25.593903 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7fa616-bdf1-43c5-9843-0a6e00fd2c66 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:25.606025 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 543/1079] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 15 12:12:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:12:25.833935 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564395ac-003f-40ae-a57e-e068797e3334 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:25.939745 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564395ac-003f-40ae-a57e-e068797e3334 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:25.972234 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c3e080-8e0c-4809-9646-34913f148a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:25.972870 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c3e080-8e0c-4809-9646-34913f148a1f None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:25.973145 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c3e080-8e0c-4809-9646-34913f148a1f None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:25.973412 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c3e080-8e0c-4809-9646-34913f148a1f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:25.984350 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c3e080-8e0c-4809-9646-34913f148a1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:12:25.989091 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-c8c3e080-8e0c-4809-9646-34913f148a1f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 15 12:12:25.989091 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:12:25.989091 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:12:25.989091 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:12:25.989091 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:12:25.989091 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:12:25.989091 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:12:25.989091 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:12:25.989091 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:12:25.989091 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:12:25.989091 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:12:25.989091 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:12:25.989091 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:12:25.989091 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:12:25.989091 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:12:25.989091 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:12:25.990179 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:12:25.990179 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:12:25.990179 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:12:25.990179 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:12:25.990179 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:12:25.990179 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:12:25.990179 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:12:25.990179 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:12:25.990179 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:12:25.990179 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:12:25.990179 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:12:25.990179 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:12:25.990179 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:12:25.990179 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:12:25.990179 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:12:25.990179 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:12:25.991252 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:12:25.991252 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:12:25.991252 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:12:25.991252 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:12:25.991252 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:12:25.991252 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:12:25.991252 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:12:25.991252 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:12:25.991252 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:12:25.991252 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:12:25.991252 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 15 12:12:25.991252 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:12:25.992178 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 537/1080] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Sep 15 12:12:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:12:25.996056 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7fa616-bdf1-43c5-9843-0a6e00fd2c66 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:26.093217 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7fa616-bdf1-43c5-9843-0a6e00fd2c66 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:26.127757 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdb884c-3a86-4168-8b50-87c0449dc8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:26.128354 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb884c-3a86-4168-8b50-87c0449dc8b9 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:26.128627 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb884c-3a86-4168-8b50-87c0449dc8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:26.128892 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb884c-3a86-4168-8b50-87c0449dc8b9 None admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:26.129549 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdb884c-3a86-4168-8b50-87c0449dc8b9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:12:26.129849 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdb884c-3a86-4168-8b50-87c0449dc8b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:26.131235 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdb884c-3a86-4168-8b50-87c0449dc8b9 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:26.139057 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 544/1081] 10.222.0.16 () {56 vars in 1115 bytes} [Thu Sep 15 12:12:25 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:12:26.144756 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c3e080-8e0c-4809-9646-34913f148a1f None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:26.174911 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:26.246185 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c3e080-8e0c-4809-9646-34913f148a1f None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:26.281800 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b847f8e1-50be-41ac-9683-e14fd8fd9966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:26.282428 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b847f8e1-50be-41ac-9683-e14fd8fd9966 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:26.282726 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b847f8e1-50be-41ac-9683-e14fd8fd9966 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:26.283000 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b847f8e1-50be-41ac-9683-e14fd8fd9966 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:26.293111 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b847f8e1-50be-41ac-9683-e14fd8fd9966 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:26.295128 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b847f8e1-50be-41ac-9683-e14fd8fd9966 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:26.309322 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-b847f8e1-50be-41ac-9683-e14fd8fd9966 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:12:26.309322 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:12:26.309322 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:12:26.309322 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:12:26.309322 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:12:26.309322 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:12:26.309322 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:12:26.309322 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:12:26.309322 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:12:26.309322 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:12:26.309322 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:12:26.309322 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:12:26.309322 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:12:26.309322 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:12:26.309322 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:12:26.309322 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:12:26.310426 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:12:26.310426 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:12:26.310426 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:12:26.310426 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:12:26.310426 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:12:26.310426 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:12:26.310426 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:12:26.310426 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:12:26.310426 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:12:26.310426 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:12:26.310426 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:12:26.310426 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:12:26.310426 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:12:26.310426 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:12:26.310426 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:12:26.310426 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:12:26.310426 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:12:26.311422 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:12:26.311422 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:12:26.311422 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:12:26.311422 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 538/1082] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:12:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:12:26.316279 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdb884c-3a86-4168-8b50-87c0449dc8b9 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:26.365855 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:26.414087 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdb884c-3a86-4168-8b50-87c0449dc8b9 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:26.446018 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c5b861-a515-448e-80d7-735b69ed87ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:26.446603 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c5b861-a515-448e-80d7-735b69ed87ec None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:26.446904 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c5b861-a515-448e-80d7-735b69ed87ec None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:26.447173 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c5b861-a515-448e-80d7-735b69ed87ec None admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:26.447799 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c5b861-a515-448e-80d7-735b69ed87ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:12:26.448097 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c5b861-a515-448e-80d7-735b69ed87ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:26.449432 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c5b861-a515-448e-80d7-735b69ed87ec None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:26.460619 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 545/1083] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 15 12:12:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:12:26.466715 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b847f8e1-50be-41ac-9683-e14fd8fd9966 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:26.551511 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:26.569890 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b847f8e1-50be-41ac-9683-e14fd8fd9966 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:26.602813 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdc698b-0ac6-4f7a-b8de-54ca090a98a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:26.603435 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc698b-0ac6-4f7a-b8de-54ca090a98a2 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:26.603709 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc698b-0ac6-4f7a-b8de-54ca090a98a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:26.603977 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc698b-0ac6-4f7a-b8de-54ca090a98a2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:26.612353 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdc698b-0ac6-4f7a-b8de-54ca090a98a2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:26.613813 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdc698b-0ac6-4f7a-b8de-54ca090a98a2 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:26.624894 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-6cdc698b-0ac6-4f7a-b8de-54ca090a98a2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 15 12:12:26.624894 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:12:26.624894 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:12:26.624894 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:12:26.624894 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:12:26.624894 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:12:26.624894 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:12:26.624894 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:12:26.624894 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:12:26.624894 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:12:26.624894 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:12:26.624894 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:12:26.624894 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 12:12:26.624894 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 12:12:26.624894 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 12:12:26.624894 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 12:12:26.625984 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:12:26.625984 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:12:26.625984 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 12:12:26.625984 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:12:26.625984 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 12:12:26.625984 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:12:26.625984 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:12:26.625984 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:12:26.625984 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:12:26.625984 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:12:26.625984 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:12:26.625984 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:12:26.625984 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:12:26.625984 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:12:26.625984 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:12:26.625984 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:12:26.625984 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:12:26.625984 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:12:26.627224 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:12:26.627224 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:12:26.627224 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 12:12:26.627224 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 12:12:26.627224 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 12:12:26.627224 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 12:12:26.627224 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 12:12:26.627224 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 12:12:26.627224 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 15 12:12:26.627224 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:12:26.627224 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 539/1084] 10.222.0.16 () {56 vars in 1093 bytes} [Thu Sep 15 12:12:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:12:26.632062 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c5b861-a515-448e-80d7-735b69ed87ec None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:26.726879 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c5b861-a515-448e-80d7-735b69ed87ec None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:26.737609 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:26.761686 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc93a78-5655-4541-b0d1-d8bd4ddacb5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:26.762275 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc93a78-5655-4541-b0d1-d8bd4ddacb5f None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:26.762548 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc93a78-5655-4541-b0d1-d8bd4ddacb5f None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:26.762844 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc93a78-5655-4541-b0d1-d8bd4ddacb5f None admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:26.763583 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc93a78-5655-4541-b0d1-d8bd4ddacb5f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:12:26.763881 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc93a78-5655-4541-b0d1-d8bd4ddacb5f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:26.765277 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc93a78-5655-4541-b0d1-d8bd4ddacb5f None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:26.781687 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 546/1085] 10.222.0.16 () {56 vars in 1133 bytes} [Thu Sep 15 12:12:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:12:26.787377 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdc698b-0ac6-4f7a-b8de-54ca090a98a2 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:26.883708 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdc698b-0ac6-4f7a-b8de-54ca090a98a2 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:26.915984 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43a5333-5c61-41b9-a551-a5d95d64a998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:26.916581 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a5333-5c61-41b9-a551-a5d95d64a998 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:26.916856 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a5333-5c61-41b9-a551-a5d95d64a998 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:26.917126 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a5333-5c61-41b9-a551-a5d95d64a998 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:26.929528 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:26.987893 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43a5333-5c61-41b9-a551-a5d95d64a998 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:26.989333 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43a5333-5c61-41b9-a551-a5d95d64a998 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:27.082167 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 540/1086] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 15 12:12:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 15 12:12:27.087946 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc93a78-5655-4541-b0d1-d8bd4ddacb5f None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:27.184419 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc93a78-5655-4541-b0d1-d8bd4ddacb5f None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:27.217069 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b6575-0fca-4ebc-ba9b-845471cfd55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:27.217687 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b6575-0fca-4ebc-ba9b-845471cfd55f None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:27.217958 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b6575-0fca-4ebc-ba9b-845471cfd55f None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:27.218223 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b6575-0fca-4ebc-ba9b-845471cfd55f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:27.228027 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9b6575-0fca-4ebc-ba9b-845471cfd55f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:27.229449 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9b6575-0fca-4ebc-ba9b-845471cfd55f None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:27.244023 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-5b9b6575-0fca-4ebc-ba9b-845471cfd55f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:12:27.244023 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:12:27.244023 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:12:27.244023 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:12:27.244023 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:12:27.244023 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:12:27.244023 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:12:27.244023 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:12:27.244023 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:12:27.244023 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:12:27.244023 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:12:27.244023 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:12:27.244023 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:12:27.244023 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:12:27.244023 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:12:27.244023 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:12:27.244948 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:12:27.244948 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:12:27.244948 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:12:27.244948 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:12:27.244948 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:12:27.244948 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:12:27.244948 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:12:27.244948 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:12:27.244948 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:12:27.244948 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:12:27.244948 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:12:27.244948 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:12:27.244948 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:12:27.244948 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:12:27.244948 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:12:27.244948 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:12:27.244948 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:12:27.245837 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:12:27.245837 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:12:27.245837 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:12:27.245837 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 547/1087] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:12:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:12:27.250805 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43a5333-5c61-41b9-a551-a5d95d64a998 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:27.295455 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:27.351004 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43a5333-5c61-41b9-a551-a5d95d64a998 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:27.383745 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d9e3a2-d7d4-4d52-8669-db98879d17f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:27.384338 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d9e3a2-d7d4-4d52-8669-db98879d17f7 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:27.384614 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d9e3a2-d7d4-4d52-8669-db98879d17f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:27.384879 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d9e3a2-d7d4-4d52-8669-db98879d17f7 None admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:27.385505 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d9e3a2-d7d4-4d52-8669-db98879d17f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:12:27.385799 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d9e3a2-d7d4-4d52-8669-db98879d17f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:27.387187 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d9e3a2-d7d4-4d52-8669-db98879d17f7 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:27.398545 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 541/1088] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 15 12:12:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:12:27.404712 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b6575-0fca-4ebc-ba9b-845471cfd55f None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:27.425860 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:27.507280 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b6575-0fca-4ebc-ba9b-845471cfd55f None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:27.540246 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d1988d-e864-4c4c-a3c9-ab90044c4f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:27.540861 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d1988d-e864-4c4c-a3c9-ab90044c4f30 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:27.541135 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d1988d-e864-4c4c-a3c9-ab90044c4f30 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:27.541400 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d1988d-e864-4c4c-a3c9-ab90044c4f30 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:27.547879 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d1988d-e864-4c4c-a3c9-ab90044c4f30 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:27.549287 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d1988d-e864-4c4c-a3c9-ab90044c4f30 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:27.558121 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2de789-33ea-43b9-af62-bb9799cdee27 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:27.558586 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2de789-33ea-43b9-af62-bb9799cdee27 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:27.558675 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2de789-33ea-43b9-af62-bb9799cdee27 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:27.560200 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 542/1089] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:12:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:12:27.560330 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-c8d1988d-e864-4c4c-a3c9-ab90044c4f30 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:12:27.560330 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:12:27.560330 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:12:27.560330 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:12:27.560330 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:12:27.560330 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:12:27.560330 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:12:27.560330 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:12:27.560330 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:12:27.560330 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:12:27.560330 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:12:27.560330 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:12:27.560330 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 12:12:27.560330 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 12:12:27.560330 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 12:12:27.561239 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 12:12:27.561239 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:12:27.561239 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:12:27.561239 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:12:27.561239 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:12:27.561239 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:12:27.561239 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:12:27.561239 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:12:27.561239 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:12:27.561239 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:12:27.561239 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:12:27.561239 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:12:27.561239 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:12:27.561239 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:12:27.561239 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:12:27.561239 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:12:27.561239 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:12:27.562151 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 12:12:27.562151 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 12:12:27.562151 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 12:12:27.562151 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 12:12:27.562151 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 12:12:27.562151 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 12:12:27.562151 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:12:27.562151 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:12:27.562151 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 548/1090] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 15 12:12:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:12:27.566743 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f299bc-ade1-4d2c-9fed-e350f4b0e600 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:27.566989 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d1988d-e864-4c4c-a3c9-ab90044c4f30 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:27.567092 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f299bc-ade1-4d2c-9fed-e350f4b0e600 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:27.567358 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f299bc-ade1-4d2c-9fed-e350f4b0e600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:27.586143 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-e4f299bc-ade1-4d2c-9fed-e350f4b0e600 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:12:27.587343 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-e4f299bc-ade1-4d2c-9fed-e350f4b0e600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:12:27.647656 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:27.654029 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 543/1091] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:12:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:12:27.666613 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d1988d-e864-4c4c-a3c9-ab90044c4f30 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:27.699629 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57648727-9e28-4a2d-9684-616e4cc44a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:27.700223 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57648727-9e28-4a2d-9684-616e4cc44a59 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:27.700500 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57648727-9e28-4a2d-9684-616e4cc44a59 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:27.700768 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57648727-9e28-4a2d-9684-616e4cc44a59 None admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:27.701454 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57648727-9e28-4a2d-9684-616e4cc44a59 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:12:27.701755 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57648727-9e28-4a2d-9684-616e4cc44a59 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:27.703192 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57648727-9e28-4a2d-9684-616e4cc44a59 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:27.714681 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 549/1092] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Sep 15 12:12:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:12:27.720933 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f299bc-ade1-4d2c-9fed-e350f4b0e600 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:27.751095 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:27.817531 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f299bc-ade1-4d2c-9fed-e350f4b0e600 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:27.849900 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0f75d6-0a0d-4201-a2dc-bf253382ade1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:27.850488 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f75d6-0a0d-4201-a2dc-bf253382ade1 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:27.850794 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f75d6-0a0d-4201-a2dc-bf253382ade1 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:27.851066 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f75d6-0a0d-4201-a2dc-bf253382ade1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:27.851778 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0f75d6-0a0d-4201-a2dc-bf253382ade1 None admin] RBAC: Adding query filter params (role.id=4ceb69a86bf04a2ebb1f56b197006b3c, scope.project.id=cab958c081ad4a92939d4469cf4ce1c6, user.id=9d05c52570474820b4ba0e2cdad5c13f) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:12:27.852082 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0f75d6-0a0d-4201-a2dc-bf253382ade1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:27.853495 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0f75d6-0a0d-4201-a2dc-bf253382ade1 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:27.859848 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 544/1093] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 15 12:12:27 2022] GET /identity/v3/role_assignments?user.id=9d05c52570474820b4ba0e2cdad5c13f&scope.project.id=cab958c081ad4a92939d4469cf4ce1c6&role.id=4ceb69a86bf04a2ebb1f56b197006b3c => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:12:27.922162 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57648727-9e28-4a2d-9684-616e4cc44a59 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:28.031827 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57648727-9e28-4a2d-9684-616e4cc44a59 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:28.065588 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5220d76-cc37-4a36-9fad-daf1873591d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:28.066152 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5220d76-cc37-4a36-9fad-daf1873591d4 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:28.066421 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5220d76-cc37-4a36-9fad-daf1873591d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:28.066817 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5220d76-cc37-4a36-9fad-daf1873591d4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:28.074362 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:28.078083 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5220d76-cc37-4a36-9fad-daf1873591d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:12:28.083087 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-a5220d76-cc37-4a36-9fad-daf1873591d4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:12:28.083087 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:12:28.083087 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:12:28.083087 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:12:28.083087 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:12:28.083087 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:12:28.083087 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:12:28.083087 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:12:28.083087 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:12:28.083087 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:12:28.083087 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:12:28.083087 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:12:28.083087 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:12:28.083087 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:12:28.083087 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:12:28.083087 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:12:28.084217 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:12:28.084217 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:12:28.084217 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:12:28.084217 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:12:28.084217 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:12:28.084217 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:12:28.084217 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:12:28.084217 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:12:28.084217 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:12:28.084217 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:12:28.084217 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:12:28.084217 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:12:28.084217 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:12:28.084217 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:12:28.084217 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:12:28.084217 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:12:28.085256 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:12:28.085256 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:12:28.085256 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:12:28.085256 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:12:28.085256 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:12:28.085256 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:12:28.085256 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:12:28.085256 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:12:28.085256 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:12:28.085256 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:12:28.085256 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:12:28.085256 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:12:28.085256 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 550/1094] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Sep 15 12:12:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:12:28.090324 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0f75d6-0a0d-4201-a2dc-bf253382ade1 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:28.185269 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:28.191660 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0f75d6-0a0d-4201-a2dc-bf253382ade1 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:28.226481 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5fb854-f43f-4488-995a-504223ab8f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:28.227203 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5fb854-f43f-4488-995a-504223ab8f55 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:28.227482 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5fb854-f43f-4488-995a-504223ab8f55 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:28.227755 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5fb854-f43f-4488-995a-504223ab8f55 None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:28.228416 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5fb854-f43f-4488-995a-504223ab8f55 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:12:28.228719 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5fb854-f43f-4488-995a-504223ab8f55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:28.230100 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5fb854-f43f-4488-995a-504223ab8f55 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:28.238991 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 545/1095] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 15 12:12:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:12:28.244944 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5220d76-cc37-4a36-9fad-daf1873591d4 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:28.346886 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5220d76-cc37-4a36-9fad-daf1873591d4 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:28.383025 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf950b5-6dcf-4e2e-a128-cb2fc56935cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:28.383645 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf950b5-6dcf-4e2e-a128-cb2fc56935cf None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:28.383918 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf950b5-6dcf-4e2e-a128-cb2fc56935cf None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:28.384190 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf950b5-6dcf-4e2e-a128-cb2fc56935cf None admin] PATH_INFO: `/v3/users/26f2ac2338a843bbbe4fcc5c8ca69a77` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:28.385293 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf950b5-6dcf-4e2e-a128-cb2fc56935cf None admin] RBAC: Authorizing `identity:get_user(user_id=26f2ac2338a843bbbe4fcc5c8ca69a77)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:28.386717 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf950b5-6dcf-4e2e-a128-cb2fc56935cf None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:28.388793 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 551/1096] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 15 12:12:28 2022] GET /identity/v3/users/26f2ac2338a843bbbe4fcc5c8ca69a77 => generated 285 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:12:28.394706 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5fb854-f43f-4488-995a-504223ab8f55 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:28.496112 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5fb854-f43f-4488-995a-504223ab8f55 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:28.532006 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eb81e7-670e-42aa-a51c-07628e6cdee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:28.532636 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb81e7-670e-42aa-a51c-07628e6cdee7 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:28.532912 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb81e7-670e-42aa-a51c-07628e6cdee7 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:28.533180 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb81e7-670e-42aa-a51c-07628e6cdee7 None admin] PATH_INFO: `/v3/projects/d73662fc0d3c413bb78e2fa054345895` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:28.534315 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eb81e7-670e-42aa-a51c-07628e6cdee7 None admin] RBAC: Authorizing `identity:get_project(project_id=d73662fc0d3c413bb78e2fa054345895)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:28.535786 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eb81e7-670e-42aa-a51c-07628e6cdee7 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:28.539708 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 546/1097] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 15 12:12:28 2022] GET /identity/v3/projects/d73662fc0d3c413bb78e2fa054345895 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:12:28.543366 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf950b5-6dcf-4e2e-a128-cb2fc56935cf None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:28.612585 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:28.648560 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf950b5-6dcf-4e2e-a128-cb2fc56935cf None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:28.681908 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c247df6-0043-4761-b207-08c6bebf1100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:28.682563 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c247df6-0043-4761-b207-08c6bebf1100 None admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:28.682912 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c247df6-0043-4761-b207-08c6bebf1100 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:28.683184 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c247df6-0043-4761-b207-08c6bebf1100 None admin] PATH_INFO: `/v3/projects/d73662fc0d3c413bb78e2fa054345895/users/26f2ac2338a843bbbe4fcc5c8ca69a77/roles/7f53f1c823b746529ba5057bf21b2477` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:28.685581 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c247df6-0043-4761-b207-08c6bebf1100 None admin] RBAC: Authorizing `identity:create_grant(project_id=d73662fc0d3c413bb78e2fa054345895, user_id=26f2ac2338a843bbbe4fcc5c8ca69a77, role_id=7f53f1c823b746529ba5057bf21b2477)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:28.687023 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c247df6-0043-4761-b207-08c6bebf1100 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:28.699675 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 552/1098] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Sep 15 12:12:28 2022] PUT /identity/v3/projects/d73662fc0d3c413bb78e2fa054345895/users/26f2ac2338a843bbbe4fcc5c8ca69a77/roles/7f53f1c823b746529ba5057bf21b2477 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:12:30.790679 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb2e2e-ac4f-44f5-ab2a-a58d19a201ef None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:30.791232 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb2e2e-ac4f-44f5-ab2a-a58d19a201ef None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:30.791232 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb2e2e-ac4f-44f5-ab2a-a58d19a201ef None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:30.792573 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 547/1099] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:12:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:12:30.797845 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53756722-19e8-4898-9fa3-16a5737600d3 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:30.798288 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53756722-19e8-4898-9fa3-16a5737600d3 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:30.798383 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53756722-19e8-4898-9fa3-16a5737600d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:30.817282 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-53756722-19e8-4898-9fa3-16a5737600d3 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:12:30.818483 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-53756722-19e8-4898-9fa3-16a5737600d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:12:30.886778 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 553/1100] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:12:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:12:31.166277 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbb2e2e-ac4f-44f5-ab2a-a58d19a201ef None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:31.193719 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:31.264351 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbb2e2e-ac4f-44f5-ab2a-a58d19a201ef None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:31.296174 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d1e8d2-f032-475c-a21e-f9a781c63d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:31.296782 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d1e8d2-f032-475c-a21e-f9a781c63d63 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:31.297056 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d1e8d2-f032-475c-a21e-f9a781c63d63 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:31.297321 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d1e8d2-f032-475c-a21e-f9a781c63d63 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:31.306931 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d1e8d2-f032-475c-a21e-f9a781c63d63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:12:31.312306 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-f6d1e8d2-f032-475c-a21e-f9a781c63d63 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:12:31.312306 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:12:31.312306 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:12:31.312306 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:12:31.312306 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:12:31.312306 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:12:31.312306 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:12:31.312306 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:12:31.312306 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:12:31.312306 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:12:31.312306 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:12:31.312306 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:12:31.312306 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:12:31.312306 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:12:31.312306 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:12:31.312306 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:12:31.313366 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:12:31.313366 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:12:31.313366 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:12:31.313366 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:12:31.313366 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:12:31.313366 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:12:31.313366 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:12:31.313366 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:12:31.313366 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:12:31.313366 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:12:31.313366 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:12:31.313366 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:12:31.313366 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:12:31.313366 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:12:31.313366 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:12:31.313366 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:12:31.314359 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:12:31.314359 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:12:31.314359 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:12:31.314359 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:12:31.314359 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:12:31.314359 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:12:31.314359 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:12:31.314359 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:12:31.314359 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:12:31.314359 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:12:31.314359 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:12:31.314359 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:12:31.314359 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 548/1101] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Sep 15 12:12:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:12:31.319237 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53756722-19e8-4898-9fa3-16a5737600d3 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:31.374145 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:31.417979 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53756722-19e8-4898-9fa3-16a5737600d3 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:31.450896 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673e2470-ee12-4ca0-aec2-7924386a74cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:31.451484 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673e2470-ee12-4ca0-aec2-7924386a74cd None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:31.451756 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673e2470-ee12-4ca0-aec2-7924386a74cd None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:31.452022 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673e2470-ee12-4ca0-aec2-7924386a74cd None admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:31.452670 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673e2470-ee12-4ca0-aec2-7924386a74cd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:12:31.452964 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673e2470-ee12-4ca0-aec2-7924386a74cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:31.454299 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673e2470-ee12-4ca0-aec2-7924386a74cd None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:31.461909 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 554/1102] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 15 12:12:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:12:31.468498 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d1e8d2-f032-475c-a21e-f9a781c63d63 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:31.550475 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:31.565076 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d1e8d2-f032-475c-a21e-f9a781c63d63 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:31.597196 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcc11ac-1f29-4f52-b140-8bba84ba81cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:31.597792 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc11ac-1f29-4f52-b140-8bba84ba81cc None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:31.598065 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc11ac-1f29-4f52-b140-8bba84ba81cc None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:31.598331 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc11ac-1f29-4f52-b140-8bba84ba81cc None admin] PATH_INFO: `/v3/users/26f2ac2338a843bbbe4fcc5c8ca69a77` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:31.599444 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcc11ac-1f29-4f52-b140-8bba84ba81cc None admin] RBAC: Authorizing `identity:get_user(user_id=26f2ac2338a843bbbe4fcc5c8ca69a77)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:31.600855 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcc11ac-1f29-4f52-b140-8bba84ba81cc None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:31.602374 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 549/1103] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 15 12:12:31 2022] GET /identity/v3/users/26f2ac2338a843bbbe4fcc5c8ca69a77 => generated 285 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:12:31.608663 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673e2470-ee12-4ca0-aec2-7924386a74cd None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:31.705894 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673e2470-ee12-4ca0-aec2-7924386a74cd None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:31.725093 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:31.740386 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5721f2-3d2d-4e46-a7de-5bb66bf7a59d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:31.740986 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5721f2-3d2d-4e46-a7de-5bb66bf7a59d None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:31.741266 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5721f2-3d2d-4e46-a7de-5bb66bf7a59d None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:31.741538 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5721f2-3d2d-4e46-a7de-5bb66bf7a59d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:31.805697 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5721f2-3d2d-4e46-a7de-5bb66bf7a59d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:31.807147 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5721f2-3d2d-4e46-a7de-5bb66bf7a59d None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:31.899856 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 555/1104] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 15 12:12:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 12:12:31.906389 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcc11ac-1f29-4f52-b140-8bba84ba81cc None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:32.003213 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcc11ac-1f29-4f52-b140-8bba84ba81cc None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:32.035814 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d9d5b-ccdf-4887-8944-d209b6a63778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:32.036432 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d9d5b-ccdf-4887-8944-d209b6a63778 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:32.036707 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d9d5b-ccdf-4887-8944-d209b6a63778 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:32.036974 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d9d5b-ccdf-4887-8944-d209b6a63778 None admin] PATH_INFO: `/v3/projects/d73662fc0d3c413bb78e2fa054345895` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:32.038061 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644d9d5b-ccdf-4887-8944-d209b6a63778 None admin] RBAC: Authorizing `identity:get_project(project_id=d73662fc0d3c413bb78e2fa054345895)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:32.039525 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644d9d5b-ccdf-4887-8944-d209b6a63778 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:32.041117 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 550/1105] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 15 12:12:31 2022] GET /identity/v3/projects/d73662fc0d3c413bb78e2fa054345895 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:12:32.047266 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5721f2-3d2d-4e46-a7de-5bb66bf7a59d None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:32.067280 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:32.141863 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5721f2-3d2d-4e46-a7de-5bb66bf7a59d None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:32.174295 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a88199e-a617-4885-bcc7-69c0560b27c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:32.174915 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88199e-a617-4885-bcc7-69c0560b27c8 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:32.175198 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88199e-a617-4885-bcc7-69c0560b27c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:32.175469 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88199e-a617-4885-bcc7-69c0560b27c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:32.176189 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a88199e-a617-4885-bcc7-69c0560b27c8 None admin] RBAC: Adding query filter params (role.id=7f53f1c823b746529ba5057bf21b2477, scope.project.id=d73662fc0d3c413bb78e2fa054345895, user.id=26f2ac2338a843bbbe4fcc5c8ca69a77) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:12:32.176498 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a88199e-a617-4885-bcc7-69c0560b27c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:32.177905 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a88199e-a617-4885-bcc7-69c0560b27c8 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:32.183461 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 556/1106] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 15 12:12:32 2022] GET /identity/v3/role_assignments?user.id=26f2ac2338a843bbbe4fcc5c8ca69a77&scope.project.id=d73662fc0d3c413bb78e2fa054345895&role.id=7f53f1c823b746529ba5057bf21b2477 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:12:34.320784 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfada14c-7353-4b46-bd0d-f47fbbf62c52 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:34.321322 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfada14c-7353-4b46-bd0d-f47fbbf62c52 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:34.321322 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfada14c-7353-4b46-bd0d-f47fbbf62c52 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:34.322560 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 551/1107] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:12:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:12:34.328178 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68fe311-98f8-4bc6-b4cd-fdc0c4cc807e None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:34.328565 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68fe311-98f8-4bc6-b4cd-fdc0c4cc807e None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:34.328707 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68fe311-98f8-4bc6-b4cd-fdc0c4cc807e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:34.346781 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-e68fe311-98f8-4bc6-b4cd-fdc0c4cc807e None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:12:34.347940 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-e68fe311-98f8-4bc6-b4cd-fdc0c4cc807e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:12:34.415377 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 557/1108] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:12:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:12:34.679708 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfada14c-7353-4b46-bd0d-f47fbbf62c52 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:34.707333 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:34.782810 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfada14c-7353-4b46-bd0d-f47fbbf62c52 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:34.815580 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05f76ff-e769-4114-8b9c-1b4c110b69e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:34.816190 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05f76ff-e769-4114-8b9c-1b4c110b69e6 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:34.816462 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05f76ff-e769-4114-8b9c-1b4c110b69e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:34.816726 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05f76ff-e769-4114-8b9c-1b4c110b69e6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:34.817802 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05f76ff-e769-4114-8b9c-1b4c110b69e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:34.819257 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05f76ff-e769-4114-8b9c-1b4c110b69e6 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:34.820782 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 552/1109] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:12:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:12:34.826641 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68fe311-98f8-4bc6-b4cd-fdc0c4cc807e None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:34.840945 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:34.921843 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68fe311-98f8-4bc6-b4cd-fdc0c4cc807e None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:34.953711 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecf8f24-439c-44b2-bf8d-f973de714ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:34.954298 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf8f24-439c-44b2-bf8d-f973de714ed5 None admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:34.954572 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf8f24-439c-44b2-bf8d-f973de714ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:34.954873 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf8f24-439c-44b2-bf8d-f973de714ed5 None admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:34.955518 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecf8f24-439c-44b2-bf8d-f973de714ed5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:34.956914 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecf8f24-439c-44b2-bf8d-f973de714ed5 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:34.977695 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 558/1110] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Sep 15 12:12:34 2022] POST /identity/v3/users => generated 286 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:12:37.136768 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd90ee1-5438-44da-99bb-555ca5c6afe8 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:37.137313 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd90ee1-5438-44da-99bb-555ca5c6afe8 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:37.137313 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd90ee1-5438-44da-99bb-555ca5c6afe8 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:37.138625 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 553/1111] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:12:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:12:37.143829 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a35440-e02a-431e-bc7c-57f158c9adce None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:37.144199 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a35440-e02a-431e-bc7c-57f158c9adce None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:37.144368 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a35440-e02a-431e-bc7c-57f158c9adce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:37.161892 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-02a35440-e02a-431e-bc7c-57f158c9adce None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:12:37.163092 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-02a35440-e02a-431e-bc7c-57f158c9adce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:12:37.223726 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:37.228620 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 559/1112] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:12:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:12:37.493175 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd90ee1-5438-44da-99bb-555ca5c6afe8 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:37.581556 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:37.591559 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd90ee1-5438-44da-99bb-555ca5c6afe8 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:37.625127 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0853045f-e0e1-4ade-99b6-503aa637bcfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:37.625750 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0853045f-e0e1-4ade-99b6-503aa637bcfe None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:37.626057 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0853045f-e0e1-4ade-99b6-503aa637bcfe None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:37.626331 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0853045f-e0e1-4ade-99b6-503aa637bcfe None admin] PATH_INFO: `/v3/roles/19ee0f56c10b47628ba0b1c3deee4448` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:37.627994 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0853045f-e0e1-4ade-99b6-503aa637bcfe None admin] RBAC: Authorizing `identity:get_role(role_id=19ee0f56c10b47628ba0b1c3deee4448)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:37.629363 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0853045f-e0e1-4ade-99b6-503aa637bcfe None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:37.630668 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 554/1113] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 15 12:12:37 2022] GET /identity/v3/roles/19ee0f56c10b47628ba0b1c3deee4448 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:12:37.636457 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a35440-e02a-431e-bc7c-57f158c9adce None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:37.730236 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a35440-e02a-431e-bc7c-57f158c9adce None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:37.762873 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeb588f-9496-4b34-bf72-307b00159a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:37.763424 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb588f-9496-4b34-bf72-307b00159a68 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:37.763698 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb588f-9496-4b34-bf72-307b00159a68 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:37.764481 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb588f-9496-4b34-bf72-307b00159a68 None admin] PATH_INFO: `/v3/users/ada30de4990946c4b45158fc5c83b4df` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:37.776864 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeb588f-9496-4b34-bf72-307b00159a68 None admin] RBAC: Authorizing `identity:get_user(user_id=ada30de4990946c4b45158fc5c83b4df)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:37.778264 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeb588f-9496-4b34-bf72-307b00159a68 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:37.780388 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 560/1114] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 15 12:12:37 2022] GET /identity/v3/users/ada30de4990946c4b45158fc5c83b4df => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:12:37.785939 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0853045f-e0e1-4ade-99b6-503aa637bcfe None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:37.881872 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0853045f-e0e1-4ade-99b6-503aa637bcfe None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:37.914666 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cd85f1-beb8-4c99-85af-f99232dd7f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:37.915277 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cd85f1-beb8-4c99-85af-f99232dd7f6d None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:37.915555 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cd85f1-beb8-4c99-85af-f99232dd7f6d None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:37.915825 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cd85f1-beb8-4c99-85af-f99232dd7f6d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:37.942136 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:37.985213 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cd85f1-beb8-4c99-85af-f99232dd7f6d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:37.986652 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cd85f1-beb8-4c99-85af-f99232dd7f6d None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:38.080874 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 555/1115] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 15 12:12:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 12:12:38.086546 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeb588f-9496-4b34-bf72-307b00159a68 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:38.143004 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:38.183117 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeb588f-9496-4b34-bf72-307b00159a68 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:38.214827 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a332212-16e3-464f-a0b7-ed62d96270aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:38.215431 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a332212-16e3-464f-a0b7-ed62d96270aa None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:38.215707 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a332212-16e3-464f-a0b7-ed62d96270aa None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:38.215978 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a332212-16e3-464f-a0b7-ed62d96270aa None admin] PATH_INFO: `/v3/projects/d73662fc0d3c413bb78e2fa054345895` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:38.217574 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a332212-16e3-464f-a0b7-ed62d96270aa None admin] RBAC: Authorizing `identity:get_project(project_id=d73662fc0d3c413bb78e2fa054345895)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:38.219008 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a332212-16e3-464f-a0b7-ed62d96270aa None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:38.220593 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 561/1116] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 15 12:12:38 2022] GET /identity/v3/projects/d73662fc0d3c413bb78e2fa054345895 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:12:38.226580 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cd85f1-beb8-4c99-85af-f99232dd7f6d None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:38.282197 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:38.322450 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cd85f1-beb8-4c99-85af-f99232dd7f6d None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:38.354963 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742b28a3-92c5-4608-944d-98cac5db1a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:38.355496 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742b28a3-92c5-4608-944d-98cac5db1a57 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:38.355772 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742b28a3-92c5-4608-944d-98cac5db1a57 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:38.356040 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742b28a3-92c5-4608-944d-98cac5db1a57 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:38.356753 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742b28a3-92c5-4608-944d-98cac5db1a57 None admin] RBAC: Adding query filter params (role.id=19ee0f56c10b47628ba0b1c3deee4448, scope.project.id=d73662fc0d3c413bb78e2fa054345895, user.id=ada30de4990946c4b45158fc5c83b4df) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:12:38.357056 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742b28a3-92c5-4608-944d-98cac5db1a57 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:38.359075 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742b28a3-92c5-4608-944d-98cac5db1a57 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:38.364179 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 556/1117] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 15 12:12:38 2022] GET /identity/v3/role_assignments?user.id=ada30de4990946c4b45158fc5c83b4df&scope.project.id=d73662fc0d3c413bb78e2fa054345895&role.id=19ee0f56c10b47628ba0b1c3deee4448 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:12:40.438006 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c571e6-a360-4276-9702-9f8fcd206448 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:40.438550 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c571e6-a360-4276-9702-9f8fcd206448 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:40.438550 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c571e6-a360-4276-9702-9f8fcd206448 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:40.439910 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 562/1118] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:12:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:12:40.446447 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb1875-8cda-4a19-89ec-269e5dc12f71 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:40.447258 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb1875-8cda-4a19-89ec-269e5dc12f71 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:40.447537 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb1875-8cda-4a19-89ec-269e5dc12f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:40.469865 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-4afb1875-8cda-4a19-89ec-269e5dc12f71 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:12:40.471070 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-4afb1875-8cda-4a19-89ec-269e5dc12f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:12:40.535188 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 557/1119] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:12:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 12:12:40.801420 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c571e6-a360-4276-9702-9f8fcd206448 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:40.898559 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c571e6-a360-4276-9702-9f8fcd206448 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:40.923344 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:40.932111 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cd66f0-9fe4-49bf-88d8-2c8db0833029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:40.932722 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd66f0-9fe4-49bf-88d8-2c8db0833029 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:40.933001 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd66f0-9fe4-49bf-88d8-2c8db0833029 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:40.933269 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd66f0-9fe4-49bf-88d8-2c8db0833029 None admin] PATH_INFO: `/v3/roles/19ee0f56c10b47628ba0b1c3deee4448` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:40.934630 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cd66f0-9fe4-49bf-88d8-2c8db0833029 None admin] RBAC: Authorizing `identity:get_role(role_id=19ee0f56c10b47628ba0b1c3deee4448)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:40.936615 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cd66f0-9fe4-49bf-88d8-2c8db0833029 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:40.937926 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 563/1120] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 15 12:12:40 2022] GET /identity/v3/roles/19ee0f56c10b47628ba0b1c3deee4448 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:12:40.943676 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afb1875-8cda-4a19-89ec-269e5dc12f71 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:40.993274 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:41.037929 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afb1875-8cda-4a19-89ec-269e5dc12f71 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:41.070838 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5937f963-1086-4b16-af46-ccdf3121da03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:41.071399 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5937f963-1086-4b16-af46-ccdf3121da03 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:41.071673 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5937f963-1086-4b16-af46-ccdf3121da03 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:41.071940 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5937f963-1086-4b16-af46-ccdf3121da03 None admin] PATH_INFO: `/v3/users/ada30de4990946c4b45158fc5c83b4df` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:41.073027 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5937f963-1086-4b16-af46-ccdf3121da03 None admin] RBAC: Authorizing `identity:get_user(user_id=ada30de4990946c4b45158fc5c83b4df)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:41.074438 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5937f963-1086-4b16-af46-ccdf3121da03 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:41.076012 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 558/1121] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 15 12:12:40 2022] GET /identity/v3/users/ada30de4990946c4b45158fc5c83b4df => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:12:41.081711 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cd66f0-9fe4-49bf-88d8-2c8db0833029 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:41.183275 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cd66f0-9fe4-49bf-88d8-2c8db0833029 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:41.215004 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769309cc-3a68-452e-b4ce-dcdca5c19c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:41.215611 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769309cc-3a68-452e-b4ce-dcdca5c19c16 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:41.215885 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769309cc-3a68-452e-b4ce-dcdca5c19c16 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:41.216149 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769309cc-3a68-452e-b4ce-dcdca5c19c16 None admin] PATH_INFO: `/v3/projects/d73662fc0d3c413bb78e2fa054345895` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:41.217711 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769309cc-3a68-452e-b4ce-dcdca5c19c16 None admin] RBAC: Authorizing `identity:get_project(project_id=d73662fc0d3c413bb78e2fa054345895)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:41.219135 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769309cc-3a68-452e-b4ce-dcdca5c19c16 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:41.220713 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 564/1122] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 15 12:12:41 2022] GET /identity/v3/projects/d73662fc0d3c413bb78e2fa054345895 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:12:41.226597 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5937f963-1086-4b16-af46-ccdf3121da03 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:41.321714 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5937f963-1086-4b16-af46-ccdf3121da03 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:41.340258 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:41.354432 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2476fe-57b6-47c2-8281-d97c35a86fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:41.355097 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2476fe-57b6-47c2-8281-d97c35a86fd9 None admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:41.355372 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2476fe-57b6-47c2-8281-d97c35a86fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:41.355639 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2476fe-57b6-47c2-8281-d97c35a86fd9 None admin] PATH_INFO: `/v3/projects/d73662fc0d3c413bb78e2fa054345895/users/ada30de4990946c4b45158fc5c83b4df/roles/19ee0f56c10b47628ba0b1c3deee4448` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:41.358311 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2476fe-57b6-47c2-8281-d97c35a86fd9 None admin] RBAC: Authorizing `identity:create_grant(project_id=d73662fc0d3c413bb78e2fa054345895, user_id=ada30de4990946c4b45158fc5c83b4df, role_id=19ee0f56c10b47628ba0b1c3deee4448)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:41.360708 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2476fe-57b6-47c2-8281-d97c35a86fd9 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:41.372599 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 559/1123] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Sep 15 12:12:41 2022] PUT /identity/v3/projects/d73662fc0d3c413bb78e2fa054345895/users/ada30de4990946c4b45158fc5c83b4df/roles/19ee0f56c10b47628ba0b1c3deee4448 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:12:43.505152 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc5ea97-68d7-4a63-b577-166ad3227892 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:43.505673 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc5ea97-68d7-4a63-b577-166ad3227892 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:43.505673 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc5ea97-68d7-4a63-b577-166ad3227892 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:43.507043 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 565/1124] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:12:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:12:43.512231 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d5a15-54bf-4107-8b34-0d83d7e1678f None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:43.512634 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d5a15-54bf-4107-8b34-0d83d7e1678f None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:43.512777 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d5a15-54bf-4107-8b34-0d83d7e1678f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:43.531588 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-9b1d5a15-54bf-4107-8b34-0d83d7e1678f None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:12:43.532772 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-9b1d5a15-54bf-4107-8b34-0d83d7e1678f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:12:43.596542 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 560/1125] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:12:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:12:43.864958 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc5ea97-68d7-4a63-b577-166ad3227892 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:43.924923 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:43.962333 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc5ea97-68d7-4a63-b577-166ad3227892 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:43.995111 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29738fc8-0063-4b1d-82f5-53299e8221f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:43.995724 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29738fc8-0063-4b1d-82f5-53299e8221f5 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:43.995994 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29738fc8-0063-4b1d-82f5-53299e8221f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:43.996257 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29738fc8-0063-4b1d-82f5-53299e8221f5 None admin] PATH_INFO: `/v3/roles/19ee0f56c10b47628ba0b1c3deee4448` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:43.997597 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29738fc8-0063-4b1d-82f5-53299e8221f5 None admin] RBAC: Authorizing `identity:get_role(role_id=19ee0f56c10b47628ba0b1c3deee4448)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:43.999558 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29738fc8-0063-4b1d-82f5-53299e8221f5 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:44.000851 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 566/1126] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 15 12:12:43 2022] GET /identity/v3/roles/19ee0f56c10b47628ba0b1c3deee4448 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:12:44.006880 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d5a15-54bf-4107-8b34-0d83d7e1678f None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:44.101325 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d5a15-54bf-4107-8b34-0d83d7e1678f None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:44.112016 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:44.136518 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5906686f-17b8-4e2b-90af-1857305401e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:44.137076 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5906686f-17b8-4e2b-90af-1857305401e7 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:44.137356 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5906686f-17b8-4e2b-90af-1857305401e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:44.137627 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5906686f-17b8-4e2b-90af-1857305401e7 None admin] PATH_INFO: `/v3/users/ada30de4990946c4b45158fc5c83b4df` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:44.138782 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5906686f-17b8-4e2b-90af-1857305401e7 None admin] RBAC: Authorizing `identity:get_user(user_id=ada30de4990946c4b45158fc5c83b4df)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:44.140217 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5906686f-17b8-4e2b-90af-1857305401e7 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:44.141765 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 561/1127] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 15 12:12:44 2022] GET /identity/v3/users/ada30de4990946c4b45158fc5c83b4df => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:12:44.147385 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29738fc8-0063-4b1d-82f5-53299e8221f5 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:44.242835 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29738fc8-0063-4b1d-82f5-53299e8221f5 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:44.270512 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:44.276651 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d7401d-68ba-4804-a511-7e7fe4a66a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:44.277245 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d7401d-68ba-4804-a511-7e7fe4a66a25 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:44.277521 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d7401d-68ba-4804-a511-7e7fe4a66a25 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:44.277787 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d7401d-68ba-4804-a511-7e7fe4a66a25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:44.342617 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d7401d-68ba-4804-a511-7e7fe4a66a25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:44.344061 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d7401d-68ba-4804-a511-7e7fe4a66a25 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:44.437189 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 567/1128] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 15 12:12:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 12:12:44.443204 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5906686f-17b8-4e2b-90af-1857305401e7 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:44.539109 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5906686f-17b8-4e2b-90af-1857305401e7 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:44.570583 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3737089-b01e-48be-aa2c-23aea668ea73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:44.571232 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3737089-b01e-48be-aa2c-23aea668ea73 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:44.571512 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3737089-b01e-48be-aa2c-23aea668ea73 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:44.571784 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3737089-b01e-48be-aa2c-23aea668ea73 None admin] PATH_INFO: `/v3/projects/d73662fc0d3c413bb78e2fa054345895` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:44.572881 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3737089-b01e-48be-aa2c-23aea668ea73 None admin] RBAC: Authorizing `identity:get_project(project_id=d73662fc0d3c413bb78e2fa054345895)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:44.574290 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3737089-b01e-48be-aa2c-23aea668ea73 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:44.575898 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 562/1129] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 15 12:12:44 2022] GET /identity/v3/projects/d73662fc0d3c413bb78e2fa054345895 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:12:44.582279 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d7401d-68ba-4804-a511-7e7fe4a66a25 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:44.612246 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:44.679573 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d7401d-68ba-4804-a511-7e7fe4a66a25 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:44.712183 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e35179d-b9be-4036-8037-e381a3f6c631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:44.712716 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e35179d-b9be-4036-8037-e381a3f6c631 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:44.712994 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e35179d-b9be-4036-8037-e381a3f6c631 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:44.713266 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e35179d-b9be-4036-8037-e381a3f6c631 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:44.713981 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e35179d-b9be-4036-8037-e381a3f6c631 None admin] RBAC: Adding query filter params (role.id=19ee0f56c10b47628ba0b1c3deee4448, scope.project.id=d73662fc0d3c413bb78e2fa054345895, user.id=ada30de4990946c4b45158fc5c83b4df) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:12:44.714288 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e35179d-b9be-4036-8037-e381a3f6c631 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:44.715716 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e35179d-b9be-4036-8037-e381a3f6c631 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:44.721831 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 568/1130] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 15 12:12:44 2022] GET /identity/v3/role_assignments?user.id=ada30de4990946c4b45158fc5c83b4df&scope.project.id=d73662fc0d3c413bb78e2fa054345895&role.id=19ee0f56c10b47628ba0b1c3deee4448 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:12:46.858156 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b158b5b6-2dd1-4fb0-a6b4-949991db4733 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:46.858733 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b158b5b6-2dd1-4fb0-a6b4-949991db4733 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:46.858733 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b158b5b6-2dd1-4fb0-a6b4-949991db4733 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:46.860032 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 563/1131] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:12:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:12:46.865340 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07a751d-3948-493f-9d47-d8790026d7dd None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:46.865754 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07a751d-3948-493f-9d47-d8790026d7dd None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:46.865886 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07a751d-3948-493f-9d47-d8790026d7dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:46.884382 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-b07a751d-3948-493f-9d47-d8790026d7dd None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:12:46.885546 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-b07a751d-3948-493f-9d47-d8790026d7dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:12:46.954364 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 569/1132] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:12:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:12:47.220906 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b158b5b6-2dd1-4fb0-a6b4-949991db4733 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:47.269004 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:47.321901 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b158b5b6-2dd1-4fb0-a6b4-949991db4733 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:47.357934 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a3546e-2d06-4ea0-b498-c93828e7d59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:47.358568 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3546e-2d06-4ea0-b498-c93828e7d59b None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:47.358898 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3546e-2d06-4ea0-b498-c93828e7d59b None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:47.359167 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3546e-2d06-4ea0-b498-c93828e7d59b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:47.360255 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a3546e-2d06-4ea0-b498-c93828e7d59b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:47.361705 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a3546e-2d06-4ea0-b498-c93828e7d59b None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:47.363275 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 564/1133] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:12:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:12:47.369213 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07a751d-3948-493f-9d47-d8790026d7dd None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:47.393782 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:47.463954 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07a751d-3948-493f-9d47-d8790026d7dd None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:47.496539 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451d4cd3-99a9-48df-b05c-f1b143c18a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:47.497068 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d4cd3-99a9-48df-b05c-f1b143c18a1e None admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:47.497341 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d4cd3-99a9-48df-b05c-f1b143c18a1e None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:47.497608 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d4cd3-99a9-48df-b05c-f1b143c18a1e None admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:47.498488 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451d4cd3-99a9-48df-b05c-f1b143c18a1e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:47.499919 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451d4cd3-99a9-48df-b05c-f1b143c18a1e None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:47.525987 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 570/1134] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Sep 15 12:12:47 2022] POST /identity/v3/projects => generated 311 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:12:49.761321 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9928fd22-6fbf-49ba-b1eb-b89abcf11ecd None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:49.761883 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9928fd22-6fbf-49ba-b1eb-b89abcf11ecd None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:49.761883 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9928fd22-6fbf-49ba-b1eb-b89abcf11ecd None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:49.763202 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 565/1135] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:12:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:12:49.770355 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a2d3e-a547-4808-8180-142191a7df52 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:49.770749 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a2d3e-a547-4808-8180-142191a7df52 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:49.770926 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a2d3e-a547-4808-8180-142191a7df52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:49.795059 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-7c5a2d3e-a547-4808-8180-142191a7df52 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:12:49.796288 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-7c5a2d3e-a547-4808-8180-142191a7df52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:12:49.860356 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 571/1136] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:12:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:12:50.137318 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9928fd22-6fbf-49ba-b1eb-b89abcf11ecd None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:50.234915 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9928fd22-6fbf-49ba-b1eb-b89abcf11ecd None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:50.248571 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:50.268660 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a85fcf-f3f2-4681-a681-4c2223e561cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:50.269274 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a85fcf-f3f2-4681-a681-4c2223e561cb None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:50.269550 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a85fcf-f3f2-4681-a681-4c2223e561cb None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:50.269819 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a85fcf-f3f2-4681-a681-4c2223e561cb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:50.270934 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a85fcf-f3f2-4681-a681-4c2223e561cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:50.272354 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a85fcf-f3f2-4681-a681-4c2223e561cb None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:50.273891 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 566/1137] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:12:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:12:50.279512 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5a2d3e-a547-4808-8180-142191a7df52 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:50.287372 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:50.375648 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5a2d3e-a547-4808-8180-142191a7df52 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:50.408715 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c36b623-26d1-4c0e-b213-ed76055e671c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:50.409251 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c36b623-26d1-4c0e-b213-ed76055e671c None admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:50.409527 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c36b623-26d1-4c0e-b213-ed76055e671c None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:50.409796 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c36b623-26d1-4c0e-b213-ed76055e671c None admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:50.410439 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c36b623-26d1-4c0e-b213-ed76055e671c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:50.411873 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c36b623-26d1-4c0e-b213-ed76055e671c None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:50.432908 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 572/1138] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Sep 15 12:12:50 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:12:52.584007 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3623bf86-8778-4ebd-bf43-e95bdca9ae48 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:52.584558 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3623bf86-8778-4ebd-bf43-e95bdca9ae48 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:52.584558 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3623bf86-8778-4ebd-bf43-e95bdca9ae48 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:52.585856 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 567/1139] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:12:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:12:52.591096 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c90272f-b4ff-4567-ac00-b80a1de41e1a None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:52.591477 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c90272f-b4ff-4567-ac00-b80a1de41e1a None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:52.591646 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c90272f-b4ff-4567-ac00-b80a1de41e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:52.609215 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-5c90272f-b4ff-4567-ac00-b80a1de41e1a None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:12:52.610391 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-5c90272f-b4ff-4567-ac00-b80a1de41e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:12:52.664928 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:52.675847 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 573/1140] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:12:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:12:52.946473 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3623bf86-8778-4ebd-bf43-e95bdca9ae48 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:53.045339 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3623bf86-8778-4ebd-bf43-e95bdca9ae48 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:53.078044 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b9c707-2661-4440-b16c-e560c089381c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:53.078660 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b9c707-2661-4440-b16c-e560c089381c None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:53.078965 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b9c707-2661-4440-b16c-e560c089381c None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:53.079232 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b9c707-2661-4440-b16c-e560c089381c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:53.088992 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b9c707-2661-4440-b16c-e560c089381c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:12:53.093787 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-62b9c707-2661-4440-b16c-e560c089381c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:12:53.093787 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:12:53.093787 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:12:53.093787 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:12:53.093787 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:12:53.093787 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:12:53.093787 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:12:53.093787 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:12:53.093787 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:12:53.093787 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:12:53.093787 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:12:53.093787 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:12:53.093787 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:12:53.093787 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:12:53.093787 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:12:53.093787 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:12:53.094928 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:12:53.094928 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:12:53.094928 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:12:53.094928 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:12:53.094928 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:12:53.094928 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:12:53.094928 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:12:53.094928 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:12:53.094928 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:12:53.094928 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:12:53.094928 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:12:53.094928 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:12:53.094928 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:12:53.094928 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:12:53.094928 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:12:53.094928 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:12:53.096177 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:12:53.096177 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:12:53.096177 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:12:53.096177 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:12:53.096177 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:12:53.096177 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:12:53.096177 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:12:53.096177 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:12:53.096177 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:12:53.096177 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:12:53.096177 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:12:53.096177 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:12:53.096177 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 568/1141] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Sep 15 12:12:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:12:53.100832 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c90272f-b4ff-4567-ac00-b80a1de41e1a None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:53.195428 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c90272f-b4ff-4567-ac00-b80a1de41e1a None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:53.227541 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69646b5a-cc42-42b1-ae1f-7c3ea8cd71fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:53.228066 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69646b5a-cc42-42b1-ae1f-7c3ea8cd71fc None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:53.228340 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69646b5a-cc42-42b1-ae1f-7c3ea8cd71fc None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:53.228606 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69646b5a-cc42-42b1-ae1f-7c3ea8cd71fc None admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:53.229248 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69646b5a-cc42-42b1-ae1f-7c3ea8cd71fc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:12:53.229543 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69646b5a-cc42-42b1-ae1f-7c3ea8cd71fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:53.230925 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69646b5a-cc42-42b1-ae1f-7c3ea8cd71fc None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:53.239146 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 574/1142] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 15 12:12:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:12:53.244712 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b9c707-2661-4440-b16c-e560c089381c None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:53.286905 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:53.340658 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b9c707-2661-4440-b16c-e560c089381c None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:53.373271 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0c786f-5d7c-4b44-a34f-3f1032b913fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:53.373873 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c786f-5d7c-4b44-a34f-3f1032b913fd None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:53.374148 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c786f-5d7c-4b44-a34f-3f1032b913fd None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:53.374413 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c786f-5d7c-4b44-a34f-3f1032b913fd None admin] PATH_INFO: `/v3/users/cad9c9f54f0e42e1870588b0fd79953e` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:53.387042 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0c786f-5d7c-4b44-a34f-3f1032b913fd None admin] RBAC: Authorizing `identity:get_user(user_id=cad9c9f54f0e42e1870588b0fd79953e)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:53.388482 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0c786f-5d7c-4b44-a34f-3f1032b913fd None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:53.390013 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 569/1143] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 15 12:12:53 2022] GET /identity/v3/users/cad9c9f54f0e42e1870588b0fd79953e => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:12:53.395676 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69646b5a-cc42-42b1-ae1f-7c3ea8cd71fc None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:53.449277 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:53.495181 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69646b5a-cc42-42b1-ae1f-7c3ea8cd71fc None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:53.527533 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8082b566-835e-4da4-baef-543f51b21969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:53.528125 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8082b566-835e-4da4-baef-543f51b21969 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:53.528407 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8082b566-835e-4da4-baef-543f51b21969 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:53.528677 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8082b566-835e-4da4-baef-543f51b21969 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:53.595860 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8082b566-835e-4da4-baef-543f51b21969 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:53.597282 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8082b566-835e-4da4-baef-543f51b21969 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:53.648065 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:53.691712 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 575/1144] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 15 12:12:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 12:12:53.697560 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0c786f-5d7c-4b44-a34f-3f1032b913fd None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:53.790018 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:53.792723 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0c786f-5d7c-4b44-a34f-3f1032b913fd None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:53.826820 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986d246f-30e3-4ba1-bc3f-d4a23ac59d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:53.827441 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d246f-30e3-4ba1-bc3f-d4a23ac59d96 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:53.827717 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d246f-30e3-4ba1-bc3f-d4a23ac59d96 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:53.827986 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d246f-30e3-4ba1-bc3f-d4a23ac59d96 None admin] PATH_INFO: `/v3/projects/5f4df2e96b75487cb71cfe3534d45021` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:53.829186 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986d246f-30e3-4ba1-bc3f-d4a23ac59d96 None admin] RBAC: Authorizing `identity:get_project(project_id=5f4df2e96b75487cb71cfe3534d45021)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:53.830598 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986d246f-30e3-4ba1-bc3f-d4a23ac59d96 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:53.832220 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 570/1145] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 15 12:12:53 2022] GET /identity/v3/projects/5f4df2e96b75487cb71cfe3534d45021 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:12:53.838382 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8082b566-835e-4da4-baef-543f51b21969 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:53.933489 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8082b566-835e-4da4-baef-543f51b21969 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:53.966624 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc3b79f-e17e-4e52-b9ef-b47026cd8fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:53.967247 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc3b79f-e17e-4e52-b9ef-b47026cd8fd3 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:53.967525 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc3b79f-e17e-4e52-b9ef-b47026cd8fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:53.967796 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc3b79f-e17e-4e52-b9ef-b47026cd8fd3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:53.968508 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc3b79f-e17e-4e52-b9ef-b47026cd8fd3 None admin] RBAC: Adding query filter params (role.id=7f53f1c823b746529ba5057bf21b2477, scope.project.id=5f4df2e96b75487cb71cfe3534d45021, user.id=cad9c9f54f0e42e1870588b0fd79953e) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:12:53.968811 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc3b79f-e17e-4e52-b9ef-b47026cd8fd3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:53.970213 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc3b79f-e17e-4e52-b9ef-b47026cd8fd3 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:53.975578 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 576/1146] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 15 12:12:53 2022] GET /identity/v3/role_assignments?user.id=cad9c9f54f0e42e1870588b0fd79953e&scope.project.id=5f4df2e96b75487cb71cfe3534d45021&role.id=7f53f1c823b746529ba5057bf21b2477 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:12:56.084657 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36294995-11d8-46a8-a364-44105b079c53 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:56.085271 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36294995-11d8-46a8-a364-44105b079c53 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:56.085271 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36294995-11d8-46a8-a364-44105b079c53 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:56.086532 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 571/1147] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:12:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:12:56.091708 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef644b9-b86c-4ccb-a1d2-7bf59287ddde None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:56.092082 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef644b9-b86c-4ccb-a1d2-7bf59287ddde None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:56.092251 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef644b9-b86c-4ccb-a1d2-7bf59287ddde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:56.110479 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-7ef644b9-b86c-4ccb-a1d2-7bf59287ddde None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:12:56.111684 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-7ef644b9-b86c-4ccb-a1d2-7bf59287ddde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:12:56.124934 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:56.179500 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 577/1148] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:12:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:12:56.447582 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36294995-11d8-46a8-a364-44105b079c53 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:56.546660 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36294995-11d8-46a8-a364-44105b079c53 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:56.579388 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b08402-b1f4-49d9-ba6b-5d56a2c81ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:56.579999 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b08402-b1f4-49d9-ba6b-5d56a2c81ef2 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:56.580279 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b08402-b1f4-49d9-ba6b-5d56a2c81ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:56.580551 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b08402-b1f4-49d9-ba6b-5d56a2c81ef2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:56.590320 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b08402-b1f4-49d9-ba6b-5d56a2c81ef2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:12:56.595721 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-d1b08402-b1f4-49d9-ba6b-5d56a2c81ef2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:12:56.595721 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:12:56.595721 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:12:56.595721 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:12:56.595721 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:12:56.595721 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:12:56.595721 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:12:56.595721 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:12:56.595721 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:12:56.595721 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:12:56.595721 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:12:56.595721 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:12:56.595721 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:12:56.595721 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:12:56.595721 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:12:56.595721 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:12:56.596791 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:12:56.596791 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:12:56.596791 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:12:56.596791 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:12:56.596791 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:12:56.596791 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:12:56.596791 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:12:56.596791 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:12:56.596791 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:12:56.596791 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:12:56.596791 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:12:56.596791 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:12:56.596791 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:12:56.596791 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:12:56.596791 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:12:56.596791 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:12:56.598012 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:12:56.598012 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:12:56.598012 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:12:56.598012 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:12:56.598012 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:12:56.598012 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:12:56.598012 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:12:56.598012 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:12:56.598012 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:12:56.598012 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:12:56.598012 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:12:56.598012 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:12:56.598012 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 572/1149] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Sep 15 12:12:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:12:56.602602 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef644b9-b86c-4ccb-a1d2-7bf59287ddde None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:56.697572 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef644b9-b86c-4ccb-a1d2-7bf59287ddde None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:56.731218 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06672567-7ff8-4cef-8e11-133f15146c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:56.731764 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06672567-7ff8-4cef-8e11-133f15146c64 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:56.732077 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06672567-7ff8-4cef-8e11-133f15146c64 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:56.732352 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06672567-7ff8-4cef-8e11-133f15146c64 None admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:56.733011 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06672567-7ff8-4cef-8e11-133f15146c64 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:12:56.733316 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06672567-7ff8-4cef-8e11-133f15146c64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:56.734668 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06672567-7ff8-4cef-8e11-133f15146c64 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:56.742458 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 578/1150] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 15 12:12:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:12:56.748128 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b08402-b1f4-49d9-ba6b-5d56a2c81ef2 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:56.776602 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:56.847127 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b08402-b1f4-49d9-ba6b-5d56a2c81ef2 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:56.879701 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b76178-9c7b-4865-84d5-14d5f115075b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:56.880326 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b76178-9c7b-4865-84d5-14d5f115075b None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:56.880602 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b76178-9c7b-4865-84d5-14d5f115075b None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:56.880871 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b76178-9c7b-4865-84d5-14d5f115075b None admin] PATH_INFO: `/v3/users/cad9c9f54f0e42e1870588b0fd79953e` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:56.881975 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b76178-9c7b-4865-84d5-14d5f115075b None admin] RBAC: Authorizing `identity:get_user(user_id=cad9c9f54f0e42e1870588b0fd79953e)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:56.883424 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b76178-9c7b-4865-84d5-14d5f115075b None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:56.884979 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 573/1151] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 15 12:12:56 2022] GET /identity/v3/users/cad9c9f54f0e42e1870588b0fd79953e => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:12:56.892345 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06672567-7ff8-4cef-8e11-133f15146c64 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:56.906574 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:56.994198 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06672567-7ff8-4cef-8e11-133f15146c64 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:57.027540 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c758a45c-9116-4ddf-985a-3a155288c18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:57.028161 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758a45c-9116-4ddf-985a-3a155288c18f None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:57.028434 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758a45c-9116-4ddf-985a-3a155288c18f None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:57.028701 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758a45c-9116-4ddf-985a-3a155288c18f None admin] PATH_INFO: `/v3/projects/5f4df2e96b75487cb71cfe3534d45021` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:57.030310 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c758a45c-9116-4ddf-985a-3a155288c18f None admin] RBAC: Authorizing `identity:get_project(project_id=5f4df2e96b75487cb71cfe3534d45021)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:57.031741 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c758a45c-9116-4ddf-985a-3a155288c18f None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:57.033341 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 579/1152] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 15 12:12:56 2022] GET /identity/v3/projects/5f4df2e96b75487cb71cfe3534d45021 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:12:57.039426 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b76178-9c7b-4865-84d5-14d5f115075b None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:57.130845 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:57.136869 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b76178-9c7b-4865-84d5-14d5f115075b None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:57.170195 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e42d95-7076-4320-98da-275d3e0cbcdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:57.170870 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e42d95-7076-4320-98da-275d3e0cbcdc None admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:57.171147 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e42d95-7076-4320-98da-275d3e0cbcdc None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:57.171417 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e42d95-7076-4320-98da-275d3e0cbcdc None admin] PATH_INFO: `/v3/projects/5f4df2e96b75487cb71cfe3534d45021/users/cad9c9f54f0e42e1870588b0fd79953e/roles/7f53f1c823b746529ba5057bf21b2477` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:57.173268 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e42d95-7076-4320-98da-275d3e0cbcdc None admin] RBAC: Authorizing `identity:create_grant(project_id=5f4df2e96b75487cb71cfe3534d45021, user_id=cad9c9f54f0e42e1870588b0fd79953e, role_id=7f53f1c823b746529ba5057bf21b2477)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:57.174680 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e42d95-7076-4320-98da-275d3e0cbcdc None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:57.187528 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 574/1153] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Sep 15 12:12:57 2022] PUT /identity/v3/projects/5f4df2e96b75487cb71cfe3534d45021/users/cad9c9f54f0e42e1870588b0fd79953e/roles/7f53f1c823b746529ba5057bf21b2477 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:12:59.302136 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb717858-bdbb-4873-a517-8dd7ee920afc None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:59.302656 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb717858-bdbb-4873-a517-8dd7ee920afc None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:59.302656 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb717858-bdbb-4873-a517-8dd7ee920afc None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:59.303956 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 580/1154] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:12:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:12:59.309068 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7939c5-8c32-498e-867d-5c8433605c38 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:59.309503 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7939c5-8c32-498e-867d-5c8433605c38 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:59.309601 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7939c5-8c32-498e-867d-5c8433605c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:59.327194 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-fe7939c5-8c32-498e-867d-5c8433605c38 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:12:59.328357 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-fe7939c5-8c32-498e-867d-5c8433605c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:12:59.391500 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 575/1155] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:12:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:12:59.661916 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb717858-bdbb-4873-a517-8dd7ee920afc None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:59.738856 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:59.760843 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb717858-bdbb-4873-a517-8dd7ee920afc None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:59.793150 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f0408b-d26c-477e-86d4-9ea01362cf92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:59.793761 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f0408b-d26c-477e-86d4-9ea01362cf92 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:59.794035 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f0408b-d26c-477e-86d4-9ea01362cf92 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:59.794303 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f0408b-d26c-477e-86d4-9ea01362cf92 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:59.804343 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f0408b-d26c-477e-86d4-9ea01362cf92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:12:59.809057 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-b6f0408b-d26c-477e-86d4-9ea01362cf92 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:12:59.809057 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:12:59.809057 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:12:59.809057 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:12:59.809057 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:12:59.809057 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:12:59.809057 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:12:59.809057 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:12:59.809057 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:12:59.809057 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:12:59.809057 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:12:59.809057 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:12:59.809057 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:12:59.809057 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:12:59.809057 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:12:59.809057 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:12:59.810075 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:12:59.810075 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:12:59.810075 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:12:59.810075 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:12:59.810075 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:12:59.810075 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:12:59.810075 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:12:59.810075 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:12:59.810075 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:12:59.810075 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:12:59.810075 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:12:59.810075 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:12:59.810075 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:12:59.810075 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:12:59.810075 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:12:59.810075 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:12:59.811103 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:12:59.811103 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:12:59.811103 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:12:59.811103 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:12:59.811103 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:12:59.811103 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:12:59.811103 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:12:59.811103 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:12:59.811103 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:12:59.811103 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:12:59.811103 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:12:59.811103 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:12:59.811103 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 581/1156] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Sep 15 12:12:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:12:59.816012 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7939c5-8c32-498e-867d-5c8433605c38 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:12:59.897647 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:12:59.913443 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7939c5-8c32-498e-867d-5c8433605c38 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:12:59.945749 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f17da04-a61e-4013-ab9b-d783152f735f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:12:59.946335 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f17da04-a61e-4013-ab9b-d783152f735f None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:12:59.946607 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f17da04-a61e-4013-ab9b-d783152f735f None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:12:59.946899 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f17da04-a61e-4013-ab9b-d783152f735f None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:12:59.947545 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f17da04-a61e-4013-ab9b-d783152f735f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:12:59.947842 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f17da04-a61e-4013-ab9b-d783152f735f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:12:59.949188 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f17da04-a61e-4013-ab9b-d783152f735f None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:12:59.956883 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 576/1157] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 15 12:12:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:12:59.962837 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f0408b-d26c-477e-86d4-9ea01362cf92 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:13:00.060017 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f0408b-d26c-477e-86d4-9ea01362cf92 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:13:00.092136 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4227425-60dd-4498-ab8a-1aefd9fba2c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:13:00.092749 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4227425-60dd-4498-ab8a-1aefd9fba2c2 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:13:00.093027 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4227425-60dd-4498-ab8a-1aefd9fba2c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:13:00.093295 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4227425-60dd-4498-ab8a-1aefd9fba2c2 None admin] PATH_INFO: `/v3/users/cad9c9f54f0e42e1870588b0fd79953e` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:13:00.094403 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4227425-60dd-4498-ab8a-1aefd9fba2c2 None admin] RBAC: Authorizing `identity:get_user(user_id=cad9c9f54f0e42e1870588b0fd79953e)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:13:00.095847 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4227425-60dd-4498-ab8a-1aefd9fba2c2 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:13:00.097402 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 582/1158] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 15 12:12:59 2022] GET /identity/v3/users/cad9c9f54f0e42e1870588b0fd79953e => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:13:00.103064 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f17da04-a61e-4013-ab9b-d783152f735f None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:13:00.198819 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f17da04-a61e-4013-ab9b-d783152f735f None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:13:00.230995 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91015dc-da18-47d9-83ec-bdce713a83fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:13:00.231647 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91015dc-da18-47d9-83ec-bdce713a83fe None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:13:00.232514 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91015dc-da18-47d9-83ec-bdce713a83fe None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:13:00.232794 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91015dc-da18-47d9-83ec-bdce713a83fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:13:00.254625 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:13:00.303317 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91015dc-da18-47d9-83ec-bdce713a83fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:13:00.304752 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91015dc-da18-47d9-83ec-bdce713a83fe None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:13:00.401973 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 577/1159] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 15 12:13:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 12:13:00.408049 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4227425-60dd-4498-ab8a-1aefd9fba2c2 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:13:00.417000 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:13:00.509145 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4227425-60dd-4498-ab8a-1aefd9fba2c2 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:13:00.540545 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2803d9ae-3af8-4db2-a7b3-04814b93ba56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:13:00.541151 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803d9ae-3af8-4db2-a7b3-04814b93ba56 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:13:00.541425 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803d9ae-3af8-4db2-a7b3-04814b93ba56 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:13:00.541691 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803d9ae-3af8-4db2-a7b3-04814b93ba56 None admin] PATH_INFO: `/v3/projects/5f4df2e96b75487cb71cfe3534d45021` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:13:00.542798 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2803d9ae-3af8-4db2-a7b3-04814b93ba56 None admin] RBAC: Authorizing `identity:get_project(project_id=5f4df2e96b75487cb71cfe3534d45021)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:13:00.544206 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2803d9ae-3af8-4db2-a7b3-04814b93ba56 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:13:00.546315 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 583/1160] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 15 12:13:00 2022] GET /identity/v3/projects/5f4df2e96b75487cb71cfe3534d45021 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:13:00.552425 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91015dc-da18-47d9-83ec-bdce713a83fe None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:13:00.598961 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:13:00.647983 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91015dc-da18-47d9-83ec-bdce713a83fe None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:13:00.680966 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfc7b54-0771-4101-b7cf-01de7aae23d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:13:00.681550 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc7b54-0771-4101-b7cf-01de7aae23d8 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:13:00.681826 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc7b54-0771-4101-b7cf-01de7aae23d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:13:00.682096 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc7b54-0771-4101-b7cf-01de7aae23d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:13:00.682837 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfc7b54-0771-4101-b7cf-01de7aae23d8 None admin] RBAC: Adding query filter params (role.id=7f53f1c823b746529ba5057bf21b2477, scope.project.id=5f4df2e96b75487cb71cfe3534d45021, user.id=cad9c9f54f0e42e1870588b0fd79953e) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:13:00.683144 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfc7b54-0771-4101-b7cf-01de7aae23d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:13:00.684550 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfc7b54-0771-4101-b7cf-01de7aae23d8 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:13:00.690049 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 578/1161] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 15 12:13:00 2022] GET /identity/v3/role_assignments?user.id=cad9c9f54f0e42e1870588b0fd79953e&scope.project.id=5f4df2e96b75487cb71cfe3534d45021&role.id=7f53f1c823b746529ba5057bf21b2477 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:13:02.851845 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d0ef2d-9778-4520-8197-20d410e829dd None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:13:02.852372 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d0ef2d-9778-4520-8197-20d410e829dd None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:13:02.852372 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d0ef2d-9778-4520-8197-20d410e829dd None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:13:02.853722 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 584/1162] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:13:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:13:02.858822 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031dae5e-bda6-4351-8765-63c4937214d7 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:13:02.859194 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031dae5e-bda6-4351-8765-63c4937214d7 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:13:02.859368 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031dae5e-bda6-4351-8765-63c4937214d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:13:02.877217 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-031dae5e-bda6-4351-8765-63c4937214d7 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:13:02.878376 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-031dae5e-bda6-4351-8765-63c4937214d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:13:02.942433 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 579/1163] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:13:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:13:03.207906 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d0ef2d-9778-4520-8197-20d410e829dd None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:13:03.281726 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:13:03.307106 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d0ef2d-9778-4520-8197-20d410e829dd None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:13:03.339282 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa311b70-57fd-4679-a413-cba53fbed42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:13:03.339874 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa311b70-57fd-4679-a413-cba53fbed42e None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:13:03.340156 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa311b70-57fd-4679-a413-cba53fbed42e None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:13:03.340431 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa311b70-57fd-4679-a413-cba53fbed42e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:13:03.404379 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa311b70-57fd-4679-a413-cba53fbed42e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:13:03.405870 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa311b70-57fd-4679-a413-cba53fbed42e None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:13:03.474747 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:13:03.500396 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 585/1164] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 15 12:13:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 12:13:03.506392 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031dae5e-bda6-4351-8765-63c4937214d7 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:13:03.556139 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:13:03.623189 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031dae5e-bda6-4351-8765-63c4937214d7 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:13:03.655637 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e194dce-767e-46ee-bfff-687522524ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:13:03.656254 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e194dce-767e-46ee-bfff-687522524ba6 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:13:03.656528 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e194dce-767e-46ee-bfff-687522524ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:13:03.656795 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e194dce-767e-46ee-bfff-687522524ba6 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:13:03.663145 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e194dce-767e-46ee-bfff-687522524ba6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:13:03.664572 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e194dce-767e-46ee-bfff-687522524ba6 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:13:03.676227 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-7e194dce-767e-46ee-bfff-687522524ba6 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 15 12:13:03.676227 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:13:03.676227 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 15 12:13:03.676227 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 15 12:13:03.676227 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 12:13:03.676227 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 12:13:03.676227 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 12:13:03.676227 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 12:13:03.676227 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 15 12:13:03.676227 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:13:03.676227 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 12:13:03.676227 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:13:03.676227 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:13:03.676227 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:13:03.676227 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:13:03.676227 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:13:03.676227 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:13:03.677414 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:13:03.677414 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:13:03.677414 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:13:03.677414 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:13:03.677414 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:13:03.677414 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:13:03.677414 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:13:03.677414 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:13:03.677414 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:13:03.677414 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:13:03.677414 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:13:03.677414 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:13:03.677414 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:13:03.677414 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:13:03.677414 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:13:03.677414 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:13:03.678441 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:13:03.678441 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:13:03.678441 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:13:03.678441 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:13:03.678441 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:13:03.678441 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:13:03.678441 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:13:03.678441 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:13:03.678441 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:13:03.678441 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:13:03.678441 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 15 12:13:03.678441 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:13:03.678441 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 15 12:13:03.678441 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:13:03.678441 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 580/1165] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Sep 15 12:13:03 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:13:03.683337 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa311b70-57fd-4679-a413-cba53fbed42e None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:13:03.777276 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa311b70-57fd-4679-a413-cba53fbed42e None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:13:03.809598 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d942be1-bd2b-483c-bed6-8328a4b5083c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:13:03.810197 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d942be1-bd2b-483c-bed6-8328a4b5083c None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:13:03.810471 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d942be1-bd2b-483c-bed6-8328a4b5083c None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:13:03.810764 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d942be1-bd2b-483c-bed6-8328a4b5083c None admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:13:03.811390 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d942be1-bd2b-483c-bed6-8328a4b5083c None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:13:03.811685 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d942be1-bd2b-483c-bed6-8328a4b5083c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:13:03.813005 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d942be1-bd2b-483c-bed6-8328a4b5083c None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:13:03.819735 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 586/1166] 10.222.0.16 () {56 vars in 1115 bytes} [Thu Sep 15 12:13:03 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:13:05.999085 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0817aa-dfd1-4b37-8441-851ac562636a None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:13:05.999527 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0817aa-dfd1-4b37-8441-851ac562636a None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:13:05.999626 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0817aa-dfd1-4b37-8441-851ac562636a None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:13:06.000958 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 581/1167] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:13:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:13:06.006511 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d2bff-4db7-4e31-ac0a-0c99e5122584 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:13:06.006949 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d2bff-4db7-4e31-ac0a-0c99e5122584 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:13:06.007090 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d2bff-4db7-4e31-ac0a-0c99e5122584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:13:06.025267 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-a51d2bff-4db7-4e31-ac0a-0c99e5122584 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:13:06.026433 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-a51d2bff-4db7-4e31-ac0a-0c99e5122584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:13:06.054157 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:13:06.090489 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 587/1168] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:13:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:13:06.358758 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0817aa-dfd1-4b37-8441-851ac562636a None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:13:06.456205 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0817aa-dfd1-4b37-8441-851ac562636a None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:13:06.457658 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:13:06.489285 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9146b0b5-6bda-4608-a02e-99696bee99db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:13:06.489871 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9146b0b5-6bda-4608-a02e-99696bee99db None admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:13:06.490143 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9146b0b5-6bda-4608-a02e-99696bee99db None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:13:06.490408 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9146b0b5-6bda-4608-a02e-99696bee99db None admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:13:06.491107 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9146b0b5-6bda-4608-a02e-99696bee99db None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:13:06.492437 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9146b0b5-6bda-4608-a02e-99696bee99db None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:13:06.507972 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 582/1169] 10.222.0.16 () {60 vars in 1138 bytes} [Thu Sep 15 12:13:06 2022] POST /identity/v3/domains => generated 267 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:13:08.658704 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6283fdfc-fa66-480e-8191-8cd4a05e60f0 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:13:08.659231 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6283fdfc-fa66-480e-8191-8cd4a05e60f0 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:13:08.659345 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6283fdfc-fa66-480e-8191-8cd4a05e60f0 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:13:08.660592 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 588/1170] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:13:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:13:08.665882 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d199b94d-383f-4aa5-8f06-1e108c1c54db None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:13:08.666312 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d199b94d-383f-4aa5-8f06-1e108c1c54db None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:13:08.666410 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d199b94d-383f-4aa5-8f06-1e108c1c54db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:13:08.684175 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-d199b94d-383f-4aa5-8f06-1e108c1c54db None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:13:08.685336 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-d199b94d-383f-4aa5-8f06-1e108c1c54db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:13:08.749301 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 583/1171] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:13:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:13:09.013840 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6283fdfc-fa66-480e-8191-8cd4a05e60f0 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:13:09.109292 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6283fdfc-fa66-480e-8191-8cd4a05e60f0 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:13:09.142361 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11d16bf-0345-4d5a-adad-05ea7424b092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:13:09.143006 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d16bf-0345-4d5a-adad-05ea7424b092 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:13:09.143284 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d16bf-0345-4d5a-adad-05ea7424b092 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:13:09.143551 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d16bf-0345-4d5a-adad-05ea7424b092 None admin] PATH_INFO: `/v3/domains/8605dcef48ef4fa0a5b2df21823e0fbe` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:13:09.153460 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11d16bf-0345-4d5a-adad-05ea7424b092 None admin] RBAC: Authorizing `identity:get_domain(domain_id=8605dcef48ef4fa0a5b2df21823e0fbe)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:13:09.154913 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11d16bf-0345-4d5a-adad-05ea7424b092 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:13:09.156669 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 589/1172] 10.222.0.16 () {56 vars in 1183 bytes} [Thu Sep 15 12:13:09 2022] GET /identity/v3/domains/8605dcef48ef4fa0a5b2df21823e0fbe => generated 267 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:13:09.162216 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d199b94d-383f-4aa5-8f06-1e108c1c54db None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:13:09.248397 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:13:09.258540 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d199b94d-383f-4aa5-8f06-1e108c1c54db None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:13:09.291176 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344a31ee-9f1c-4dab-bec8-7a86f8fb8d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:13:09.291770 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a31ee-9f1c-4dab-bec8-7a86f8fb8d45 None admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:13:09.292042 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a31ee-9f1c-4dab-bec8-7a86f8fb8d45 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:13:09.292309 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a31ee-9f1c-4dab-bec8-7a86f8fb8d45 None admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:13:09.292941 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344a31ee-9f1c-4dab-bec8-7a86f8fb8d45 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:13:09.294885 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344a31ee-9f1c-4dab-bec8-7a86f8fb8d45 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:13:09.320120 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 584/1173] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Sep 15 12:13:09 2022] POST /identity/v3/projects => generated 361 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 12:13:11.490189 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d5714-a6a7-4c36-ae1c-5510b6cb9938 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:13:11.490742 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d5714-a6a7-4c36-ae1c-5510b6cb9938 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:13:11.490742 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d5714-a6a7-4c36-ae1c-5510b6cb9938 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:13:11.492082 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 590/1174] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:13:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:13:11.497196 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ba19a-5371-462c-bd80-ae3a459cea24 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:13:11.497576 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ba19a-5371-462c-bd80-ae3a459cea24 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:13:11.497743 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ba19a-5371-462c-bd80-ae3a459cea24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:13:11.516236 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-c81ba19a-5371-462c-bd80-ae3a459cea24 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:13:11.517400 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-c81ba19a-5371-462c-bd80-ae3a459cea24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:13:11.580493 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 585/1175] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:13:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:13:11.847765 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8d5714-a6a7-4c36-ae1c-5510b6cb9938 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:13:11.875264 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:13:11.946592 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8d5714-a6a7-4c36-ae1c-5510b6cb9938 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:13:11.979727 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4565e3e8-53ee-45f9-836c-67330b7d840a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:13:11.980351 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4565e3e8-53ee-45f9-836c-67330b7d840a None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:13:11.980630 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4565e3e8-53ee-45f9-836c-67330b7d840a None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:13:11.980902 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4565e3e8-53ee-45f9-836c-67330b7d840a None admin] PATH_INFO: `/v3/domains/8605dcef48ef4fa0a5b2df21823e0fbe` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:13:11.982004 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4565e3e8-53ee-45f9-836c-67330b7d840a None admin] RBAC: Authorizing `identity:get_domain(domain_id=8605dcef48ef4fa0a5b2df21823e0fbe)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:13:11.983452 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4565e3e8-53ee-45f9-836c-67330b7d840a None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:13:11.985011 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 591/1176] 10.222.0.16 () {56 vars in 1183 bytes} [Thu Sep 15 12:13:11 2022] GET /identity/v3/domains/8605dcef48ef4fa0a5b2df21823e0fbe => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:13:11.990598 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81ba19a-5371-462c-bd80-ae3a459cea24 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:13:12.062260 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:13:12.087874 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81ba19a-5371-462c-bd80-ae3a459cea24 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:13:12.119914 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01f9f2a-27aa-4518-afe9-a4c2e43222db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:13:12.120451 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01f9f2a-27aa-4518-afe9-a4c2e43222db None admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:13:12.120726 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01f9f2a-27aa-4518-afe9-a4c2e43222db None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:13:12.120992 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01f9f2a-27aa-4518-afe9-a4c2e43222db None admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:13:12.121636 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01f9f2a-27aa-4518-afe9-a4c2e43222db None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:13:12.123585 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01f9f2a-27aa-4518-afe9-a4c2e43222db None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:13:12.144912 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 586/1177] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Sep 15 12:13:11 2022] POST /identity/v3/users => generated 311 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:13:14.320843 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd1283e-0202-4d71-bd79-0e668275d4c2 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:13:14.321358 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd1283e-0202-4d71-bd79-0e668275d4c2 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:13:14.321358 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd1283e-0202-4d71-bd79-0e668275d4c2 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:13:14.322629 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 592/1178] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:13:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:13:14.327865 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b8dcd-8df4-409c-8f5e-8aa2c2780ade None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:13:14.328236 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b8dcd-8df4-409c-8f5e-8aa2c2780ade None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:13:14.328425 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b8dcd-8df4-409c-8f5e-8aa2c2780ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:13:14.347344 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-182b8dcd-8df4-409c-8f5e-8aa2c2780ade None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:13:14.348536 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-182b8dcd-8df4-409c-8f5e-8aa2c2780ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:13:14.412610 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 587/1179] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:13:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:13:14.686257 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd1283e-0202-4d71-bd79-0e668275d4c2 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:13:14.775807 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:13:14.782805 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd1283e-0202-4d71-bd79-0e668275d4c2 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:13:14.814845 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d54657-93db-4d2a-8a71-5fdfb8bf8077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:13:14.815448 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d54657-93db-4d2a-8a71-5fdfb8bf8077 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:13:14.815721 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d54657-93db-4d2a-8a71-5fdfb8bf8077 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:13:14.815985 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d54657-93db-4d2a-8a71-5fdfb8bf8077 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:13:14.825896 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d54657-93db-4d2a-8a71-5fdfb8bf8077 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:13:14.830592 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-36d54657-93db-4d2a-8a71-5fdfb8bf8077 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:13:14.830592 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:13:14.830592 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:13:14.830592 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:13:14.830592 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:13:14.830592 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:13:14.830592 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:13:14.830592 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:13:14.830592 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:13:14.830592 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:13:14.830592 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:13:14.830592 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:13:14.830592 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:13:14.830592 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:13:14.830592 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:13:14.830592 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:13:14.831691 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:13:14.831691 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:13:14.831691 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:13:14.831691 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:13:14.831691 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:13:14.831691 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:13:14.831691 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:13:14.831691 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:13:14.831691 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:13:14.831691 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:13:14.831691 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:13:14.831691 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:13:14.831691 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:13:14.831691 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:13:14.831691 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:13:14.831691 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:13:14.832555 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:13:14.832555 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:13:14.832555 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:13:14.832555 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:13:14.832555 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:13:14.832555 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:13:14.832555 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:13:14.832555 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:13:14.832555 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:13:14.832555 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:13:14.832555 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:13:14.832555 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:13:14.832555 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 593/1180] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Sep 15 12:13:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:13:14.837456 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b8dcd-8df4-409c-8f5e-8aa2c2780ade None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:13:14.893569 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:13:14.934088 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b8dcd-8df4-409c-8f5e-8aa2c2780ade None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:13:14.966859 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8d9dff-565c-49ec-a278-e3b93d6c26bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:13:14.967406 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d9dff-565c-49ec-a278-e3b93d6c26bc None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:13:14.967693 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d9dff-565c-49ec-a278-e3b93d6c26bc None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:13:14.967962 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d9dff-565c-49ec-a278-e3b93d6c26bc None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:13:14.968625 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8d9dff-565c-49ec-a278-e3b93d6c26bc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:13:14.968955 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8d9dff-565c-49ec-a278-e3b93d6c26bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:13:14.970332 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8d9dff-565c-49ec-a278-e3b93d6c26bc None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:13:14.978571 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 588/1181] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 15 12:13:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:13:14.984998 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d54657-93db-4d2a-8a71-5fdfb8bf8077 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:13:15.081393 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d54657-93db-4d2a-8a71-5fdfb8bf8077 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:13:15.113716 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d6424b-4c91-492c-ad4e-4b32bac35492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:13:15.114321 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d6424b-4c91-492c-ad4e-4b32bac35492 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:13:15.114596 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d6424b-4c91-492c-ad4e-4b32bac35492 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:13:15.114890 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d6424b-4c91-492c-ad4e-4b32bac35492 None admin] PATH_INFO: `/v3/users/48bcab9c2eba43bbb49ba8399db2583b` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:13:15.127391 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d6424b-4c91-492c-ad4e-4b32bac35492 None admin] RBAC: Authorizing `identity:get_user(user_id=48bcab9c2eba43bbb49ba8399db2583b)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:13:15.128804 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d6424b-4c91-492c-ad4e-4b32bac35492 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:13:15.130349 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 594/1182] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 15 12:13:14 2022] GET /identity/v3/users/48bcab9c2eba43bbb49ba8399db2583b => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:13:15.136150 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8d9dff-565c-49ec-a278-e3b93d6c26bc None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:13:15.232576 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8d9dff-565c-49ec-a278-e3b93d6c26bc None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:13:15.253489 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:13:15.265762 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da7f379-1cc6-4b20-8560-9d06cb6a895a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:13:15.266356 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da7f379-1cc6-4b20-8560-9d06cb6a895a None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:13:15.266637 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da7f379-1cc6-4b20-8560-9d06cb6a895a None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:13:15.266939 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da7f379-1cc6-4b20-8560-9d06cb6a895a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:13:15.330913 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da7f379-1cc6-4b20-8560-9d06cb6a895a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:13:15.332345 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da7f379-1cc6-4b20-8560-9d06cb6a895a None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:13:15.425408 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 589/1183] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 15 12:13:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 12:13:15.431186 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d6424b-4c91-492c-ad4e-4b32bac35492 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:13:15.446548 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:13:15.526247 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d6424b-4c91-492c-ad4e-4b32bac35492 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:13:15.558382 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0174cd35-7625-416d-bc3f-b7a790a22424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:13:15.559018 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0174cd35-7625-416d-bc3f-b7a790a22424 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:13:15.559296 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0174cd35-7625-416d-bc3f-b7a790a22424 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:13:15.560154 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0174cd35-7625-416d-bc3f-b7a790a22424 None admin] PATH_INFO: `/v3/projects/1f51203fd6d14dae8e390db718fdd2f5` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:13:15.561256 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0174cd35-7625-416d-bc3f-b7a790a22424 None admin] RBAC: Authorizing `identity:get_project(project_id=1f51203fd6d14dae8e390db718fdd2f5)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:13:15.562663 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0174cd35-7625-416d-bc3f-b7a790a22424 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:13:15.564287 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 595/1184] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 15 12:13:15 2022] GET /identity/v3/projects/1f51203fd6d14dae8e390db718fdd2f5 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:13:15.570280 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da7f379-1cc6-4b20-8560-9d06cb6a895a None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:13:15.592765 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:13:15.667736 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da7f379-1cc6-4b20-8560-9d06cb6a895a None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:13:15.704422 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f64e3f-7874-4aa4-b4f7-83c3e78b31dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:13:15.705020 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f64e3f-7874-4aa4-b4f7-83c3e78b31dc None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:13:15.705298 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f64e3f-7874-4aa4-b4f7-83c3e78b31dc None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:13:15.705568 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f64e3f-7874-4aa4-b4f7-83c3e78b31dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:13:15.706289 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f64e3f-7874-4aa4-b4f7-83c3e78b31dc None admin] RBAC: Adding query filter params (role.id=7f53f1c823b746529ba5057bf21b2477, scope.project.id=1f51203fd6d14dae8e390db718fdd2f5, user.id=48bcab9c2eba43bbb49ba8399db2583b) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:13:15.706593 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f64e3f-7874-4aa4-b4f7-83c3e78b31dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:13:15.708046 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f64e3f-7874-4aa4-b4f7-83c3e78b31dc None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:13:15.713344 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 590/1185] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 15 12:13:15 2022] GET /identity/v3/role_assignments?user.id=48bcab9c2eba43bbb49ba8399db2583b&scope.project.id=1f51203fd6d14dae8e390db718fdd2f5&role.id=7f53f1c823b746529ba5057bf21b2477 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:13:17.825635 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83021f38-c60d-4122-a97f-65e029962bd7 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:13:17.826203 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83021f38-c60d-4122-a97f-65e029962bd7 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:13:17.826203 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83021f38-c60d-4122-a97f-65e029962bd7 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:13:17.827545 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 596/1186] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:13:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:13:17.832697 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8919d0d-74bd-4773-9ca8-3ea2f09b38b8 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:13:17.833078 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8919d0d-74bd-4773-9ca8-3ea2f09b38b8 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:13:17.833234 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8919d0d-74bd-4773-9ca8-3ea2f09b38b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:13:17.851679 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-c8919d0d-74bd-4773-9ca8-3ea2f09b38b8 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:13:17.852842 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-c8919d0d-74bd-4773-9ca8-3ea2f09b38b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:13:17.918241 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 591/1187] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:13:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 12:13:18.187292 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83021f38-c60d-4122-a97f-65e029962bd7 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:13:18.266373 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:13:18.285302 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83021f38-c60d-4122-a97f-65e029962bd7 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:13:18.318180 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b407c70b-d5c6-4011-bdbf-5147ef2e12bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:13:18.318817 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407c70b-d5c6-4011-bdbf-5147ef2e12bc None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:13:18.319091 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407c70b-d5c6-4011-bdbf-5147ef2e12bc None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:13:18.319354 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407c70b-d5c6-4011-bdbf-5147ef2e12bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:13:18.329004 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b407c70b-d5c6-4011-bdbf-5147ef2e12bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:13:18.333678 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-b407c70b-d5c6-4011-bdbf-5147ef2e12bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:13:18.333678 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:13:18.333678 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:13:18.333678 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:13:18.333678 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:13:18.333678 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:13:18.333678 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:13:18.333678 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:13:18.333678 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:13:18.333678 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:13:18.333678 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:13:18.333678 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:13:18.333678 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:13:18.333678 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:13:18.333678 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:13:18.333678 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:13:18.334651 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:13:18.334651 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:13:18.334651 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:13:18.334651 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:13:18.334651 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:13:18.334651 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:13:18.334651 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:13:18.334651 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:13:18.334651 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:13:18.334651 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:13:18.334651 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:13:18.334651 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:13:18.334651 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:13:18.334651 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:13:18.334651 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:13:18.334651 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:13:18.335572 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:13:18.335572 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:13:18.335572 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:13:18.335572 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:13:18.335572 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:13:18.335572 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:13:18.335572 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:13:18.335572 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:13:18.335572 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:13:18.335572 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:13:18.335572 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:13:18.335572 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:13:18.335572 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 597/1188] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Sep 15 12:13:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:13:18.340702 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8919d0d-74bd-4773-9ca8-3ea2f09b38b8 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:13:18.357912 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:13:18.436426 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8919d0d-74bd-4773-9ca8-3ea2f09b38b8 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:13:18.468620 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1240c680-8a4b-4534-bd6f-82aae9e7e90a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:13:18.469163 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240c680-8a4b-4534-bd6f-82aae9e7e90a None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:13:18.469440 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240c680-8a4b-4534-bd6f-82aae9e7e90a None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:13:18.469708 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240c680-8a4b-4534-bd6f-82aae9e7e90a None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:13:18.470367 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1240c680-8a4b-4534-bd6f-82aae9e7e90a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:13:18.470666 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1240c680-8a4b-4534-bd6f-82aae9e7e90a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:13:18.472056 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1240c680-8a4b-4534-bd6f-82aae9e7e90a None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:13:18.479711 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 592/1189] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 15 12:13:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:13:18.485926 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b407c70b-d5c6-4011-bdbf-5147ef2e12bc None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:13:18.580310 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b407c70b-d5c6-4011-bdbf-5147ef2e12bc None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:13:18.612178 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8c9ee8-3c60-4b8c-b7b7-a90864ecb9a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:13:18.612776 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c9ee8-3c60-4b8c-b7b7-a90864ecb9a0 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:13:18.613050 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c9ee8-3c60-4b8c-b7b7-a90864ecb9a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:13:18.613317 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c9ee8-3c60-4b8c-b7b7-a90864ecb9a0 None admin] PATH_INFO: `/v3/users/48bcab9c2eba43bbb49ba8399db2583b` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:13:18.614904 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8c9ee8-3c60-4b8c-b7b7-a90864ecb9a0 None admin] RBAC: Authorizing `identity:get_user(user_id=48bcab9c2eba43bbb49ba8399db2583b)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:13:18.616623 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8c9ee8-3c60-4b8c-b7b7-a90864ecb9a0 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:13:18.618352 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 598/1190] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 15 12:13:18 2022] GET /identity/v3/users/48bcab9c2eba43bbb49ba8399db2583b => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:13:18.624613 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1240c680-8a4b-4534-bd6f-82aae9e7e90a None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:13:18.700317 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:13:18.721508 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1240c680-8a4b-4534-bd6f-82aae9e7e90a None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:13:18.753594 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef92266-3100-4f5a-89ee-a27c8e674bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:13:18.754203 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef92266-3100-4f5a-89ee-a27c8e674bc2 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:13:18.754479 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef92266-3100-4f5a-89ee-a27c8e674bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:13:18.754772 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef92266-3100-4f5a-89ee-a27c8e674bc2 None admin] PATH_INFO: `/v3/projects/1f51203fd6d14dae8e390db718fdd2f5` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:13:18.755857 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef92266-3100-4f5a-89ee-a27c8e674bc2 None admin] RBAC: Authorizing `identity:get_project(project_id=1f51203fd6d14dae8e390db718fdd2f5)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:13:18.757285 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef92266-3100-4f5a-89ee-a27c8e674bc2 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:13:18.758890 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 593/1191] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 15 12:13:18 2022] GET /identity/v3/projects/1f51203fd6d14dae8e390db718fdd2f5 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:13:18.764780 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8c9ee8-3c60-4b8c-b7b7-a90864ecb9a0 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:13:18.776630 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:13:18.861059 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8c9ee8-3c60-4b8c-b7b7-a90864ecb9a0 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:13:18.892988 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbb1e93-eef1-49e7-a229-c8f4eef744f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:13:18.893618 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb1e93-eef1-49e7-a229-c8f4eef744f1 None admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:13:18.893895 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb1e93-eef1-49e7-a229-c8f4eef744f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:13:18.894164 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb1e93-eef1-49e7-a229-c8f4eef744f1 None admin] PATH_INFO: `/v3/projects/1f51203fd6d14dae8e390db718fdd2f5/users/48bcab9c2eba43bbb49ba8399db2583b/roles/7f53f1c823b746529ba5057bf21b2477` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:13:18.896043 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbb1e93-eef1-49e7-a229-c8f4eef744f1 None admin] RBAC: Authorizing `identity:create_grant(project_id=1f51203fd6d14dae8e390db718fdd2f5, user_id=48bcab9c2eba43bbb49ba8399db2583b, role_id=7f53f1c823b746529ba5057bf21b2477)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:13:18.897444 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbb1e93-eef1-49e7-a229-c8f4eef744f1 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:13:18.909674 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 599/1192] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Sep 15 12:13:18 2022] PUT /identity/v3/projects/1f51203fd6d14dae8e390db718fdd2f5/users/48bcab9c2eba43bbb49ba8399db2583b/roles/7f53f1c823b746529ba5057bf21b2477 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:13:21.084792 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b5112f-1a59-40c1-8b5e-3295dd80aa58 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:13:21.085341 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b5112f-1a59-40c1-8b5e-3295dd80aa58 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:13:21.085341 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b5112f-1a59-40c1-8b5e-3295dd80aa58 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:13:21.086641 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 594/1193] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:13:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:13:21.091909 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec462aea-1e11-4fd5-95fe-109575d352b1 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:13:21.092344 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec462aea-1e11-4fd5-95fe-109575d352b1 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:13:21.092476 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec462aea-1e11-4fd5-95fe-109575d352b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:13:21.110168 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-ec462aea-1e11-4fd5-95fe-109575d352b1 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:13:21.111373 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-ec462aea-1e11-4fd5-95fe-109575d352b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:13:21.171998 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:13:21.177042 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 600/1194] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:13:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:13:21.442711 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b5112f-1a59-40c1-8b5e-3295dd80aa58 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:13:21.540274 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b5112f-1a59-40c1-8b5e-3295dd80aa58 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:13:21.571802 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e8d499-040a-483d-9320-a0da895f6777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:13:21.572410 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e8d499-040a-483d-9320-a0da895f6777 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:13:21.572688 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e8d499-040a-483d-9320-a0da895f6777 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:13:21.572958 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e8d499-040a-483d-9320-a0da895f6777 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:13:21.583142 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e8d499-040a-483d-9320-a0da895f6777 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:13:21.587889 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-89e8d499-040a-483d-9320-a0da895f6777 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:13:21.587889 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:13:21.587889 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:13:21.587889 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:13:21.587889 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:13:21.587889 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:13:21.587889 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:13:21.587889 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:13:21.587889 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:13:21.587889 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:13:21.587889 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:13:21.587889 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:13:21.587889 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:13:21.587889 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:13:21.587889 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:13:21.587889 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:13:21.588961 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:13:21.588961 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:13:21.588961 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:13:21.588961 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:13:21.588961 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:13:21.588961 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:13:21.588961 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:13:21.588961 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:13:21.588961 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:13:21.588961 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:13:21.588961 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:13:21.588961 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:13:21.588961 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:13:21.588961 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:13:21.588961 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:13:21.588961 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:13:21.590127 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:13:21.590127 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:13:21.590127 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:13:21.590127 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:13:21.590127 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:13:21.590127 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:13:21.590127 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:13:21.590127 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:13:21.590127 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:13:21.590127 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:13:21.590127 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:13:21.590127 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:13:21.590127 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 595/1195] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Sep 15 12:13:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:13:21.595365 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec462aea-1e11-4fd5-95fe-109575d352b1 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:13:21.689667 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec462aea-1e11-4fd5-95fe-109575d352b1 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:13:21.722054 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1392ac7e-e413-4de7-95fe-54d7502919f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:13:21.722586 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1392ac7e-e413-4de7-95fe-54d7502919f8 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:13:21.722895 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1392ac7e-e413-4de7-95fe-54d7502919f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:13:21.723166 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1392ac7e-e413-4de7-95fe-54d7502919f8 None admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:13:21.723817 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1392ac7e-e413-4de7-95fe-54d7502919f8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:13:21.724115 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1392ac7e-e413-4de7-95fe-54d7502919f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:13:21.725453 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1392ac7e-e413-4de7-95fe-54d7502919f8 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:13:21.733125 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 601/1196] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 15 12:13:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:13:21.738934 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e8d499-040a-483d-9320-a0da895f6777 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:13:21.748930 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:13:21.836605 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e8d499-040a-483d-9320-a0da895f6777 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:13:21.868515 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a257ec-c01c-4e9a-8043-a5ae98b91f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:13:21.869126 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a257ec-c01c-4e9a-8043-a5ae98b91f70 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:13:21.869404 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a257ec-c01c-4e9a-8043-a5ae98b91f70 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:13:21.869675 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a257ec-c01c-4e9a-8043-a5ae98b91f70 None admin] PATH_INFO: `/v3/users/48bcab9c2eba43bbb49ba8399db2583b` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:13:21.870797 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a257ec-c01c-4e9a-8043-a5ae98b91f70 None admin] RBAC: Authorizing `identity:get_user(user_id=48bcab9c2eba43bbb49ba8399db2583b)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:13:21.872743 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a257ec-c01c-4e9a-8043-a5ae98b91f70 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:13:21.874286 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 596/1197] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Sep 15 12:13:21 2022] GET /identity/v3/users/48bcab9c2eba43bbb49ba8399db2583b => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:13:21.880263 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1392ac7e-e413-4de7-95fe-54d7502919f8 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:13:21.939111 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:13:21.977225 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1392ac7e-e413-4de7-95fe-54d7502919f8 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:13:22.010625 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e408f2f-0ed0-40ee-a3bf-bcd1fd1d40ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:13:22.011245 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e408f2f-0ed0-40ee-a3bf-bcd1fd1d40ac None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:13:22.011521 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e408f2f-0ed0-40ee-a3bf-bcd1fd1d40ac None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:13:22.011789 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e408f2f-0ed0-40ee-a3bf-bcd1fd1d40ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:13:22.076063 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e408f2f-0ed0-40ee-a3bf-bcd1fd1d40ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:13:22.077511 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e408f2f-0ed0-40ee-a3bf-bcd1fd1d40ac None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:13:22.133796 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:13:22.171418 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 602/1198] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 15 12:13:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 15 12:13:22.177271 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a257ec-c01c-4e9a-8043-a5ae98b91f70 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:13:22.250466 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:13:22.274439 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a257ec-c01c-4e9a-8043-a5ae98b91f70 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:13:22.306663 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c293906c-95f0-4108-9e3d-405c6c30e3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:13:22.307304 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c293906c-95f0-4108-9e3d-405c6c30e3a9 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:13:22.307582 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c293906c-95f0-4108-9e3d-405c6c30e3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:13:22.307853 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c293906c-95f0-4108-9e3d-405c6c30e3a9 None admin] PATH_INFO: `/v3/projects/1f51203fd6d14dae8e390db718fdd2f5` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:13:22.308942 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c293906c-95f0-4108-9e3d-405c6c30e3a9 None admin] RBAC: Authorizing `identity:get_project(project_id=1f51203fd6d14dae8e390db718fdd2f5)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:13:22.310983 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c293906c-95f0-4108-9e3d-405c6c30e3a9 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:13:22.312581 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 597/1199] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Sep 15 12:13:22 2022] GET /identity/v3/projects/1f51203fd6d14dae8e390db718fdd2f5 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:13:22.318672 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e408f2f-0ed0-40ee-a3bf-bcd1fd1d40ac None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:13:22.412629 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e408f2f-0ed0-40ee-a3bf-bcd1fd1d40ac None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:13:22.444775 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85276e8-d812-47a2-a546-ea3010483199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:13:22.445359 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85276e8-d812-47a2-a546-ea3010483199 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:13:22.445637 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85276e8-d812-47a2-a546-ea3010483199 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:13:22.445904 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85276e8-d812-47a2-a546-ea3010483199 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:13:22.446613 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85276e8-d812-47a2-a546-ea3010483199 None admin] RBAC: Adding query filter params (role.id=7f53f1c823b746529ba5057bf21b2477, scope.project.id=1f51203fd6d14dae8e390db718fdd2f5, user.id=48bcab9c2eba43bbb49ba8399db2583b) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:13:22.447015 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85276e8-d812-47a2-a546-ea3010483199 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:13:22.448409 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85276e8-d812-47a2-a546-ea3010483199 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:13:22.453860 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 603/1200] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 15 12:13:22 2022] GET /identity/v3/role_assignments?user.id=48bcab9c2eba43bbb49ba8399db2583b&scope.project.id=1f51203fd6d14dae8e390db718fdd2f5&role.id=7f53f1c823b746529ba5057bf21b2477 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:13:32.302718 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=29 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:13:32.451416 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=87 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:14:18.169808 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff70ab-d004-45d6-8031-d8ac06451832 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:18.170461 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff70ab-d004-45d6-8031-d8ac06451832 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:18.170461 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff70ab-d004-45d6-8031-d8ac06451832 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:18.171845 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 598/1201] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:14:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:14:18.177323 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b251c09e-fc6f-4f96-9522-39b561e03c7b None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:18.177773 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b251c09e-fc6f-4f96-9522-39b561e03c7b None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:18.177990 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b251c09e-fc6f-4f96-9522-39b561e03c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:18.199577 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-b251c09e-fc6f-4f96-9522-39b561e03c7b None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:14:18.200940 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-b251c09e-fc6f-4f96-9522-39b561e03c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:14:18.285299 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 604/1202] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:14:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:14:18.566025 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ff70ab-d004-45d6-8031-d8ac06451832 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:14:18.706722 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ff70ab-d004-45d6-8031-d8ac06451832 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:14:18.766764 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a463b-f44c-4616-8ed0-ec023ba03c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:14:18.767693 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a463b-f44c-4616-8ed0-ec023ba03c5c None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:18.768074 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a463b-f44c-4616-8ed0-ec023ba03c5c None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:18.768486 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a463b-f44c-4616-8ed0-ec023ba03c5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:18.788915 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9a463b-f44c-4616-8ed0-ec023ba03c5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:14:18.792382 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9a463b-f44c-4616-8ed0-ec023ba03c5c None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:14:18.817323 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-ce9a463b-f44c-4616-8ed0-ec023ba03c5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:14:18.817323 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:14:18.817323 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:14:18.817323 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:14:18.817323 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:14:18.817323 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:14:18.817323 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:14:18.817323 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:14:18.817323 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:14:18.817323 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:14:18.817323 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:14:18.817323 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:14:18.817323 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:14:18.817323 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:14:18.817323 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:14:18.817323 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:14:18.818945 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:14:18.818945 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:14:18.818945 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:14:18.818945 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:14:18.818945 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:14:18.818945 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:14:18.818945 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:14:18.818945 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:14:18.818945 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:14:18.818945 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:14:18.818945 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:14:18.818945 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:14:18.818945 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:14:18.818945 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:14:18.818945 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:14:18.818945 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:14:18.818945 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:14:18.820121 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:14:18.820121 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:14:18.820121 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:14:18.820121 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 599/1203] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:14:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:14:18.824844 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b251c09e-fc6f-4f96-9522-39b561e03c7b None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:14:18.950659 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b251c09e-fc6f-4f96-9522-39b561e03c7b None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:14:19.004581 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:14:19.013575 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d79bd8b-1b11-4ed8-a13a-bec38b622a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:14:19.014262 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d79bd8b-1b11-4ed8-a13a-bec38b622a7f None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:19.014549 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d79bd8b-1b11-4ed8-a13a-bec38b622a7f None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:19.014840 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d79bd8b-1b11-4ed8-a13a-bec38b622a7f None admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:19.015573 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d79bd8b-1b11-4ed8-a13a-bec38b622a7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:14:19.016042 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d79bd8b-1b11-4ed8-a13a-bec38b622a7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:14:19.017193 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d79bd8b-1b11-4ed8-a13a-bec38b622a7f None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:14:19.041185 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 605/1204] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 15 12:14:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:14:19.041409 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a463b-f44c-4616-8ed0-ec023ba03c5c None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:14:19.108438 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:14:19.176640 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a463b-f44c-4616-8ed0-ec023ba03c5c None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:14:19.218425 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a748abb-95d7-4a34-a804-6b9121e83511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:14:19.219009 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a748abb-95d7-4a34-a804-6b9121e83511 None admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:19.219288 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a748abb-95d7-4a34-a804-6b9121e83511 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:19.219562 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a748abb-95d7-4a34-a804-6b9121e83511 None admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:19.220207 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a748abb-95d7-4a34-a804-6b9121e83511 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:14:19.221633 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a748abb-95d7-4a34-a804-6b9121e83511 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:14:19.244454 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 600/1205] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Sep 15 12:14:19 2022] POST /identity/v3/users => generated 251 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 12:14:21.843528 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ab61a-d8ca-4e18-881b-8f3abeafd0b6 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:21.844133 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ab61a-d8ca-4e18-881b-8f3abeafd0b6 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:21.844133 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ab61a-d8ca-4e18-881b-8f3abeafd0b6 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:21.845676 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 606/1206] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:14:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:14:21.854913 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc49c68-cc01-4827-8793-35db0d4d5d5c None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:21.854913 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc49c68-cc01-4827-8793-35db0d4d5d5c None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:21.854913 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc49c68-cc01-4827-8793-35db0d4d5d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:21.873025 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-afc49c68-cc01-4827-8793-35db0d4d5d5c None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:14:21.874297 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-afc49c68-cc01-4827-8793-35db0d4d5d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:14:21.953370 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 601/1207] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:14:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:14:22.231768 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1ab61a-d8ca-4e18-881b-8f3abeafd0b6 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:14:22.351114 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1ab61a-d8ca-4e18-881b-8f3abeafd0b6 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:14:22.411149 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac03fd17-99ca-4c66-bb2d-709fc4307442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:14:22.412322 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac03fd17-99ca-4c66-bb2d-709fc4307442 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:22.412322 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac03fd17-99ca-4c66-bb2d-709fc4307442 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:22.412536 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac03fd17-99ca-4c66-bb2d-709fc4307442 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:22.427151 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac03fd17-99ca-4c66-bb2d-709fc4307442 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:14:22.435342 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-ac03fd17-99ca-4c66-bb2d-709fc4307442 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 12:14:22.435342 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:14:22.435342 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:14:22.435342 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:14:22.435342 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:14:22.435342 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:14:22.435342 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:14:22.435342 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:14:22.435342 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:14:22.435342 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:14:22.435342 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:14:22.435342 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:14:22.435342 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:14:22.435342 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:14:22.435342 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:14:22.435342 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:14:22.436550 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:14:22.436550 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:14:22.436550 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:14:22.436550 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:14:22.436550 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:14:22.436550 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:14:22.436550 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:14:22.436550 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:14:22.436550 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:14:22.436550 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:14:22.436550 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:14:22.436550 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:14:22.436550 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:14:22.436550 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:14:22.436550 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:14:22.436550 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:14:22.437593 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:14:22.437593 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:14:22.437593 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:14:22.437593 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:14:22.437593 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:14:22.437593 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:14:22.437593 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:14:22.437593 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:14:22.437593 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:14:22.437593 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:14:22.437593 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 12:14:22.437593 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:14:22.437593 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 607/1208] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Sep 15 12:14:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:14:22.442985 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc49c68-cc01-4827-8793-35db0d4d5d5c None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:14:22.497402 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:14:22.576547 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc49c68-cc01-4827-8793-35db0d4d5d5c None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:14:22.619486 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcecafc0-b23b-4f3c-91d8-009b6381b792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:14:22.620800 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcecafc0-b23b-4f3c-91d8-009b6381b792 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:22.621168 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcecafc0-b23b-4f3c-91d8-009b6381b792 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:22.621494 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcecafc0-b23b-4f3c-91d8-009b6381b792 None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:22.622552 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcecafc0-b23b-4f3c-91d8-009b6381b792 None admin] RBAC: Adding query filter params (name=service) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:14:22.623037 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcecafc0-b23b-4f3c-91d8-009b6381b792 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:14:22.625062 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcecafc0-b23b-4f3c-91d8-009b6381b792 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:14:22.637281 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 602/1209] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Sep 15 12:14:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:14:22.643084 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac03fd17-99ca-4c66-bb2d-709fc4307442 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:14:22.709040 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:14:22.777878 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac03fd17-99ca-4c66-bb2d-709fc4307442 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:14:22.817663 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc136512-1a29-4ed5-afcb-44e3694efe64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:14:22.818292 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc136512-1a29-4ed5-afcb-44e3694efe64 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:22.818568 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc136512-1a29-4ed5-afcb-44e3694efe64 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:22.818869 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc136512-1a29-4ed5-afcb-44e3694efe64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:22.830677 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc136512-1a29-4ed5-afcb-44e3694efe64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:14:22.832163 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc136512-1a29-4ed5-afcb-44e3694efe64 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:14:22.851026 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-fc136512-1a29-4ed5-afcb-44e3694efe64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:14:22.851026 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:14:22.851026 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:14:22.851026 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:14:22.851026 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:14:22.851026 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:14:22.851026 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:14:22.851026 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:14:22.851026 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:14:22.851026 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:14:22.851026 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:14:22.851026 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:14:22.851026 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:14:22.851026 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:14:22.851026 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:14:22.851026 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:14:22.853163 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:14:22.853163 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:14:22.853163 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:14:22.853163 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:14:22.853163 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:14:22.853163 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:14:22.853163 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:14:22.853163 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:14:22.853163 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:14:22.853163 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:14:22.853163 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:14:22.853163 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:14:22.853163 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:14:22.853163 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:14:22.853163 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:14:22.853163 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:14:22.853163 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:14:22.854832 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:14:22.854832 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:14:22.854832 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:14:22.854832 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 608/1210] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:14:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:14:22.858420 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcecafc0-b23b-4f3c-91d8-009b6381b792 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:14:22.980966 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:14:22.984419 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcecafc0-b23b-4f3c-91d8-009b6381b792 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:14:23.029361 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a9936-f468-4b4b-8f88-97559477d97e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:14:23.030000 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a9936-f468-4b4b-8f88-97559477d97e None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:23.030279 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a9936-f468-4b4b-8f88-97559477d97e None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:23.030611 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a9936-f468-4b4b-8f88-97559477d97e None admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:23.031483 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3a9936-f468-4b4b-8f88-97559477d97e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:14:23.031878 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3a9936-f468-4b4b-8f88-97559477d97e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:14:23.033576 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3a9936-f468-4b4b-8f88-97559477d97e None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:14:23.052230 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 603/1211] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 15 12:14:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:14:23.053793 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc136512-1a29-4ed5-afcb-44e3694efe64 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:14:23.177079 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc136512-1a29-4ed5-afcb-44e3694efe64 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:14:23.179131 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:14:23.217839 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ee81cf-6c79-4137-ba05-dcdb5be77c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:14:23.219251 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee81cf-6c79-4137-ba05-dcdb5be77c58 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:23.219251 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee81cf-6c79-4137-ba05-dcdb5be77c58 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:23.219463 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee81cf-6c79-4137-ba05-dcdb5be77c58 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:23.227954 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ee81cf-6c79-4137-ba05-dcdb5be77c58 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:14:23.229970 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ee81cf-6c79-4137-ba05-dcdb5be77c58 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:14:23.241952 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-e2ee81cf-6c79-4137-ba05-dcdb5be77c58 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 15 12:14:23.241952 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:14:23.241952 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:14:23.241952 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:14:23.241952 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:14:23.241952 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:14:23.241952 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:14:23.241952 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:14:23.241952 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:14:23.241952 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:14:23.241952 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:14:23.241952 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:14:23.241952 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 12:14:23.241952 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 12:14:23.241952 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 12:14:23.241952 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 12:14:23.243203 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:14:23.243203 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:14:23.243203 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 12:14:23.243203 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:14:23.243203 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 12:14:23.243203 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:14:23.243203 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:14:23.243203 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:14:23.243203 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:14:23.243203 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:14:23.243203 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:14:23.243203 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:14:23.243203 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:14:23.243203 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:14:23.243203 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:14:23.243203 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:14:23.243203 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:14:23.243203 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:14:23.244185 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:14:23.244185 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:14:23.244185 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 12:14:23.244185 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 12:14:23.244185 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 12:14:23.244185 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 12:14:23.244185 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 12:14:23.244185 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 12:14:23.244185 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 15 12:14:23.244185 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:14:23.244185 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 609/1212] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:14:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:14:23.249278 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a9936-f468-4b4b-8f88-97559477d97e None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:14:23.370828 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a9936-f468-4b4b-8f88-97559477d97e None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:14:23.413800 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce848680-0658-4b8f-ac5b-f6fe2787a00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:14:23.414412 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce848680-0658-4b8f-ac5b-f6fe2787a00a None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:23.414829 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce848680-0658-4b8f-ac5b-f6fe2787a00a None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:23.416350 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce848680-0658-4b8f-ac5b-f6fe2787a00a None admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:23.416350 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce848680-0658-4b8f-ac5b-f6fe2787a00a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:14:23.416350 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce848680-0658-4b8f-ac5b-f6fe2787a00a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:14:23.418165 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce848680-0658-4b8f-ac5b-f6fe2787a00a None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:14:23.439340 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 604/1213] 10.222.0.16 () {56 vars in 1143 bytes} [Thu Sep 15 12:14:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:14:23.445439 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ee81cf-6c79-4137-ba05-dcdb5be77c58 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:14:23.560061 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ee81cf-6c79-4137-ba05-dcdb5be77c58 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:14:23.601642 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9835a8c9-7219-4c23-aed7-02ae6276c721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:14:23.602290 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9835a8c9-7219-4c23-aed7-02ae6276c721 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:23.602569 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9835a8c9-7219-4c23-aed7-02ae6276c721 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:23.602875 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9835a8c9-7219-4c23-aed7-02ae6276c721 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:23.648678 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:14:23.704667 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9835a8c9-7219-4c23-aed7-02ae6276c721 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:14:23.706280 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9835a8c9-7219-4c23-aed7-02ae6276c721 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:14:23.817422 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 610/1214] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 15 12:14:23 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 15 12:14:23.823357 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce848680-0658-4b8f-ac5b-f6fe2787a00a None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:14:23.843517 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:14:23.931364 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce848680-0658-4b8f-ac5b-f6fe2787a00a None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:14:23.975130 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c6cdfe-a42a-4db6-bf39-88f696c5b469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:14:23.975772 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c6cdfe-a42a-4db6-bf39-88f696c5b469 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:23.976049 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c6cdfe-a42a-4db6-bf39-88f696c5b469 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:23.976316 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c6cdfe-a42a-4db6-bf39-88f696c5b469 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:23.988270 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c6cdfe-a42a-4db6-bf39-88f696c5b469 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:14:23.989807 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c6cdfe-a42a-4db6-bf39-88f696c5b469 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:14:24.006079 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-99c6cdfe-a42a-4db6-bf39-88f696c5b469 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:14:24.006079 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:14:24.006079 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:14:24.006079 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:14:24.006079 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:14:24.006079 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:14:24.006079 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:14:24.006079 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:14:24.006079 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:14:24.006079 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:14:24.006079 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:14:24.006079 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:14:24.006079 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:14:24.006079 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:14:24.006079 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:14:24.006079 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:14:24.007419 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:14:24.007419 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:14:24.007419 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:14:24.007419 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:14:24.007419 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:14:24.007419 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:14:24.007419 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:14:24.007419 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:14:24.007419 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:14:24.007419 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:14:24.007419 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:14:24.007419 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:14:24.007419 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:14:24.007419 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:14:24.007419 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:14:24.007419 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:14:24.007419 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:14:24.008611 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:14:24.008611 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:14:24.008611 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:14:24.008611 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 605/1215] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:14:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:14:24.013138 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9835a8c9-7219-4c23-aed7-02ae6276c721 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:14:24.076185 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:14:24.118917 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9835a8c9-7219-4c23-aed7-02ae6276c721 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:14:24.158310 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb9342f-603d-441a-ba80-61276b7f6883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:14:24.159064 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb9342f-603d-441a-ba80-61276b7f6883 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:24.159349 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb9342f-603d-441a-ba80-61276b7f6883 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:24.159705 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb9342f-603d-441a-ba80-61276b7f6883 None admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:24.160503 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb9342f-603d-441a-ba80-61276b7f6883 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:14:24.160804 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb9342f-603d-441a-ba80-61276b7f6883 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:14:24.162161 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb9342f-603d-441a-ba80-61276b7f6883 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:14:24.180522 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 611/1216] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 15 12:14:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:14:24.182026 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c6cdfe-a42a-4db6-bf39-88f696c5b469 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:14:24.259414 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:14:24.295826 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c6cdfe-a42a-4db6-bf39-88f696c5b469 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:14:24.330534 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0756d07-f3a4-4e31-8bb0-fe8d9a0f8c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:14:24.331248 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0756d07-f3a4-4e31-8bb0-fe8d9a0f8c38 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:24.331527 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0756d07-f3a4-4e31-8bb0-fe8d9a0f8c38 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:24.331802 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0756d07-f3a4-4e31-8bb0-fe8d9a0f8c38 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:24.339301 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0756d07-f3a4-4e31-8bb0-fe8d9a0f8c38 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:14:24.340742 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0756d07-f3a4-4e31-8bb0-fe8d9a0f8c38 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:14:24.352703 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-d0756d07-f3a4-4e31-8bb0-fe8d9a0f8c38 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:14:24.352703 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:14:24.352703 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:14:24.352703 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:14:24.352703 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:14:24.352703 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:14:24.352703 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:14:24.352703 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:14:24.352703 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:14:24.352703 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:14:24.352703 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:14:24.352703 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:14:24.352703 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 12:14:24.352703 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 12:14:24.352703 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 12:14:24.358576 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 12:14:24.358576 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:14:24.358576 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:14:24.358576 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:14:24.358576 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:14:24.358576 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:14:24.358576 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:14:24.358576 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:14:24.358576 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:14:24.358576 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:14:24.358576 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:14:24.358576 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:14:24.358576 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:14:24.358576 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:14:24.358576 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:14:24.358576 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:14:24.358576 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:14:24.359782 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 12:14:24.359782 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 12:14:24.359782 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 12:14:24.359782 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 12:14:24.359782 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 12:14:24.359782 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 12:14:24.359782 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:14:24.359782 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:14:24.359782 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 606/1217] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 15 12:14:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:14:24.360403 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb9342f-603d-441a-ba80-61276b7f6883 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:14:24.476224 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb9342f-603d-441a-ba80-61276b7f6883 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:14:24.501729 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:14:24.515372 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1929a6f-d31a-4d96-8b1a-27c4f0a6b99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:14:24.515989 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1929a6f-d31a-4d96-8b1a-27c4f0a6b99f None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:24.516270 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1929a6f-d31a-4d96-8b1a-27c4f0a6b99f None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:24.516546 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1929a6f-d31a-4d96-8b1a-27c4f0a6b99f None admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:24.517374 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1929a6f-d31a-4d96-8b1a-27c4f0a6b99f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:14:24.517605 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1929a6f-d31a-4d96-8b1a-27c4f0a6b99f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:14:24.519098 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1929a6f-d31a-4d96-8b1a-27c4f0a6b99f None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:14:24.532400 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 612/1218] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Sep 15 12:14:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:14:24.538666 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0756d07-f3a4-4e31-8bb0-fe8d9a0f8c38 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:14:24.653545 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0756d07-f3a4-4e31-8bb0-fe8d9a0f8c38 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:14:24.686254 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:14:24.692583 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8266fcc-acc9-4c01-8df3-24cf16e58dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:14:24.693216 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8266fcc-acc9-4c01-8df3-24cf16e58dc9 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:24.693510 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8266fcc-acc9-4c01-8df3-24cf16e58dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:24.693790 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8266fcc-acc9-4c01-8df3-24cf16e58dc9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:24.694564 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8266fcc-acc9-4c01-8df3-24cf16e58dc9 None admin] RBAC: Adding query filter params (role.id=9c9f10110e12479bb6b3b630dd6412b8, scope.project.id=cab958c081ad4a92939d4469cf4ce1c6, user.id=b7ff8a5ddf1e422ca97f92bd9d4e5fb8) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:14:24.694891 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8266fcc-acc9-4c01-8df3-24cf16e58dc9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:14:24.696495 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8266fcc-acc9-4c01-8df3-24cf16e58dc9 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:14:24.714722 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 607/1219] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 15 12:14:24 2022] GET /identity/v3/role_assignments?user.id=b7ff8a5ddf1e422ca97f92bd9d4e5fb8&scope.project.id=cab958c081ad4a92939d4469cf4ce1c6&role.id=9c9f10110e12479bb6b3b630dd6412b8 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:14:26.988021 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26209528-f640-4d1e-ab08-360ad55b6125 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:26.988639 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26209528-f640-4d1e-ab08-360ad55b6125 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:26.988639 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26209528-f640-4d1e-ab08-360ad55b6125 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:26.990739 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 613/1220] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:14:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 12:14:26.996307 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59745096-f569-40d6-9680-5e8e3a7aca0b None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:26.996828 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59745096-f569-40d6-9680-5e8e3a7aca0b None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:26.996977 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59745096-f569-40d6-9680-5e8e3a7aca0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:27.018033 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-59745096-f569-40d6-9680-5e8e3a7aca0b None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:14:27.019396 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-59745096-f569-40d6-9680-5e8e3a7aca0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:14:27.096954 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 608/1221] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:14:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:14:27.367074 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26209528-f640-4d1e-ab08-360ad55b6125 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:14:27.483859 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26209528-f640-4d1e-ab08-360ad55b6125 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:14:27.520401 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e19667-2830-4ab9-b2f3-a6b36efb166f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:14:27.521028 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e19667-2830-4ab9-b2f3-a6b36efb166f None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:27.521302 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e19667-2830-4ab9-b2f3-a6b36efb166f None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:27.521627 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e19667-2830-4ab9-b2f3-a6b36efb166f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:27.534266 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e19667-2830-4ab9-b2f3-a6b36efb166f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:14:27.539729 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-46e19667-2830-4ab9-b2f3-a6b36efb166f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 12:14:27.539729 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:14:27.539729 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:14:27.539729 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:14:27.539729 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:14:27.539729 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:14:27.539729 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:14:27.539729 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:14:27.539729 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:14:27.539729 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:14:27.539729 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:14:27.539729 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:14:27.539729 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:14:27.539729 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:14:27.539729 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:14:27.539729 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:14:27.541071 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:14:27.541071 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:14:27.541071 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:14:27.541071 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:14:27.541071 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:14:27.541071 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:14:27.541071 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:14:27.541071 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:14:27.541071 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:14:27.541071 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:14:27.541071 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:14:27.541071 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:14:27.541071 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:14:27.541071 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:14:27.541071 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:14:27.541071 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:14:27.542226 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:14:27.542226 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:14:27.542226 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:14:27.542226 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:14:27.542226 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:14:27.542226 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:14:27.542226 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:14:27.542226 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:14:27.542226 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:14:27.542226 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:14:27.542226 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 12:14:27.542226 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:14:27.542226 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 614/1222] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Sep 15 12:14:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:14:27.547471 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59745096-f569-40d6-9680-5e8e3a7aca0b None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:14:27.662395 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59745096-f569-40d6-9680-5e8e3a7aca0b None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:14:27.688267 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:14:27.700177 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64505bde-696f-4600-8e09-93a26803f2b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:14:27.700819 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64505bde-696f-4600-8e09-93a26803f2b5 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:27.701286 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64505bde-696f-4600-8e09-93a26803f2b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:27.701554 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64505bde-696f-4600-8e09-93a26803f2b5 None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:27.702211 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64505bde-696f-4600-8e09-93a26803f2b5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:14:27.702510 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64505bde-696f-4600-8e09-93a26803f2b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:14:27.703913 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64505bde-696f-4600-8e09-93a26803f2b5 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:14:27.711894 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 609/1223] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Sep 15 12:14:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:14:27.717753 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e19667-2830-4ab9-b2f3-a6b36efb166f None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:14:27.763747 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:14:27.820429 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e19667-2830-4ab9-b2f3-a6b36efb166f None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:14:27.856531 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5f9db9-da7a-4292-96f9-63855e096662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:14:27.857145 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f9db9-da7a-4292-96f9-63855e096662 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:27.857420 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f9db9-da7a-4292-96f9-63855e096662 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:27.857687 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f9db9-da7a-4292-96f9-63855e096662 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:27.869116 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5f9db9-da7a-4292-96f9-63855e096662 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:14:27.871070 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5f9db9-da7a-4292-96f9-63855e096662 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:14:27.886571 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-3e5f9db9-da7a-4292-96f9-63855e096662 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:14:27.886571 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:14:27.886571 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:14:27.886571 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:14:27.886571 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:14:27.886571 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:14:27.886571 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:14:27.886571 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:14:27.886571 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:14:27.886571 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:14:27.886571 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:14:27.886571 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:14:27.886571 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:14:27.886571 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:14:27.886571 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:14:27.886571 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:14:27.887585 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:14:27.887585 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:14:27.887585 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:14:27.887585 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:14:27.887585 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:14:27.887585 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:14:27.887585 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:14:27.887585 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:14:27.887585 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:14:27.887585 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:14:27.887585 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:14:27.887585 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:14:27.887585 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:14:27.887585 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:14:27.887585 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:14:27.887585 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:14:27.887585 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:14:27.888495 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:14:27.888495 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:14:27.888495 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:14:27.888495 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 615/1224] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:14:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:14:27.893490 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64505bde-696f-4600-8e09-93a26803f2b5 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:14:27.996545 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64505bde-696f-4600-8e09-93a26803f2b5 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:14:28.034409 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a6e30d-cb82-4d4e-8394-b1e3da28fcfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:14:28.035055 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a6e30d-cb82-4d4e-8394-b1e3da28fcfc None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:28.035348 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a6e30d-cb82-4d4e-8394-b1e3da28fcfc None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:28.035600 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a6e30d-cb82-4d4e-8394-b1e3da28fcfc None admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:28.036317 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a6e30d-cb82-4d4e-8394-b1e3da28fcfc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:14:28.036610 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a6e30d-cb82-4d4e-8394-b1e3da28fcfc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:14:28.038003 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a6e30d-cb82-4d4e-8394-b1e3da28fcfc None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:14:28.050406 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 610/1225] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 15 12:14:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:14:28.056231 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5f9db9-da7a-4292-96f9-63855e096662 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:14:28.157470 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:14:28.169369 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5f9db9-da7a-4292-96f9-63855e096662 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:14:28.205303 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1a3c49-d590-4506-a9eb-a456dde96090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:14:28.206042 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a3c49-d590-4506-a9eb-a456dde96090 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:28.206401 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a3c49-d590-4506-a9eb-a456dde96090 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:28.207712 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a3c49-d590-4506-a9eb-a456dde96090 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:28.215401 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1a3c49-d590-4506-a9eb-a456dde96090 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:14:28.216994 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1a3c49-d590-4506-a9eb-a456dde96090 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:14:28.229890 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-1f1a3c49-d590-4506-a9eb-a456dde96090 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 15 12:14:28.229890 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:14:28.229890 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:14:28.229890 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:14:28.229890 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:14:28.229890 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:14:28.229890 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:14:28.229890 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:14:28.229890 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:14:28.229890 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:14:28.229890 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:14:28.229890 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:14:28.229890 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 12:14:28.229890 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 12:14:28.229890 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 12:14:28.229890 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 12:14:28.231276 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:14:28.231276 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:14:28.231276 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 12:14:28.231276 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:14:28.231276 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 12:14:28.231276 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:14:28.231276 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:14:28.231276 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:14:28.231276 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:14:28.231276 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:14:28.231276 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:14:28.231276 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:14:28.231276 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:14:28.231276 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:14:28.231276 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:14:28.231276 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:14:28.231276 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:14:28.231276 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:14:28.232805 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:14:28.232805 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:14:28.232805 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 12:14:28.232805 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 12:14:28.232805 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 12:14:28.232805 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 12:14:28.232805 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 12:14:28.232805 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 12:14:28.232805 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 15 12:14:28.232805 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:14:28.232805 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 616/1226] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:14:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:14:28.236966 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a6e30d-cb82-4d4e-8394-b1e3da28fcfc None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:14:28.291761 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:14:28.350279 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a6e30d-cb82-4d4e-8394-b1e3da28fcfc None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:14:28.386196 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c82804b-141b-4fe9-892e-e45f4230f64b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:14:28.386898 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82804b-141b-4fe9-892e-e45f4230f64b None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:28.387251 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82804b-141b-4fe9-892e-e45f4230f64b None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:28.387524 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c82804b-141b-4fe9-892e-e45f4230f64b None admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:28.388244 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c82804b-141b-4fe9-892e-e45f4230f64b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:14:28.388547 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c82804b-141b-4fe9-892e-e45f4230f64b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:14:28.389975 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c82804b-141b-4fe9-892e-e45f4230f64b None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:14:28.409526 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 611/1227] 10.222.0.16 () {56 vars in 1143 bytes} [Thu Sep 15 12:14:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:14:28.415514 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1a3c49-d590-4506-a9eb-a456dde96090 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:14:28.528896 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1a3c49-d590-4506-a9eb-a456dde96090 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:14:28.566855 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8280f91-d4a4-4180-800c-54f180563055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:14:28.567562 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8280f91-d4a4-4180-800c-54f180563055 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:28.567886 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8280f91-d4a4-4180-800c-54f180563055 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:28.568260 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8280f91-d4a4-4180-800c-54f180563055 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:28.581847 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8280f91-d4a4-4180-800c-54f180563055 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:14:28.583486 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8280f91-d4a4-4180-800c-54f180563055 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:14:28.598388 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-a8280f91-d4a4-4180-800c-54f180563055 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:14:28.598388 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:14:28.598388 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:14:28.598388 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:14:28.598388 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:14:28.598388 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:14:28.598388 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:14:28.598388 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:14:28.598388 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:14:28.598388 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:14:28.598388 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:14:28.598388 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:14:28.598388 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:14:28.598388 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:14:28.598388 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:14:28.598388 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:14:28.599768 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:14:28.599768 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:14:28.599768 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:14:28.599768 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:14:28.599768 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:14:28.599768 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:14:28.599768 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:14:28.599768 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:14:28.599768 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:14:28.599768 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:14:28.599768 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:14:28.599768 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:14:28.599768 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:14:28.599768 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:14:28.599768 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:14:28.599768 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:14:28.599768 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:14:28.600887 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:14:28.600887 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:14:28.600887 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:14:28.604827 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 617/1228] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:14:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:14:28.605914 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c82804b-141b-4fe9-892e-e45f4230f64b None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:14:28.720878 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c82804b-141b-4fe9-892e-e45f4230f64b None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:14:28.723236 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:14:28.762118 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e4e343-6dfe-4239-aba5-582dee11fb4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:14:28.762792 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4e343-6dfe-4239-aba5-582dee11fb4a None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:28.763071 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4e343-6dfe-4239-aba5-582dee11fb4a None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:28.763383 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4e343-6dfe-4239-aba5-582dee11fb4a None admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:28.764058 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e4e343-6dfe-4239-aba5-582dee11fb4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:14:28.764395 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e4e343-6dfe-4239-aba5-582dee11fb4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:14:28.765871 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e4e343-6dfe-4239-aba5-582dee11fb4a None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:14:28.777926 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 612/1229] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 15 12:14:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:14:28.783768 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8280f91-d4a4-4180-800c-54f180563055 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:14:28.794257 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:14:28.893058 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8280f91-d4a4-4180-800c-54f180563055 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:14:28.928973 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4da3340-1cfe-4523-aa97-3c57ecaa2293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:14:28.929679 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4da3340-1cfe-4523-aa97-3c57ecaa2293 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:28.930038 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4da3340-1cfe-4523-aa97-3c57ecaa2293 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:28.930310 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4da3340-1cfe-4523-aa97-3c57ecaa2293 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:28.938196 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4da3340-1cfe-4523-aa97-3c57ecaa2293 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:14:28.939745 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4da3340-1cfe-4523-aa97-3c57ecaa2293 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:14:28.951339 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-a4da3340-1cfe-4523-aa97-3c57ecaa2293 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:14:28.951339 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:14:28.951339 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:14:28.951339 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:14:28.951339 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:14:28.951339 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:14:28.951339 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:14:28.951339 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:14:28.951339 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:14:28.951339 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:14:28.951339 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:14:28.951339 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:14:28.951339 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 12:14:28.951339 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 12:14:28.951339 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 12:14:28.952406 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 12:14:28.952406 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:14:28.952406 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:14:28.952406 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:14:28.952406 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:14:28.952406 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:14:28.952406 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:14:28.952406 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:14:28.952406 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:14:28.952406 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:14:28.952406 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:14:28.952406 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:14:28.952406 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:14:28.952406 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:14:28.952406 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:14:28.952406 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:14:28.952406 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:14:28.953566 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 12:14:28.953566 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 12:14:28.953566 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 12:14:28.953566 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 12:14:28.953566 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 12:14:28.953566 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 12:14:28.953566 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:14:28.953566 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:14:28.953566 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 618/1230] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 15 12:14:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:14:28.958403 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e4e343-6dfe-4239-aba5-582dee11fb4a None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:14:29.067145 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e4e343-6dfe-4239-aba5-582dee11fb4a None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:14:29.110257 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d53702-1d95-4855-8bbf-5d1d5b3a1ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:14:29.110954 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d53702-1d95-4855-8bbf-5d1d5b3a1ab5 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:29.111267 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d53702-1d95-4855-8bbf-5d1d5b3a1ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:29.111539 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d53702-1d95-4855-8bbf-5d1d5b3a1ab5 None admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:29.112341 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d53702-1d95-4855-8bbf-5d1d5b3a1ab5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:14:29.112751 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d53702-1d95-4855-8bbf-5d1d5b3a1ab5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:14:29.114447 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d53702-1d95-4855-8bbf-5d1d5b3a1ab5 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:14:29.129318 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 613/1231] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Sep 15 12:14:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:14:29.135388 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4da3340-1cfe-4523-aa97-3c57ecaa2293 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:14:29.207470 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:14:29.247402 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4da3340-1cfe-4523-aa97-3c57ecaa2293 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:14:29.284976 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da5e1ad-478a-4d8a-9e9e-392796e18e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:14:29.285622 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da5e1ad-478a-4d8a-9e9e-392796e18e45 None admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:29.285898 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da5e1ad-478a-4d8a-9e9e-392796e18e45 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:29.286166 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da5e1ad-478a-4d8a-9e9e-392796e18e45 None admin] PATH_INFO: `/v3/projects/cab958c081ad4a92939d4469cf4ce1c6/users/b7ff8a5ddf1e422ca97f92bd9d4e5fb8/roles/9c9f10110e12479bb6b3b630dd6412b8` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:29.303022 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da5e1ad-478a-4d8a-9e9e-392796e18e45 None admin] RBAC: Authorizing `identity:create_grant(project_id=cab958c081ad4a92939d4469cf4ce1c6, user_id=b7ff8a5ddf1e422ca97f92bd9d4e5fb8, role_id=9c9f10110e12479bb6b3b630dd6412b8)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:14:29.304464 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da5e1ad-478a-4d8a-9e9e-392796e18e45 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:14:29.317577 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 619/1232] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Sep 15 12:14:29 2022] PUT /identity/v3/projects/cab958c081ad4a92939d4469cf4ce1c6/users/b7ff8a5ddf1e422ca97f92bd9d4e5fb8/roles/9c9f10110e12479bb6b3b630dd6412b8 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:14:31.515910 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300da2c9-abe2-46f3-924a-5ba650774456 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:31.516463 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300da2c9-abe2-46f3-924a-5ba650774456 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:31.516463 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300da2c9-abe2-46f3-924a-5ba650774456 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:31.517884 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 614/1233] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:14:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:14:31.523537 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf912f90-9db2-4d54-a618-d703cf966fb5 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:31.523988 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf912f90-9db2-4d54-a618-d703cf966fb5 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:31.524083 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf912f90-9db2-4d54-a618-d703cf966fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:31.544917 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-bf912f90-9db2-4d54-a618-d703cf966fb5 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:14:31.546112 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-bf912f90-9db2-4d54-a618-d703cf966fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:14:31.621675 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 620/1234] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:14:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:14:31.919882 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300da2c9-abe2-46f3-924a-5ba650774456 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:14:31.947318 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:14:32.039229 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300da2c9-abe2-46f3-924a-5ba650774456 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:14:32.082929 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73d9a1c-f6e2-4221-9069-e02e2bc417a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:14:32.083566 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d9a1c-f6e2-4221-9069-e02e2bc417a2 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:32.083846 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d9a1c-f6e2-4221-9069-e02e2bc417a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:32.084110 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d9a1c-f6e2-4221-9069-e02e2bc417a2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:32.095843 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73d9a1c-f6e2-4221-9069-e02e2bc417a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:14:32.100825 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-e73d9a1c-f6e2-4221-9069-e02e2bc417a2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 12:14:32.100825 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:14:32.100825 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:14:32.100825 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:14:32.100825 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:14:32.100825 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:14:32.100825 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:14:32.100825 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:14:32.100825 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:14:32.100825 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:14:32.100825 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:14:32.100825 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:14:32.100825 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:14:32.100825 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:14:32.100825 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:14:32.100825 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:14:32.101892 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:14:32.101892 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:14:32.101892 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:14:32.101892 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:14:32.101892 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:14:32.101892 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:14:32.101892 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:14:32.101892 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:14:32.101892 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:14:32.101892 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:14:32.101892 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:14:32.101892 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:14:32.101892 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:14:32.101892 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:14:32.101892 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:14:32.101892 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:14:32.103243 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:14:32.103243 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:14:32.103243 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:14:32.103243 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:14:32.103243 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:14:32.103243 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:14:32.103243 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:14:32.103243 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:14:32.103243 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:14:32.103243 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:14:32.103243 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 12:14:32.103243 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:14:32.103243 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 615/1235] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Sep 15 12:14:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:14:32.108796 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf912f90-9db2-4d54-a618-d703cf966fb5 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:14:32.161361 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:14:32.226635 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf912f90-9db2-4d54-a618-d703cf966fb5 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:14:32.267208 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255950b6-87d1-4402-974b-1f0532455335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:14:32.267878 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255950b6-87d1-4402-974b-1f0532455335 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:32.268157 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255950b6-87d1-4402-974b-1f0532455335 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:32.268432 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255950b6-87d1-4402-974b-1f0532455335 None admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:32.269196 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255950b6-87d1-4402-974b-1f0532455335 None admin] RBAC: Adding query filter params (name=service) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:14:32.269596 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255950b6-87d1-4402-974b-1f0532455335 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:14:32.271051 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255950b6-87d1-4402-974b-1f0532455335 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:14:32.280023 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 621/1236] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Sep 15 12:14:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:14:32.285924 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73d9a1c-f6e2-4221-9069-e02e2bc417a2 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:14:32.376712 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:14:32.394856 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73d9a1c-f6e2-4221-9069-e02e2bc417a2 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:14:32.435144 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd64d8-3cfd-4434-a7f3-ef2b2086eb58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:14:32.435781 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd64d8-3cfd-4434-a7f3-ef2b2086eb58 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:32.436060 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd64d8-3cfd-4434-a7f3-ef2b2086eb58 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:32.436329 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd64d8-3cfd-4434-a7f3-ef2b2086eb58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:32.448177 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcd64d8-3cfd-4434-a7f3-ef2b2086eb58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:14:32.449621 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcd64d8-3cfd-4434-a7f3-ef2b2086eb58 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:14:32.467583 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-4bcd64d8-3cfd-4434-a7f3-ef2b2086eb58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:14:32.467583 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:14:32.467583 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:14:32.467583 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:14:32.467583 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:14:32.467583 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:14:32.467583 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:14:32.467583 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:14:32.467583 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:14:32.467583 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:14:32.467583 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:14:32.467583 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:14:32.467583 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:14:32.467583 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:14:32.467583 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:14:32.467583 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:14:32.468798 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:14:32.468798 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:14:32.468798 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:14:32.468798 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:14:32.468798 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:14:32.468798 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:14:32.468798 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:14:32.468798 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:14:32.468798 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:14:32.468798 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:14:32.468798 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:14:32.468798 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:14:32.468798 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:14:32.468798 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:14:32.468798 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:14:32.468798 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:14:32.468798 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:14:32.470372 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:14:32.470372 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:14:32.470372 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:14:32.470372 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 616/1237] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:14:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:14:32.474945 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255950b6-87d1-4402-974b-1f0532455335 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:14:32.587150 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255950b6-87d1-4402-974b-1f0532455335 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:14:32.597693 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:14:32.628490 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fba3e3-7dac-40af-b305-b9e8bba7098c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:14:32.629179 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fba3e3-7dac-40af-b305-b9e8bba7098c None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:32.629537 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fba3e3-7dac-40af-b305-b9e8bba7098c None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:32.629869 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fba3e3-7dac-40af-b305-b9e8bba7098c None admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:32.630562 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fba3e3-7dac-40af-b305-b9e8bba7098c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:14:32.630952 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fba3e3-7dac-40af-b305-b9e8bba7098c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:14:32.632502 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fba3e3-7dac-40af-b305-b9e8bba7098c None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:14:32.647097 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 622/1238] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 15 12:14:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:14:32.653077 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd64d8-3cfd-4434-a7f3-ef2b2086eb58 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:14:32.764214 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd64d8-3cfd-4434-a7f3-ef2b2086eb58 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:14:32.802403 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5339435-88f8-46dd-93a8-d2a5ebbf0d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:14:32.803099 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5339435-88f8-46dd-93a8-d2a5ebbf0d4a None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:32.803378 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5339435-88f8-46dd-93a8-d2a5ebbf0d4a None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:32.803664 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5339435-88f8-46dd-93a8-d2a5ebbf0d4a None admin] PATH_INFO: `/v3/users/placement` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:32.806527 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:14:32.814959 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5339435-88f8-46dd-93a8-d2a5ebbf0d4a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:14:32.816555 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5339435-88f8-46dd-93a8-d2a5ebbf0d4a None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:14:32.829215 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-d5339435-88f8-46dd-93a8-d2a5ebbf0d4a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 15 12:14:32.829215 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:14:32.829215 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:14:32.829215 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:14:32.829215 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:14:32.829215 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:14:32.829215 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:14:32.829215 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:14:32.829215 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:14:32.829215 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:14:32.829215 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:14:32.829215 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:14:32.829215 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 12:14:32.829215 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 12:14:32.829215 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 12:14:32.829215 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 12:14:32.830307 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:14:32.830307 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:14:32.830307 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 12:14:32.830307 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:14:32.830307 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 12:14:32.830307 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:14:32.830307 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:14:32.830307 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:14:32.830307 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:14:32.830307 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:14:32.830307 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:14:32.830307 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:14:32.830307 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:14:32.830307 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:14:32.830307 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:14:32.830307 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:14:32.830307 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:14:32.830307 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:14:32.836178 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:14:32.836178 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:14:32.836178 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 12:14:32.836178 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 12:14:32.836178 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 12:14:32.836178 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 12:14:32.836178 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 12:14:32.836178 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 12:14:32.836178 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 15 12:14:32.836178 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:14:32.836178 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 617/1239] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:14:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:14:32.836805 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fba3e3-7dac-40af-b305-b9e8bba7098c None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:14:32.949949 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fba3e3-7dac-40af-b305-b9e8bba7098c None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:14:32.992031 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3d8324-d4a9-4eff-abfb-91299a63f2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:14:32.992797 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d8324-d4a9-4eff-abfb-91299a63f2b7 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:32.993164 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d8324-d4a9-4eff-abfb-91299a63f2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:32.993584 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d8324-d4a9-4eff-abfb-91299a63f2b7 None admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:32.994501 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3d8324-d4a9-4eff-abfb-91299a63f2b7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:14:32.994988 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3d8324-d4a9-4eff-abfb-91299a63f2b7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:14:32.996836 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3d8324-d4a9-4eff-abfb-91299a63f2b7 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:14:33.018782 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 623/1240] 10.222.0.16 () {56 vars in 1143 bytes} [Thu Sep 15 12:14:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:14:33.024543 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5339435-88f8-46dd-93a8-d2a5ebbf0d4a None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:14:33.133283 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5339435-88f8-46dd-93a8-d2a5ebbf0d4a None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:14:33.167134 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44cfbc5-465e-4def-9f5b-7f53c3e242cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:14:33.168223 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44cfbc5-465e-4def-9f5b-7f53c3e242cf None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:33.168497 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44cfbc5-465e-4def-9f5b-7f53c3e242cf None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:33.168763 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44cfbc5-465e-4def-9f5b-7f53c3e242cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:33.233001 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:14:33.240772 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44cfbc5-465e-4def-9f5b-7f53c3e242cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:14:33.242469 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44cfbc5-465e-4def-9f5b-7f53c3e242cf None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:14:33.348757 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 618/1241] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 15 12:14:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 12:14:33.355498 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3d8324-d4a9-4eff-abfb-91299a63f2b7 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:14:33.386708 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:14:33.465112 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3d8324-d4a9-4eff-abfb-91299a63f2b7 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:14:33.502618 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c496dbfe-7913-4c03-a1c6-d53cc8b42faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:14:33.503276 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c496dbfe-7913-4c03-a1c6-d53cc8b42faf None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:33.503572 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c496dbfe-7913-4c03-a1c6-d53cc8b42faf None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:33.503900 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c496dbfe-7913-4c03-a1c6-d53cc8b42faf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:33.515463 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c496dbfe-7913-4c03-a1c6-d53cc8b42faf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:14:33.517076 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c496dbfe-7913-4c03-a1c6-d53cc8b42faf None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:14:33.532772 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-c496dbfe-7913-4c03-a1c6-d53cc8b42faf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:14:33.532772 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:14:33.532772 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:14:33.532772 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:14:33.532772 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:14:33.532772 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:14:33.532772 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:14:33.532772 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:14:33.532772 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:14:33.532772 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:14:33.532772 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:14:33.532772 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:14:33.532772 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:14:33.532772 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:14:33.532772 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:14:33.532772 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:14:33.536666 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:14:33.536666 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:14:33.536666 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:14:33.536666 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:14:33.536666 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:14:33.536666 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:14:33.536666 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:14:33.536666 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:14:33.536666 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:14:33.536666 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:14:33.536666 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:14:33.536666 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:14:33.536666 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:14:33.536666 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:14:33.536666 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:14:33.536666 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:14:33.536666 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:14:33.537582 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:14:33.537582 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:14:33.537582 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:14:33.537582 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 624/1242] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:14:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:14:33.539905 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44cfbc5-465e-4def-9f5b-7f53c3e242cf None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:14:33.645813 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:14:33.654118 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44cfbc5-465e-4def-9f5b-7f53c3e242cf None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:14:33.697060 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63bb678-37db-4849-be85-3ae7da3c3177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:14:33.697670 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63bb678-37db-4849-be85-3ae7da3c3177 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:33.697959 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63bb678-37db-4849-be85-3ae7da3c3177 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:33.698242 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63bb678-37db-4849-be85-3ae7da3c3177 None admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:33.698938 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63bb678-37db-4849-be85-3ae7da3c3177 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:14:33.699278 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63bb678-37db-4849-be85-3ae7da3c3177 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:14:33.700800 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63bb678-37db-4849-be85-3ae7da3c3177 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:14:33.713614 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 619/1243] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 15 12:14:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:14:33.719811 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c496dbfe-7913-4c03-a1c6-d53cc8b42faf None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:14:33.812736 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:14:33.836644 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c496dbfe-7913-4c03-a1c6-d53cc8b42faf None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:14:33.876404 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dd1f0d-649d-413d-a26b-f1026cfabcee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:14:33.877215 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd1f0d-649d-413d-a26b-f1026cfabcee None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:33.877536 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd1f0d-649d-413d-a26b-f1026cfabcee None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:33.877899 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd1f0d-649d-413d-a26b-f1026cfabcee None admin] PATH_INFO: `/v3/projects/service` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:33.885323 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dd1f0d-649d-413d-a26b-f1026cfabcee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:14:33.886841 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dd1f0d-649d-413d-a26b-f1026cfabcee None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:14:33.898896 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-d0dd1f0d-649d-413d-a26b-f1026cfabcee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:14:33.898896 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:14:33.898896 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:14:33.898896 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:14:33.898896 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:14:33.898896 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:14:33.898896 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:14:33.898896 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:14:33.898896 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:14:33.898896 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:14:33.898896 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:14:33.898896 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:14:33.898896 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 12:14:33.898896 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 12:14:33.898896 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 12:14:33.900018 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 12:14:33.900018 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:14:33.900018 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:14:33.900018 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:14:33.900018 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:14:33.900018 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:14:33.900018 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:14:33.900018 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:14:33.900018 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:14:33.900018 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:14:33.900018 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:14:33.900018 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:14:33.900018 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:14:33.900018 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:14:33.900018 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:14:33.900018 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:14:33.900018 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:14:33.901430 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 12:14:33.901430 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 12:14:33.901430 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 12:14:33.901430 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 12:14:33.901430 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 12:14:33.901430 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 12:14:33.901430 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:14:33.901430 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:14:33.901430 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 625/1244] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 15 12:14:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:14:33.906609 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63bb678-37db-4849-be85-3ae7da3c3177 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:14:34.022848 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63bb678-37db-4849-be85-3ae7da3c3177 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:14:34.059960 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb281a8e-83f5-4a88-ab93-d0a40a6836e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:14:34.060788 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb281a8e-83f5-4a88-ab93-d0a40a6836e1 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:34.061092 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb281a8e-83f5-4a88-ab93-d0a40a6836e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:34.061415 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb281a8e-83f5-4a88-ab93-d0a40a6836e1 None admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:34.062131 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb281a8e-83f5-4a88-ab93-d0a40a6836e1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:14:34.062460 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb281a8e-83f5-4a88-ab93-d0a40a6836e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:14:34.064174 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb281a8e-83f5-4a88-ab93-d0a40a6836e1 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:14:34.085067 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 620/1245] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Sep 15 12:14:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:14:34.086294 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dd1f0d-649d-413d-a26b-f1026cfabcee None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:14:34.208434 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dd1f0d-649d-413d-a26b-f1026cfabcee None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:14:34.250053 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9d7990-6e4f-4c8d-8980-143fc01c9248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:14:34.250729 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d7990-6e4f-4c8d-8980-143fc01c9248 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:34.251009 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d7990-6e4f-4c8d-8980-143fc01c9248 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:34.251275 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d7990-6e4f-4c8d-8980-143fc01c9248 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:34.252247 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9d7990-6e4f-4c8d-8980-143fc01c9248 None admin] RBAC: Adding query filter params (role.id=9c9f10110e12479bb6b3b630dd6412b8, scope.project.id=cab958c081ad4a92939d4469cf4ce1c6, user.id=b7ff8a5ddf1e422ca97f92bd9d4e5fb8) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:14:34.252549 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9d7990-6e4f-4c8d-8980-143fc01c9248 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:14:34.253954 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9d7990-6e4f-4c8d-8980-143fc01c9248 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:14:34.260821 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 626/1246] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 15 12:14:34 2022] GET /identity/v3/role_assignments?user.id=b7ff8a5ddf1e422ca97f92bd9d4e5fb8&scope.project.id=cab958c081ad4a92939d4469cf4ce1c6&role.id=9c9f10110e12479bb6b3b630dd6412b8 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:14:36.724800 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c180ede-b47b-42c5-b80f-934c993688aa None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:36.725439 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c180ede-b47b-42c5-b80f-934c993688aa None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:36.725439 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c180ede-b47b-42c5-b80f-934c993688aa None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:36.726975 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 621/1247] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:14:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:14:36.732858 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8314bf-f1bf-4c3e-a8c6-b0a6951cddb3 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:36.733302 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8314bf-f1bf-4c3e-a8c6-b0a6951cddb3 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:36.733590 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8314bf-f1bf-4c3e-a8c6-b0a6951cddb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:36.740961 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:14:36.756106 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-5f8314bf-f1bf-4c3e-a8c6-b0a6951cddb3 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:14:36.757468 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-5f8314bf-f1bf-4c3e-a8c6-b0a6951cddb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:14:36.829875 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 627/1248] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:14:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:14:37.108209 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c180ede-b47b-42c5-b80f-934c993688aa None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:14:37.130989 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:14:37.223553 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c180ede-b47b-42c5-b80f-934c993688aa None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:14:37.261989 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43081e73-ca14-4ef6-ae37-9a36c0a459f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:14:37.262615 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43081e73-ca14-4ef6-ae37-9a36c0a459f0 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:37.262919 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43081e73-ca14-4ef6-ae37-9a36c0a459f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:37.263186 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43081e73-ca14-4ef6-ae37-9a36c0a459f0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:37.273255 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43081e73-ca14-4ef6-ae37-9a36c0a459f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:14:37.278053 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-43081e73-ca14-4ef6-ae37-9a36c0a459f0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:14:37.278053 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:14:37.278053 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:14:37.278053 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:14:37.278053 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:14:37.278053 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:14:37.278053 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:14:37.278053 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:14:37.278053 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:14:37.278053 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:14:37.278053 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:14:37.278053 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:14:37.278053 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:14:37.278053 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:14:37.278053 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:14:37.278053 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:14:37.279050 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:14:37.279050 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:14:37.279050 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:14:37.279050 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:14:37.279050 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:14:37.279050 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:14:37.279050 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:14:37.279050 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:14:37.279050 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:14:37.279050 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:14:37.279050 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:14:37.279050 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:14:37.279050 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:14:37.279050 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:14:37.279050 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:14:37.279050 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:14:37.279922 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:14:37.279922 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:14:37.279922 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:14:37.279922 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:14:37.279922 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:14:37.279922 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:14:37.279922 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:14:37.279922 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:14:37.279922 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:14:37.279922 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:14:37.279922 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:14:37.279922 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:14:37.279922 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 622/1249] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Sep 15 12:14:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:14:37.286356 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8314bf-f1bf-4c3e-a8c6-b0a6951cddb3 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:14:37.402008 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8314bf-f1bf-4c3e-a8c6-b0a6951cddb3 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:14:37.433459 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:14:37.439318 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c070e8e1-94c4-4bc4-b748-00bc8c20390f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:14:37.439937 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070e8e1-94c4-4bc4-b748-00bc8c20390f None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:37.440214 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070e8e1-94c4-4bc4-b748-00bc8c20390f None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:37.440506 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070e8e1-94c4-4bc4-b748-00bc8c20390f None admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:37.441159 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c070e8e1-94c4-4bc4-b748-00bc8c20390f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:14:37.441455 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c070e8e1-94c4-4bc4-b748-00bc8c20390f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:14:37.442860 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c070e8e1-94c4-4bc4-b748-00bc8c20390f None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:14:37.451796 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 628/1250] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 15 12:14:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:14:37.457783 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43081e73-ca14-4ef6-ae37-9a36c0a459f0 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:14:37.542095 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:14:37.574334 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43081e73-ca14-4ef6-ae37-9a36c0a459f0 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:14:37.608776 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e58da01-68a2-4336-bf2c-6d5958ed4265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:14:37.609421 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e58da01-68a2-4336-bf2c-6d5958ed4265 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:37.609675 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e58da01-68a2-4336-bf2c-6d5958ed4265 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:37.609994 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e58da01-68a2-4336-bf2c-6d5958ed4265 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:37.621079 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e58da01-68a2-4336-bf2c-6d5958ed4265 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:14:37.622595 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e58da01-68a2-4336-bf2c-6d5958ed4265 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:14:37.644552 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-4e58da01-68a2-4336-bf2c-6d5958ed4265 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:14:37.644552 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:14:37.644552 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:14:37.644552 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:14:37.644552 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:14:37.644552 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:14:37.644552 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:14:37.644552 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:14:37.644552 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:14:37.644552 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:14:37.644552 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:14:37.644552 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:14:37.644552 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:14:37.644552 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:14:37.644552 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:14:37.644552 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:14:37.645693 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:14:37.645693 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:14:37.645693 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:14:37.645693 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:14:37.645693 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:14:37.645693 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:14:37.645693 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:14:37.645693 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:14:37.645693 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:14:37.645693 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:14:37.645693 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:14:37.645693 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:14:37.645693 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:14:37.645693 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:14:37.645693 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:14:37.645693 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:14:37.645693 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:14:37.646592 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:14:37.646592 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:14:37.646592 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:14:37.646592 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 623/1251] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:14:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 12:14:37.654384 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c070e8e1-94c4-4bc4-b748-00bc8c20390f None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:14:37.764376 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c070e8e1-94c4-4bc4-b748-00bc8c20390f None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:14:37.808879 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ccc1ba-9745-491f-adca-8706c7c3e162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:14:37.809493 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ccc1ba-9745-491f-adca-8706c7c3e162 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:37.809774 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ccc1ba-9745-491f-adca-8706c7c3e162 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:37.810052 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ccc1ba-9745-491f-adca-8706c7c3e162 None admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:37.810721 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ccc1ba-9745-491f-adca-8706c7c3e162 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:14:37.811024 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ccc1ba-9745-491f-adca-8706c7c3e162 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:14:37.812560 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ccc1ba-9745-491f-adca-8706c7c3e162 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:14:37.825449 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 629/1252] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 15 12:14:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:14:37.831817 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e58da01-68a2-4336-bf2c-6d5958ed4265 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:14:37.951818 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e58da01-68a2-4336-bf2c-6d5958ed4265 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:14:37.981991 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:14:37.990307 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20001be0-cbc9-4b0c-9c95-f88794617c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:14:37.990994 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20001be0-cbc9-4b0c-9c95-f88794617c04 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:37.991273 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20001be0-cbc9-4b0c-9c95-f88794617c04 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:37.991540 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20001be0-cbc9-4b0c-9c95-f88794617c04 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:38.000639 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20001be0-cbc9-4b0c-9c95-f88794617c04 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:14:38.002360 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20001be0-cbc9-4b0c-9c95-f88794617c04 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:14:38.014362 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-20001be0-cbc9-4b0c-9c95-f88794617c04 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 15 12:14:38.014362 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:14:38.014362 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:14:38.014362 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:14:38.014362 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:14:38.014362 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:14:38.014362 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:14:38.014362 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:14:38.014362 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:14:38.014362 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:14:38.014362 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:14:38.014362 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:14:38.014362 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 12:14:38.014362 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 12:14:38.014362 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 12:14:38.014362 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 12:14:38.015582 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:14:38.015582 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:14:38.015582 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 12:14:38.015582 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:14:38.015582 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 12:14:38.015582 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:14:38.015582 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:14:38.015582 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:14:38.015582 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:14:38.015582 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:14:38.015582 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:14:38.015582 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:14:38.015582 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:14:38.015582 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:14:38.015582 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:14:38.015582 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:14:38.015582 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:14:38.015582 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:14:38.016532 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:14:38.016532 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:14:38.016532 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 12:14:38.016532 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 12:14:38.016532 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 12:14:38.016532 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 12:14:38.016532 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 12:14:38.016532 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 12:14:38.016532 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 15 12:14:38.016532 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:14:38.016532 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 624/1253] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:14:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:14:38.021756 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ccc1ba-9745-491f-adca-8706c7c3e162 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:14:38.079406 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:14:38.125135 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ccc1ba-9745-491f-adca-8706c7c3e162 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:14:38.164292 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d3ad65-cfff-4d7e-aa4d-aed8ebefcd30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:14:38.164916 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d3ad65-cfff-4d7e-aa4d-aed8ebefcd30 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:38.165191 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d3ad65-cfff-4d7e-aa4d-aed8ebefcd30 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:38.165458 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d3ad65-cfff-4d7e-aa4d-aed8ebefcd30 None admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:38.166850 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d3ad65-cfff-4d7e-aa4d-aed8ebefcd30 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:14:38.167267 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d3ad65-cfff-4d7e-aa4d-aed8ebefcd30 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:14:38.168722 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d3ad65-cfff-4d7e-aa4d-aed8ebefcd30 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:14:38.188486 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 630/1254] 10.222.0.16 () {56 vars in 1143 bytes} [Thu Sep 15 12:14:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:14:38.194749 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20001be0-cbc9-4b0c-9c95-f88794617c04 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:14:38.304009 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20001be0-cbc9-4b0c-9c95-f88794617c04 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:14:38.337088 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411ead51-bede-47a8-8d1d-223de7391e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:14:38.337691 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ead51-bede-47a8-8d1d-223de7391e82 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:38.338489 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ead51-bede-47a8-8d1d-223de7391e82 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:38.338786 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ead51-bede-47a8-8d1d-223de7391e82 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:38.395251 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:14:38.408875 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411ead51-bede-47a8-8d1d-223de7391e82 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:14:38.410327 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411ead51-bede-47a8-8d1d-223de7391e82 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:14:38.508222 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 625/1255] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 15 12:14:38 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 12:14:38.514735 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d3ad65-cfff-4d7e-aa4d-aed8ebefcd30 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:14:38.610977 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d3ad65-cfff-4d7e-aa4d-aed8ebefcd30 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:14:38.624279 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:14:38.651858 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6488ab2d-dae5-45c6-a0fb-105092ab42d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:14:38.652510 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6488ab2d-dae5-45c6-a0fb-105092ab42d8 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:38.652858 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6488ab2d-dae5-45c6-a0fb-105092ab42d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:38.653220 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6488ab2d-dae5-45c6-a0fb-105092ab42d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:38.666526 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6488ab2d-dae5-45c6-a0fb-105092ab42d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:14:38.668416 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6488ab2d-dae5-45c6-a0fb-105092ab42d8 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:14:38.684250 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-6488ab2d-dae5-45c6-a0fb-105092ab42d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:14:38.684250 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:14:38.684250 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:14:38.684250 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:14:38.684250 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:14:38.684250 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:14:38.684250 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:14:38.684250 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:14:38.684250 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:14:38.684250 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:14:38.684250 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:14:38.684250 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:14:38.684250 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:14:38.684250 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:14:38.684250 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:14:38.684250 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:14:38.685374 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:14:38.685374 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:14:38.685374 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:14:38.685374 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:14:38.685374 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:14:38.685374 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:14:38.685374 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:14:38.685374 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:14:38.685374 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:14:38.685374 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:14:38.685374 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:14:38.685374 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:14:38.685374 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:14:38.685374 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:14:38.685374 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:14:38.685374 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:14:38.685374 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:14:38.686289 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:14:38.686289 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:14:38.686289 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:14:38.686289 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 631/1256] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:14:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:14:38.691072 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411ead51-bede-47a8-8d1d-223de7391e82 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:14:38.773889 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:14:38.786340 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411ead51-bede-47a8-8d1d-223de7391e82 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:14:38.818167 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b670d867-10b4-4465-b967-03ddc3164035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:14:38.818781 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b670d867-10b4-4465-b967-03ddc3164035 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:38.819057 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b670d867-10b4-4465-b967-03ddc3164035 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:38.819323 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b670d867-10b4-4465-b967-03ddc3164035 None admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:38.819943 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b670d867-10b4-4465-b967-03ddc3164035 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:14:38.820239 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b670d867-10b4-4465-b967-03ddc3164035 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:14:38.821579 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b670d867-10b4-4465-b967-03ddc3164035 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:14:38.832834 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 626/1257] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 15 12:14:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:14:38.839013 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6488ab2d-dae5-45c6-a0fb-105092ab42d8 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:14:38.934317 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6488ab2d-dae5-45c6-a0fb-105092ab42d8 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:14:38.966214 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ad2f11-d382-4bc7-97de-acad1ff3feaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:14:38.966859 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad2f11-d382-4bc7-97de-acad1ff3feaa None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:38.967137 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad2f11-d382-4bc7-97de-acad1ff3feaa None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:38.967408 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad2f11-d382-4bc7-97de-acad1ff3feaa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:38.973992 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ad2f11-d382-4bc7-97de-acad1ff3feaa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:14:38.975467 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ad2f11-d382-4bc7-97de-acad1ff3feaa None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:14:38.987282 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-48ad2f11-d382-4bc7-97de-acad1ff3feaa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:14:38.987282 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:14:38.987282 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:14:38.987282 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:14:38.987282 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:14:38.987282 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:14:38.987282 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:14:38.987282 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:14:38.987282 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:14:38.987282 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:14:38.987282 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:14:38.987282 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:14:38.987282 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 12:14:38.987282 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 12:14:38.987282 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 12:14:38.988333 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 12:14:38.988333 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:14:38.988333 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:14:38.988333 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:14:38.988333 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:14:38.988333 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:14:38.988333 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:14:38.988333 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:14:38.988333 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:14:38.988333 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:14:38.988333 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:14:38.988333 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:14:38.988333 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:14:38.988333 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:14:38.988333 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:14:38.988333 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:14:38.988333 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:14:38.989605 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 12:14:38.989605 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 12:14:38.989605 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 12:14:38.989605 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 12:14:38.989605 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 12:14:38.989605 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 12:14:38.989605 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:14:38.989605 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:14:38.989605 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 632/1258] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 15 12:14:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:14:38.994637 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b670d867-10b4-4465-b967-03ddc3164035 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:14:39.089337 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b670d867-10b4-4465-b967-03ddc3164035 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:14:39.120929 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0526c85b-299e-43a1-bad2-dd98469d60a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:14:39.121511 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526c85b-299e-43a1-bad2-dd98469d60a2 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:39.121784 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526c85b-299e-43a1-bad2-dd98469d60a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:39.122055 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526c85b-299e-43a1-bad2-dd98469d60a2 None admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:39.122748 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0526c85b-299e-43a1-bad2-dd98469d60a2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:14:39.123053 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0526c85b-299e-43a1-bad2-dd98469d60a2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:14:39.124458 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0526c85b-299e-43a1-bad2-dd98469d60a2 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:14:39.136655 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 627/1259] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Sep 15 12:14:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:14:39.142466 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ad2f11-d382-4bc7-97de-acad1ff3feaa None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:14:39.167119 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:14:39.238569 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ad2f11-d382-4bc7-97de-acad1ff3feaa None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:14:39.271320 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2b46cb-a939-4ca5-a33d-b5d6e34203c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:14:39.271897 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b46cb-a939-4ca5-a33d-b5d6e34203c0 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:39.272173 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b46cb-a939-4ca5-a33d-b5d6e34203c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:39.272441 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b46cb-a939-4ca5-a33d-b5d6e34203c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:39.273152 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2b46cb-a939-4ca5-a33d-b5d6e34203c0 None admin] RBAC: Adding query filter params (role.id=7f53f1c823b746529ba5057bf21b2477, scope.project.id=cab958c081ad4a92939d4469cf4ce1c6, user.id=b7ff8a5ddf1e422ca97f92bd9d4e5fb8) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:14:39.273455 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2b46cb-a939-4ca5-a33d-b5d6e34203c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:14:39.274908 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2b46cb-a939-4ca5-a33d-b5d6e34203c0 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:14:39.280032 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 633/1260] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 15 12:14:39 2022] GET /identity/v3/role_assignments?user.id=b7ff8a5ddf1e422ca97f92bd9d4e5fb8&scope.project.id=cab958c081ad4a92939d4469cf4ce1c6&role.id=7f53f1c823b746529ba5057bf21b2477 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:14:41.386202 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f6c557-c8d4-40a9-8bd8-308b88a689e7 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:41.386740 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f6c557-c8d4-40a9-8bd8-308b88a689e7 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:41.386740 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f6c557-c8d4-40a9-8bd8-308b88a689e7 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:41.387999 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 628/1261] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:14:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:14:41.393105 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e0c508-03c8-4e6f-9878-aa28e6bf4e0e None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:41.393483 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e0c508-03c8-4e6f-9878-aa28e6bf4e0e None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:41.393646 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e0c508-03c8-4e6f-9878-aa28e6bf4e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:41.411520 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-a2e0c508-03c8-4e6f-9878-aa28e6bf4e0e None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:14:41.412714 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-a2e0c508-03c8-4e6f-9878-aa28e6bf4e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:14:41.476810 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 634/1262] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:14:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:14:41.740623 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f6c557-c8d4-40a9-8bd8-308b88a689e7 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:14:41.752311 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:14:41.837834 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f6c557-c8d4-40a9-8bd8-308b88a689e7 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:14:41.870182 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b26df1e-1303-4e77-99c5-efac73a0f3d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:14:41.870816 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b26df1e-1303-4e77-99c5-efac73a0f3d3 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:41.871096 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b26df1e-1303-4e77-99c5-efac73a0f3d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:41.871363 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b26df1e-1303-4e77-99c5-efac73a0f3d3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:41.881126 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b26df1e-1303-4e77-99c5-efac73a0f3d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:14:41.885857 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-5b26df1e-1303-4e77-99c5-efac73a0f3d3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:14:41.885857 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:14:41.885857 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:14:41.885857 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:14:41.885857 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:14:41.885857 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:14:41.885857 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:14:41.885857 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:14:41.885857 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:14:41.885857 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:14:41.885857 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:14:41.885857 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:14:41.885857 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:14:41.885857 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:14:41.885857 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:14:41.885857 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:14:41.886956 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:14:41.886956 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:14:41.886956 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:14:41.886956 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:14:41.886956 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:14:41.886956 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:14:41.886956 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:14:41.886956 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:14:41.886956 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:14:41.886956 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:14:41.886956 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:14:41.886956 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:14:41.886956 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:14:41.886956 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:14:41.886956 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:14:41.886956 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:14:41.888000 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:14:41.888000 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:14:41.888000 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:14:41.888000 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:14:41.888000 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:14:41.888000 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:14:41.888000 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:14:41.888000 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:14:41.888000 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:14:41.888000 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:14:41.888000 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:14:41.888000 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:14:41.888000 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 629/1263] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Sep 15 12:14:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:14:41.892813 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e0c508-03c8-4e6f-9878-aa28e6bf4e0e None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:14:41.910867 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:14:41.989572 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e0c508-03c8-4e6f-9878-aa28e6bf4e0e None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:14:42.021762 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180165f4-9631-4e80-b2a3-9c2c7f153e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:14:42.022290 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180165f4-9631-4e80-b2a3-9c2c7f153e9f None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:42.022564 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180165f4-9631-4e80-b2a3-9c2c7f153e9f None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:42.022869 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180165f4-9631-4e80-b2a3-9c2c7f153e9f None admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:42.023514 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180165f4-9631-4e80-b2a3-9c2c7f153e9f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:14:42.023813 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180165f4-9631-4e80-b2a3-9c2c7f153e9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:14:42.025636 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180165f4-9631-4e80-b2a3-9c2c7f153e9f None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:14:42.033239 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 635/1264] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 15 12:14:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:14:42.039070 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b26df1e-1303-4e77-99c5-efac73a0f3d3 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:14:42.104681 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:14:42.136899 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b26df1e-1303-4e77-99c5-efac73a0f3d3 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:14:42.170042 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49410c3b-fb5a-4dc3-a89c-f5f7f2c01b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:14:42.170655 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49410c3b-fb5a-4dc3-a89c-f5f7f2c01b66 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:42.170970 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49410c3b-fb5a-4dc3-a89c-f5f7f2c01b66 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:42.171244 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49410c3b-fb5a-4dc3-a89c-f5f7f2c01b66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:42.180939 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49410c3b-fb5a-4dc3-a89c-f5f7f2c01b66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:14:42.182497 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49410c3b-fb5a-4dc3-a89c-f5f7f2c01b66 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:14:42.196605 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-49410c3b-fb5a-4dc3-a89c-f5f7f2c01b66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:14:42.196605 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:14:42.196605 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:14:42.196605 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:14:42.196605 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:14:42.196605 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:14:42.196605 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:14:42.196605 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:14:42.196605 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:14:42.196605 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:14:42.196605 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:14:42.196605 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:14:42.196605 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:14:42.196605 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:14:42.196605 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:14:42.196605 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:14:42.197698 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:14:42.197698 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:14:42.197698 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:14:42.197698 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:14:42.197698 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:14:42.197698 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:14:42.197698 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:14:42.197698 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:14:42.197698 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:14:42.197698 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:14:42.197698 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:14:42.197698 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:14:42.197698 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:14:42.197698 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:14:42.197698 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:14:42.197698 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:14:42.197698 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:14:42.198965 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:14:42.198965 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:14:42.198965 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:14:42.198965 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 630/1265] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:14:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:14:42.203364 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180165f4-9631-4e80-b2a3-9c2c7f153e9f None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:14:42.282676 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:14:42.301403 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180165f4-9631-4e80-b2a3-9c2c7f153e9f None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:14:42.334319 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec2a75-c644-44c3-a8d9-794b2351d1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:14:42.334934 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec2a75-c644-44c3-a8d9-794b2351d1a5 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:42.335211 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec2a75-c644-44c3-a8d9-794b2351d1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:42.335478 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec2a75-c644-44c3-a8d9-794b2351d1a5 None admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:42.336106 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ec2a75-c644-44c3-a8d9-794b2351d1a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:14:42.336404 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ec2a75-c644-44c3-a8d9-794b2351d1a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:14:42.338309 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ec2a75-c644-44c3-a8d9-794b2351d1a5 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:14:42.349514 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 636/1266] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 15 12:14:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:14:42.355071 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49410c3b-fb5a-4dc3-a89c-f5f7f2c01b66 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:14:42.453235 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49410c3b-fb5a-4dc3-a89c-f5f7f2c01b66 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:14:42.472530 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:14:42.486489 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7e22ab-b616-4f46-9bfe-bb1b7d1c8a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:14:42.487138 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e22ab-b616-4f46-9bfe-bb1b7d1c8a40 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:42.487418 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e22ab-b616-4f46-9bfe-bb1b7d1c8a40 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:42.487689 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e22ab-b616-4f46-9bfe-bb1b7d1c8a40 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:42.494824 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7e22ab-b616-4f46-9bfe-bb1b7d1c8a40 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:14:42.496252 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7e22ab-b616-4f46-9bfe-bb1b7d1c8a40 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:14:42.507311 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-7a7e22ab-b616-4f46-9bfe-bb1b7d1c8a40 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 15 12:14:42.507311 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:14:42.507311 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:14:42.507311 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:14:42.507311 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:14:42.507311 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:14:42.507311 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:14:42.507311 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:14:42.507311 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:14:42.507311 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:14:42.507311 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:14:42.507311 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:14:42.507311 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 12:14:42.507311 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 12:14:42.507311 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 12:14:42.507311 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 12:14:42.508396 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:14:42.508396 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:14:42.508396 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 12:14:42.508396 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:14:42.508396 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 12:14:42.508396 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:14:42.508396 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:14:42.508396 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:14:42.508396 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:14:42.508396 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:14:42.508396 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:14:42.508396 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:14:42.508396 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:14:42.508396 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:14:42.508396 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:14:42.508396 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:14:42.508396 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:14:42.508396 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:14:42.510145 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:14:42.510145 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:14:42.510145 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 12:14:42.510145 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 12:14:42.510145 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 12:14:42.510145 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 12:14:42.510145 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 12:14:42.510145 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 12:14:42.510145 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 15 12:14:42.510145 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:14:42.510145 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 631/1267] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:14:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:14:42.514730 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec2a75-c644-44c3-a8d9-794b2351d1a5 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:14:42.612952 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec2a75-c644-44c3-a8d9-794b2351d1a5 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:14:42.653527 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c4b205-db28-4ac4-bcac-b3772e5e99ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:14:42.654280 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c4b205-db28-4ac4-bcac-b3772e5e99ce None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:42.654584 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c4b205-db28-4ac4-bcac-b3772e5e99ce None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:42.654891 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c4b205-db28-4ac4-bcac-b3772e5e99ce None admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:42.655616 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c4b205-db28-4ac4-bcac-b3772e5e99ce None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:14:42.655919 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c4b205-db28-4ac4-bcac-b3772e5e99ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:14:42.657337 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c4b205-db28-4ac4-bcac-b3772e5e99ce None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:14:42.665818 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:14:42.675467 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 637/1268] 10.222.0.16 () {56 vars in 1143 bytes} [Thu Sep 15 12:14:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:14:42.681918 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7e22ab-b616-4f46-9bfe-bb1b7d1c8a40 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:14:42.778758 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7e22ab-b616-4f46-9bfe-bb1b7d1c8a40 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:14:42.811009 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0f29cb-a609-42ac-abb9-7811479bf94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:14:42.811623 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f29cb-a609-42ac-abb9-7811479bf94e None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:42.811903 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f29cb-a609-42ac-abb9-7811479bf94e None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:42.812177 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f29cb-a609-42ac-abb9-7811479bf94e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:42.822956 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0f29cb-a609-42ac-abb9-7811479bf94e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:14:42.824386 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0f29cb-a609-42ac-abb9-7811479bf94e None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:14:42.838077 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-dc0f29cb-a609-42ac-abb9-7811479bf94e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:14:42.838077 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:14:42.838077 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:14:42.838077 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:14:42.838077 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:14:42.838077 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:14:42.838077 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:14:42.838077 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:14:42.838077 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:14:42.838077 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:14:42.838077 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:14:42.838077 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:14:42.838077 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:14:42.838077 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:14:42.838077 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:14:42.838077 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:14:42.839226 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:14:42.839226 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:14:42.839226 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:14:42.839226 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:14:42.839226 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:14:42.839226 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:14:42.839226 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:14:42.839226 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:14:42.839226 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:14:42.839226 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:14:42.839226 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:14:42.839226 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:14:42.839226 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:14:42.839226 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:14:42.839226 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:14:42.839226 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:14:42.839226 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:14:42.840133 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:14:42.840133 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:14:42.840133 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:14:42.840133 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 632/1269] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:14:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:14:42.845794 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c4b205-db28-4ac4-bcac-b3772e5e99ce None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:14:42.942422 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c4b205-db28-4ac4-bcac-b3772e5e99ce None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:14:42.975558 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4add6fb-7bd2-47e3-a188-cfa09f1c37f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:14:42.976158 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4add6fb-7bd2-47e3-a188-cfa09f1c37f9 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:42.976433 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4add6fb-7bd2-47e3-a188-cfa09f1c37f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:42.976702 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4add6fb-7bd2-47e3-a188-cfa09f1c37f9 None admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:42.977336 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4add6fb-7bd2-47e3-a188-cfa09f1c37f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:14:42.977635 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4add6fb-7bd2-47e3-a188-cfa09f1c37f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:14:42.979092 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4add6fb-7bd2-47e3-a188-cfa09f1c37f9 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:14:42.990026 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 638/1270] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 15 12:14:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:14:42.996149 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0f29cb-a609-42ac-abb9-7811479bf94e None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:14:43.027133 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:14:43.092057 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0f29cb-a609-42ac-abb9-7811479bf94e None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:14:43.124359 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2948a80f-a9d2-44e6-8985-068591d05b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:14:43.124965 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2948a80f-a9d2-44e6-8985-068591d05b88 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:43.125239 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2948a80f-a9d2-44e6-8985-068591d05b88 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:43.125508 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2948a80f-a9d2-44e6-8985-068591d05b88 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:43.132106 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2948a80f-a9d2-44e6-8985-068591d05b88 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:14:43.133520 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2948a80f-a9d2-44e6-8985-068591d05b88 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:14:43.144521 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-2948a80f-a9d2-44e6-8985-068591d05b88 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:14:43.144521 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:14:43.144521 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:14:43.144521 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:14:43.144521 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:14:43.144521 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:14:43.144521 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:14:43.144521 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:14:43.144521 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:14:43.144521 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:14:43.144521 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:14:43.144521 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:14:43.144521 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 12:14:43.144521 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 12:14:43.144521 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 12:14:43.145588 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 12:14:43.145588 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:14:43.145588 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:14:43.145588 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:14:43.145588 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:14:43.145588 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:14:43.145588 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:14:43.145588 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:14:43.145588 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:14:43.145588 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:14:43.145588 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:14:43.145588 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:14:43.145588 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:14:43.145588 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:14:43.145588 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:14:43.145588 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:14:43.145588 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:14:43.146640 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 12:14:43.146640 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 12:14:43.146640 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 12:14:43.146640 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 12:14:43.146640 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 12:14:43.146640 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 12:14:43.146640 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:14:43.146640 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:14:43.146640 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 633/1271] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 15 12:14:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:14:43.151389 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4add6fb-7bd2-47e3-a188-cfa09f1c37f9 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:14:43.207737 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:14:43.248922 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4add6fb-7bd2-47e3-a188-cfa09f1c37f9 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:14:43.280937 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0ba088-470d-4e99-9129-65c5b9ba8b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:14:43.281528 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0ba088-470d-4e99-9129-65c5b9ba8b95 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:43.281806 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0ba088-470d-4e99-9129-65c5b9ba8b95 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:43.282076 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0ba088-470d-4e99-9129-65c5b9ba8b95 None admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:43.282783 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0ba088-470d-4e99-9129-65c5b9ba8b95 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:14:43.283086 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0ba088-470d-4e99-9129-65c5b9ba8b95 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:14:43.284518 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0ba088-470d-4e99-9129-65c5b9ba8b95 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:14:43.296404 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 639/1272] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Sep 15 12:14:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:14:43.302138 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2948a80f-a9d2-44e6-8985-068591d05b88 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:14:43.389622 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:14:43.398591 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2948a80f-a9d2-44e6-8985-068591d05b88 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:14:43.431550 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313786f5-c487-44fe-a5db-d4585230aecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:14:43.432579 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313786f5-c487-44fe-a5db-d4585230aecc None admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:43.432993 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313786f5-c487-44fe-a5db-d4585230aecc None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:43.433399 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313786f5-c487-44fe-a5db-d4585230aecc None admin] PATH_INFO: `/v3/projects/cab958c081ad4a92939d4469cf4ce1c6/users/b7ff8a5ddf1e422ca97f92bd9d4e5fb8/roles/7f53f1c823b746529ba5057bf21b2477` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:43.435448 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313786f5-c487-44fe-a5db-d4585230aecc None admin] RBAC: Authorizing `identity:create_grant(project_id=cab958c081ad4a92939d4469cf4ce1c6, user_id=b7ff8a5ddf1e422ca97f92bd9d4e5fb8, role_id=7f53f1c823b746529ba5057bf21b2477)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:14:43.436866 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313786f5-c487-44fe-a5db-d4585230aecc None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:14:43.449066 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 634/1273] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Sep 15 12:14:43 2022] PUT /identity/v3/projects/cab958c081ad4a92939d4469cf4ce1c6/users/b7ff8a5ddf1e422ca97f92bd9d4e5fb8/roles/7f53f1c823b746529ba5057bf21b2477 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:14:45.531819 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe488a-5089-4aa3-aca2-c10f5541f95c None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:45.532344 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe488a-5089-4aa3-aca2-c10f5541f95c None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:45.532344 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe488a-5089-4aa3-aca2-c10f5541f95c None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:45.533686 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 640/1274] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:14:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:14:45.538995 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc39edf-bffc-4593-95f3-58a7768eadb6 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:45.539422 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc39edf-bffc-4593-95f3-58a7768eadb6 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:45.539536 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc39edf-bffc-4593-95f3-58a7768eadb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:45.557312 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-9dc39edf-bffc-4593-95f3-58a7768eadb6 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:14:45.558477 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-9dc39edf-bffc-4593-95f3-58a7768eadb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:14:45.621748 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 635/1275] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:14:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:14:45.903010 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fe488a-5089-4aa3-aca2-c10f5541f95c None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:14:46.000898 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fe488a-5089-4aa3-aca2-c10f5541f95c None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:14:46.017947 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:14:46.034619 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653c1fb7-5fd6-47f1-9515-fc4afe285897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:14:46.035268 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c1fb7-5fd6-47f1-9515-fc4afe285897 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:46.035543 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c1fb7-5fd6-47f1-9515-fc4afe285897 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:46.035812 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c1fb7-5fd6-47f1-9515-fc4afe285897 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:46.045455 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653c1fb7-5fd6-47f1-9515-fc4afe285897 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 12:14:46.050212 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-653c1fb7-5fd6-47f1-9515-fc4afe285897 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:14:46.050212 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:14:46.050212 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:14:46.050212 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:14:46.050212 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:14:46.050212 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:14:46.050212 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:14:46.050212 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:14:46.050212 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:14:46.050212 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:14:46.050212 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:14:46.050212 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:14:46.050212 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 12:14:46.050212 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 12:14:46.050212 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 12:14:46.050212 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 12:14:46.051298 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 12:14:46.051298 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 12:14:46.051298 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 12:14:46.051298 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 12:14:46.051298 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:14:46.051298 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:14:46.051298 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:14:46.051298 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:14:46.051298 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:14:46.051298 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:14:46.051298 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:14:46.051298 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:14:46.051298 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:14:46.051298 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:14:46.051298 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:14:46.051298 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:14:46.052337 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:14:46.052337 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:14:46.052337 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:14:46.052337 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:14:46.052337 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 12:14:46.052337 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 12:14:46.052337 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 12:14:46.052337 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 12:14:46.052337 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 12:14:46.052337 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 12:14:46.052337 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 12:14:46.052337 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:14:46.052337 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 641/1276] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Sep 15 12:14:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:14:46.057249 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc39edf-bffc-4593-95f3-58a7768eadb6 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:14:46.136061 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:14:46.154784 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc39edf-bffc-4593-95f3-58a7768eadb6 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:14:46.186945 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106d3a2e-c9a8-4ff4-98c8-71fa46b39b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:14:46.187540 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d3a2e-c9a8-4ff4-98c8-71fa46b39b02 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:46.187820 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d3a2e-c9a8-4ff4-98c8-71fa46b39b02 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:46.188091 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d3a2e-c9a8-4ff4-98c8-71fa46b39b02 None admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:46.188745 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106d3a2e-c9a8-4ff4-98c8-71fa46b39b02 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:14:46.189047 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106d3a2e-c9a8-4ff4-98c8-71fa46b39b02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:14:46.190414 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106d3a2e-c9a8-4ff4-98c8-71fa46b39b02 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:14:46.198742 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 636/1277] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Sep 15 12:14:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:14:46.204608 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653c1fb7-5fd6-47f1-9515-fc4afe285897 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:14:46.299563 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653c1fb7-5fd6-47f1-9515-fc4afe285897 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:14:46.331840 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d660aa-c5f1-49b7-9c73-f382f36f6471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:14:46.332436 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d660aa-c5f1-49b7-9c73-f382f36f6471 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:46.332707 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d660aa-c5f1-49b7-9c73-f382f36f6471 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:46.332973 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d660aa-c5f1-49b7-9c73-f382f36f6471 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:46.343026 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d660aa-c5f1-49b7-9c73-f382f36f6471 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:14:46.344434 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d660aa-c5f1-49b7-9c73-f382f36f6471 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:14:46.358752 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-f3d660aa-c5f1-49b7-9c73-f382f36f6471 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:14:46.358752 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:14:46.358752 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:14:46.358752 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:14:46.358752 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:14:46.358752 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:14:46.358752 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:14:46.358752 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:14:46.358752 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:14:46.358752 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:14:46.358752 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:14:46.358752 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:14:46.358752 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:14:46.358752 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:14:46.358752 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:14:46.358752 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:14:46.359943 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:14:46.359943 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:14:46.359943 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:14:46.359943 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:14:46.359943 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:14:46.359943 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:14:46.359943 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:14:46.359943 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:14:46.359943 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:14:46.359943 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:14:46.359943 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:14:46.359943 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:14:46.359943 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:14:46.359943 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:14:46.359943 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:14:46.359943 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:14:46.359943 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:14:46.361224 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:14:46.361224 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:14:46.361224 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:14:46.361224 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 642/1278] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:14:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:14:46.365404 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106d3a2e-c9a8-4ff4-98c8-71fa46b39b02 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:14:46.461740 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106d3a2e-c9a8-4ff4-98c8-71fa46b39b02 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:14:46.493545 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51805cd2-aed4-4533-b21b-93730910c172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:14:46.494664 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51805cd2-aed4-4533-b21b-93730910c172 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:46.494964 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51805cd2-aed4-4533-b21b-93730910c172 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:46.495233 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51805cd2-aed4-4533-b21b-93730910c172 None admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:46.495857 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51805cd2-aed4-4533-b21b-93730910c172 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:14:46.496156 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51805cd2-aed4-4533-b21b-93730910c172 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:14:46.497518 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51805cd2-aed4-4533-b21b-93730910c172 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:14:46.509102 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 637/1279] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 15 12:14:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:14:46.515294 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d660aa-c5f1-49b7-9c73-f382f36f6471 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:14:46.545442 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:14:46.611460 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d660aa-c5f1-49b7-9c73-f382f36f6471 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:14:46.646526 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a996cda-9445-4162-a72c-2df615e7197d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:14:46.647163 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a996cda-9445-4162-a72c-2df615e7197d None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:46.647468 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a996cda-9445-4162-a72c-2df615e7197d None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:46.647742 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a996cda-9445-4162-a72c-2df615e7197d None admin] PATH_INFO: `/v3/users/placement` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:46.655003 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a996cda-9445-4162-a72c-2df615e7197d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:14:46.656426 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a996cda-9445-4162-a72c-2df615e7197d None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:14:46.667220 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-7a996cda-9445-4162-a72c-2df615e7197d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 15 12:14:46.667220 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:14:46.667220 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:14:46.667220 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:14:46.667220 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:14:46.667220 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:14:46.667220 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:14:46.667220 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:14:46.667220 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:14:46.667220 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:14:46.667220 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:14:46.667220 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:14:46.667220 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 12:14:46.667220 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 12:14:46.667220 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 12:14:46.667220 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 12:14:46.668286 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:14:46.668286 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:14:46.668286 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 12:14:46.668286 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:14:46.668286 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 12:14:46.668286 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 12:14:46.668286 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:14:46.668286 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:14:46.668286 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:14:46.668286 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:14:46.668286 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:14:46.668286 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:14:46.668286 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:14:46.668286 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:14:46.668286 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:14:46.668286 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:14:46.668286 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:14:46.668286 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:14:46.669407 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:14:46.669407 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:14:46.669407 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 12:14:46.669407 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 12:14:46.669407 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 12:14:46.669407 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 12:14:46.669407 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 12:14:46.669407 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 12:14:46.669407 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 15 12:14:46.669407 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:14:46.669407 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 643/1280] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:14:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:14:46.674000 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51805cd2-aed4-4533-b21b-93730910c172 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:14:46.677699 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:14:46.770390 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51805cd2-aed4-4533-b21b-93730910c172 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:14:46.802767 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2627f59-0556-4d3c-8c76-d9d67fe24145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:14:46.803354 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2627f59-0556-4d3c-8c76-d9d67fe24145 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:46.803627 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2627f59-0556-4d3c-8c76-d9d67fe24145 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:46.803893 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2627f59-0556-4d3c-8c76-d9d67fe24145 None admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:46.804600 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2627f59-0556-4d3c-8c76-d9d67fe24145 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:14:46.804898 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2627f59-0556-4d3c-8c76-d9d67fe24145 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:14:46.806901 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2627f59-0556-4d3c-8c76-d9d67fe24145 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:14:46.823084 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 638/1281] 10.222.0.16 () {56 vars in 1143 bytes} [Thu Sep 15 12:14:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:14:46.828627 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a996cda-9445-4162-a72c-2df615e7197d None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:14:46.914612 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:14:46.924514 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a996cda-9445-4162-a72c-2df615e7197d None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:14:46.956678 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef21344-cbfb-4730-99f4-3add7fe0af58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:14:46.957264 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef21344-cbfb-4730-99f4-3add7fe0af58 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:46.957540 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef21344-cbfb-4730-99f4-3add7fe0af58 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:46.957808 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef21344-cbfb-4730-99f4-3add7fe0af58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:47.022726 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef21344-cbfb-4730-99f4-3add7fe0af58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:14:47.024100 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef21344-cbfb-4730-99f4-3add7fe0af58 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:14:47.107680 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:14:47.117482 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 644/1282] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Sep 15 12:14:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 12:14:47.123830 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2627f59-0556-4d3c-8c76-d9d67fe24145 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:14:47.183147 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:14:47.220327 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2627f59-0556-4d3c-8c76-d9d67fe24145 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:14:47.256169 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569afcbb-602b-4a6b-976b-3f1242e9507b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:14:47.256800 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569afcbb-602b-4a6b-976b-3f1242e9507b None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:47.257077 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569afcbb-602b-4a6b-976b-3f1242e9507b None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:47.257346 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569afcbb-602b-4a6b-976b-3f1242e9507b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:47.267717 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569afcbb-602b-4a6b-976b-3f1242e9507b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:14:47.269150 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569afcbb-602b-4a6b-976b-3f1242e9507b None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:14:47.283306 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-569afcbb-602b-4a6b-976b-3f1242e9507b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:14:47.283306 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:14:47.283306 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:14:47.283306 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:14:47.283306 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:14:47.283306 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:14:47.283306 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:14:47.283306 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:14:47.283306 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:14:47.283306 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:14:47.283306 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:14:47.283306 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:14:47.283306 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 12:14:47.283306 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 12:14:47.283306 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 12:14:47.283306 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 12:14:47.284255 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:14:47.284255 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:14:47.284255 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:14:47.284255 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:14:47.284255 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:14:47.284255 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:14:47.284255 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:14:47.284255 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:14:47.284255 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:14:47.284255 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:14:47.284255 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:14:47.284255 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:14:47.284255 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:14:47.284255 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:14:47.284255 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:14:47.284255 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:14:47.284255 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 12:14:47.285506 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 12:14:47.285506 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 12:14:47.285506 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:14:47.285506 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 639/1283] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:14:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:14:47.290074 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef21344-cbfb-4730-99f4-3add7fe0af58 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:14:47.385227 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef21344-cbfb-4730-99f4-3add7fe0af58 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:14:47.416935 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82554739-47bf-4388-8eca-8b3a364cefb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:14:47.417522 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82554739-47bf-4388-8eca-8b3a364cefb2 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:47.417795 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82554739-47bf-4388-8eca-8b3a364cefb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:47.418061 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82554739-47bf-4388-8eca-8b3a364cefb2 None admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:47.418719 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82554739-47bf-4388-8eca-8b3a364cefb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:14:47.419010 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82554739-47bf-4388-8eca-8b3a364cefb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:14:47.420343 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82554739-47bf-4388-8eca-8b3a364cefb2 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:14:47.430968 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 645/1284] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Sep 15 12:14:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:14:47.436951 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569afcbb-602b-4a6b-976b-3f1242e9507b None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:14:47.534716 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569afcbb-602b-4a6b-976b-3f1242e9507b None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:14:47.548079 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:14:47.568090 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e17af0f-fb03-44c0-b1c1-840b0f9d5ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:14:47.568708 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e17af0f-fb03-44c0-b1c1-840b0f9d5ba8 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:47.568984 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e17af0f-fb03-44c0-b1c1-840b0f9d5ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:47.569256 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e17af0f-fb03-44c0-b1c1-840b0f9d5ba8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:47.575614 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e17af0f-fb03-44c0-b1c1-840b0f9d5ba8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:14:47.577040 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e17af0f-fb03-44c0-b1c1-840b0f9d5ba8 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:14:47.588018 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application [None req-6e17af0f-fb03-44c0-b1c1-840b0f9d5ba8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:14:47.588018 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:14:47.588018 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:14:47.588018 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:14:47.588018 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:14:47.588018 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:14:47.588018 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:14:47.588018 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:14:47.588018 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:14:47.588018 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:14:47.588018 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:14:47.588018 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:14:47.588018 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 12:14:47.588018 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 12:14:47.588018 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 12:14:47.589033 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 12:14:47.589033 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:14:47.589033 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:14:47.589033 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:14:47.589033 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:14:47.589033 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:14:47.589033 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:14:47.589033 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:14:47.589033 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application with Lock( Sep 15 12:14:47.589033 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:14:47.589033 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:14:47.589033 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:14:47.589033 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:14:47.589033 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:14:47.589033 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:14:47.589033 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:14:47.589033 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:14:47.590313 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 12:14:47.590313 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 12:14:47.590313 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 12:14:47.590313 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 12:14:47.590313 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 12:14:47.590313 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 12:14:47.590313 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 12:14:47.590313 dv-cinder-850836-7-smb devstack@keystone.service[81375]: ERROR keystone.server.flask.application Sep 15 12:14:47.590313 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 640/1285] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Sep 15 12:14:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:14:47.594973 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82554739-47bf-4388-8eca-8b3a364cefb2 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:14:47.645890 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:14:47.694870 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82554739-47bf-4388-8eca-8b3a364cefb2 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:14:47.726471 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb2cf18-a753-41bb-bde1-f1a7f7b53ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:14:47.727091 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb2cf18-a753-41bb-bde1-f1a7f7b53ff3 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:47.727372 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb2cf18-a753-41bb-bde1-f1a7f7b53ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:47.727645 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb2cf18-a753-41bb-bde1-f1a7f7b53ff3 None admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:47.728847 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb2cf18-a753-41bb-bde1-f1a7f7b53ff3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:14:47.729151 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb2cf18-a753-41bb-bde1-f1a7f7b53ff3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:14:47.730575 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb2cf18-a753-41bb-bde1-f1a7f7b53ff3 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:14:47.742738 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 646/1286] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Sep 15 12:14:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:14:47.749257 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e17af0f-fb03-44c0-b1c1-840b0f9d5ba8 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:14:47.843956 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e17af0f-fb03-44c0-b1c1-840b0f9d5ba8 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:14:47.876251 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94024304-1230-404e-9e88-8158ecb0dd4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:14:47.877104 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94024304-1230-404e-9e88-8158ecb0dd4e None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:47.877382 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94024304-1230-404e-9e88-8158ecb0dd4e None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:47.877652 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94024304-1230-404e-9e88-8158ecb0dd4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:47.878371 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94024304-1230-404e-9e88-8158ecb0dd4e None admin] RBAC: Adding query filter params (role.id=7f53f1c823b746529ba5057bf21b2477, scope.project.id=cab958c081ad4a92939d4469cf4ce1c6, user.id=b7ff8a5ddf1e422ca97f92bd9d4e5fb8) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:14:47.878677 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94024304-1230-404e-9e88-8158ecb0dd4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:14:47.880120 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94024304-1230-404e-9e88-8158ecb0dd4e None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:14:47.885595 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 641/1287] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Sep 15 12:14:47 2022] GET /identity/v3/role_assignments?user.id=b7ff8a5ddf1e422ca97f92bd9d4e5fb8&scope.project.id=cab958c081ad4a92939d4469cf4ce1c6&role.id=7f53f1c823b746529ba5057bf21b2477 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:14:50.025625 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74186984-bc47-42f4-bf62-8e711cf7e953 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:50.026114 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74186984-bc47-42f4-bf62-8e711cf7e953 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:50.026217 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74186984-bc47-42f4-bf62-8e711cf7e953 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:50.027498 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 647/1288] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:14:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:14:50.032527 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa13229-381b-40c6-8a1f-3eb531d03979 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:50.032890 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa13229-381b-40c6-8a1f-3eb531d03979 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:50.033076 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa13229-381b-40c6-8a1f-3eb531d03979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:50.051249 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-efa13229-381b-40c6-8a1f-3eb531d03979 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:14:50.052418 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-efa13229-381b-40c6-8a1f-3eb531d03979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:14:50.080849 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:14:50.117132 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 642/1289] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:14:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:14:50.388472 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74186984-bc47-42f4-bf62-8e711cf7e953 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:14:50.485470 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74186984-bc47-42f4-bf62-8e711cf7e953 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:14:50.496534 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:14:50.520119 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038838dd-a5c3-4637-bc17-8bd1aaffb48b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:14:50.520737 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038838dd-a5c3-4637-bc17-8bd1aaffb48b None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:50.521014 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038838dd-a5c3-4637-bc17-8bd1aaffb48b None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:50.521281 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038838dd-a5c3-4637-bc17-8bd1aaffb48b None admin] PATH_INFO: `/v3/services/placement` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:50.521857 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038838dd-a5c3-4637-bc17-8bd1aaffb48b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:14:50.523262 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038838dd-a5c3-4637-bc17-8bd1aaffb48b None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:14:50.531718 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-038838dd-a5c3-4637-bc17-8bd1aaffb48b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 15 12:14:50.531718 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:14:50.531718 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 12:14:50.531718 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 12:14:50.531718 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 12:14:50.531718 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 12:14:50.531718 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 12:14:50.531718 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:14:50.531718 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 15 12:14:50.531718 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:14:50.531718 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 12:14:50.531718 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:14:50.531718 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:14:50.531718 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:14:50.531718 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:14:50.531718 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:14:50.531718 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:14:50.532893 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:14:50.532893 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:14:50.532893 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:14:50.532893 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:14:50.532893 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:14:50.532893 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:14:50.532893 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 12:14:50.532893 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 12:14:50.532893 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 12:14:50.532893 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 12:14:50.532893 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:14:50.532893 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:14:50.532893 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:14:50.532893 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:14:50.532893 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:14:50.532893 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:14:50.534082 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:14:50.534082 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:14:50.534082 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:14:50.534082 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:14:50.534082 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:14:50.534082 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:14:50.534082 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:14:50.534082 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:14:50.534082 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:14:50.534082 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:14:50.534082 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 12:14:50.534082 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:14:50.534082 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 15 12:14:50.534082 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:14:50.534082 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 648/1290] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Sep 15 12:14:50 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:14:50.538763 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa13229-381b-40c6-8a1f-3eb531d03979 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:14:50.637260 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa13229-381b-40c6-8a1f-3eb531d03979 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:14:50.677270 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bec5586-c476-4dd5-8e04-4919cacfac04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:14:50.677890 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec5586-c476-4dd5-8e04-4919cacfac04 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:50.678171 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec5586-c476-4dd5-8e04-4919cacfac04 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:50.678513 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec5586-c476-4dd5-8e04-4919cacfac04 None admin] PATH_INFO: `/v3/services` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:50.679265 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bec5586-c476-4dd5-8e04-4919cacfac04 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:14:50.679587 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bec5586-c476-4dd5-8e04-4919cacfac04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:14:50.681805 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bec5586-c476-4dd5-8e04-4919cacfac04 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:14:50.687287 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 643/1291] 10.222.0.16 () {56 vars in 1116 bytes} [Thu Sep 15 12:14:50 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:14:50.693828 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038838dd-a5c3-4637-bc17-8bd1aaffb48b None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:14:50.790442 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038838dd-a5c3-4637-bc17-8bd1aaffb48b None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:14:50.823123 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632fb339-0607-409d-9c27-6e8bc469f9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:14:50.823707 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632fb339-0607-409d-9c27-6e8bc469f9af None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:50.823984 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632fb339-0607-409d-9c27-6e8bc469f9af None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:50.824256 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632fb339-0607-409d-9c27-6e8bc469f9af None admin] PATH_INFO: `/v3/services` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:50.824874 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632fb339-0607-409d-9c27-6e8bc469f9af None admin] RBAC: Adding query filter params (type=placement) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:14:50.825175 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632fb339-0607-409d-9c27-6e8bc469f9af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:14:50.826523 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632fb339-0607-409d-9c27-6e8bc469f9af None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:14:50.830812 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 649/1292] 10.222.0.16 () {56 vars in 1116 bytes} [Thu Sep 15 12:14:50 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:14:53.063066 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58090e58-7d96-4c64-b21b-4cd6a7c4d42a None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:53.063603 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58090e58-7d96-4c64-b21b-4cd6a7c4d42a None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:53.063603 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58090e58-7d96-4c64-b21b-4cd6a7c4d42a None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:53.064928 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 644/1293] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:14:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:14:53.069961 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf434cad-6db4-4fd6-b3b7-5667f6efff26 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:53.070395 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf434cad-6db4-4fd6-b3b7-5667f6efff26 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:53.070514 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf434cad-6db4-4fd6-b3b7-5667f6efff26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:53.089379 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-bf434cad-6db4-4fd6-b3b7-5667f6efff26 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:14:53.090568 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-bf434cad-6db4-4fd6-b3b7-5667f6efff26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:14:53.118893 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:14:53.155958 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 650/1294] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:14:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 12:14:53.422340 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58090e58-7d96-4c64-b21b-4cd6a7c4d42a None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:14:53.453073 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:14:53.521950 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58090e58-7d96-4c64-b21b-4cd6a7c4d42a None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:14:53.554224 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f902b-f1a5-44b4-9406-ee12b6c3506a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:14:53.554842 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f902b-f1a5-44b4-9406-ee12b6c3506a None admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:53.555118 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f902b-f1a5-44b4-9406-ee12b6c3506a None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:53.555412 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f902b-f1a5-44b4-9406-ee12b6c3506a None admin] PATH_INFO: `/v3/services` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:53.556642 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88f902b-f1a5-44b4-9406-ee12b6c3506a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:14:53.558004 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88f902b-f1a5-44b4-9406-ee12b6c3506a None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:14:53.571527 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 645/1295] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Sep 15 12:14:53 2022] POST /identity/v3/services => generated 246 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:14:55.717599 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dfd698-46dd-4c3a-9c21-0931a7db1321 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:55.718168 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dfd698-46dd-4c3a-9c21-0931a7db1321 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:55.718168 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dfd698-46dd-4c3a-9c21-0931a7db1321 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:55.719526 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 651/1296] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:14:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:14:55.724545 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c0fad9-603b-44ae-804d-3a6b38cf6299 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:55.724932 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c0fad9-603b-44ae-804d-3a6b38cf6299 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:55.725088 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c0fad9-603b-44ae-804d-3a6b38cf6299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:55.742618 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-86c0fad9-603b-44ae-804d-3a6b38cf6299 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:14:55.744328 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-86c0fad9-603b-44ae-804d-3a6b38cf6299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:14:55.814660 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 646/1297] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:14:55 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:14:56.084367 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dfd698-46dd-4c3a-9c21-0931a7db1321 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:14:56.181794 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dfd698-46dd-4c3a-9c21-0931a7db1321 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:14:56.213937 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f843c93-fa96-4634-b774-10c68594fdf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:14:56.214543 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f843c93-fa96-4634-b774-10c68594fdf8 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:56.214853 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f843c93-fa96-4634-b774-10c68594fdf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:56.215126 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f843c93-fa96-4634-b774-10c68594fdf8 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:56.215702 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f843c93-fa96-4634-b774-10c68594fdf8 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:14:56.217045 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f843c93-fa96-4634-b774-10c68594fdf8 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:14:56.225528 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-5f843c93-fa96-4634-b774-10c68594fdf8 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 15 12:14:56.225528 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:14:56.225528 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 12:14:56.225528 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 12:14:56.225528 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 12:14:56.225528 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 12:14:56.225528 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 12:14:56.225528 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:14:56.225528 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 15 12:14:56.225528 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:14:56.225528 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 12:14:56.225528 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:14:56.225528 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:14:56.225528 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:14:56.225528 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:14:56.225528 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:14:56.225528 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:14:56.226651 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:14:56.226651 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:14:56.226651 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:14:56.226651 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:14:56.226651 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:14:56.226651 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:14:56.226651 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 12:14:56.226651 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 12:14:56.226651 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 12:14:56.226651 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 12:14:56.226651 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:14:56.226651 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:14:56.226651 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:14:56.226651 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:14:56.226651 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:14:56.226651 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:14:56.227696 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:14:56.227696 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:14:56.227696 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:14:56.227696 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:14:56.227696 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:14:56.227696 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:14:56.227696 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:14:56.227696 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:14:56.227696 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:14:56.227696 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:14:56.227696 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 12:14:56.227696 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:14:56.227696 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 15 12:14:56.227696 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:14:56.227696 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 652/1298] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Sep 15 12:14:56 2022] GET /identity/v3/services/placement => generated 90 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:14:56.232791 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c0fad9-603b-44ae-804d-3a6b38cf6299 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:14:56.250322 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:14:56.328560 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c0fad9-603b-44ae-804d-3a6b38cf6299 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:14:56.361421 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c465154-3a25-41fa-9adc-5f7bcd6eabd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:14:56.362016 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c465154-3a25-41fa-9adc-5f7bcd6eabd0 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:56.362296 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c465154-3a25-41fa-9adc-5f7bcd6eabd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:56.362569 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c465154-3a25-41fa-9adc-5f7bcd6eabd0 None admin] PATH_INFO: `/v3/services` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:56.363218 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c465154-3a25-41fa-9adc-5f7bcd6eabd0 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:14:56.363520 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c465154-3a25-41fa-9adc-5f7bcd6eabd0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:14:56.364876 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c465154-3a25-41fa-9adc-5f7bcd6eabd0 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:14:56.369777 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 647/1299] 10.222.0.16 () {56 vars in 1116 bytes} [Thu Sep 15 12:14:56 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:14:56.375580 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f843c93-fa96-4634-b774-10c68594fdf8 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:14:56.406598 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:14:56.472804 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f843c93-fa96-4634-b774-10c68594fdf8 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:14:56.505348 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcb1d0d-7926-40db-94ed-cf18210611fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:14:56.505872 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb1d0d-7926-40db-94ed-cf18210611fc None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:56.506147 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb1d0d-7926-40db-94ed-cf18210611fc None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:56.506415 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb1d0d-7926-40db-94ed-cf18210611fc None admin] PATH_INFO: `/v3/endpoints` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:56.507128 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcb1d0d-7926-40db-94ed-cf18210611fc None admin] RBAC: Adding query filter params (interface=public, service_id=3599ebd1635440659cf391527fe7d4ce, region_id=RegionOne) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:14:56.507431 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcb1d0d-7926-40db-94ed-cf18210611fc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:14:56.508766 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcb1d0d-7926-40db-94ed-cf18210611fc None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:14:56.516894 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 653/1300] 10.222.0.16 () {56 vars in 1251 bytes} [Thu Sep 15 12:14:56 2022] GET /identity/v3/endpoints?service_id=3599ebd1635440659cf391527fe7d4ce&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:14:56.523047 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c465154-3a25-41fa-9adc-5f7bcd6eabd0 None admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:14:56.602558 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:14:56.620266 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c465154-3a25-41fa-9adc-5f7bcd6eabd0 None admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:14:56.653194 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e333b2-24e9-4b74-a549-5ec280e0db9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:14:56.653785 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e333b2-24e9-4b74-a549-5ec280e0db9a None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:56.654064 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e333b2-24e9-4b74-a549-5ec280e0db9a None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:56.654331 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e333b2-24e9-4b74-a549-5ec280e0db9a None admin] PATH_INFO: `/v3/services` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:56.654949 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e333b2-24e9-4b74-a549-5ec280e0db9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:14:56.656309 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e333b2-24e9-4b74-a549-5ec280e0db9a None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:14:56.662870 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 648/1301] 10.222.0.16 () {56 vars in 1087 bytes} [Thu Sep 15 12:14:56 2022] GET /identity/v3/services => generated 2191 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:14:58.781016 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253cbaf-bb23-4b6c-9670-e22246c2497a None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:58.781535 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253cbaf-bb23-4b6c-9670-e22246c2497a None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:58.781535 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253cbaf-bb23-4b6c-9670-e22246c2497a None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:58.782915 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 654/1302] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:14:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:14:58.788192 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a9c8eb-2030-4cfb-a3d5-0daed2eca223 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:58.788628 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a9c8eb-2030-4cfb-a3d5-0daed2eca223 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:58.788747 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a9c8eb-2030-4cfb-a3d5-0daed2eca223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:58.806500 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-65a9c8eb-2030-4cfb-a3d5-0daed2eca223 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:14:58.807730 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-65a9c8eb-2030-4cfb-a3d5-0daed2eca223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:14:58.871417 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 649/1303] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:14:58 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 12:14:59.164426 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6253cbaf-bb23-4b6c-9670-e22246c2497a None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:14:59.258185 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:14:59.265573 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6253cbaf-bb23-4b6c-9670-e22246c2497a None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:14:59.297934 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63f4ae8-7141-49ff-ad55-6996043b0444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:14:59.298542 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f4ae8-7141-49ff-ad55-6996043b0444 None admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:59.298845 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f4ae8-7141-49ff-ad55-6996043b0444 None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:59.299112 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f4ae8-7141-49ff-ad55-6996043b0444 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:59.299686 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63f4ae8-7141-49ff-ad55-6996043b0444 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:14:59.301027 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63f4ae8-7141-49ff-ad55-6996043b0444 None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:14:59.310155 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application [None req-c63f4ae8-7141-49ff-ad55-6996043b0444 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 15 12:14:59.310155 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:14:59.310155 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 12:14:59.310155 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 12:14:59.310155 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 12:14:59.310155 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 12:14:59.310155 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 12:14:59.310155 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:14:59.310155 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 15 12:14:59.310155 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:14:59.310155 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 12:14:59.310155 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:14:59.310155 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 12:14:59.310155 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 12:14:59.310155 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 12:14:59.310155 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 12:14:59.310155 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 12:14:59.311340 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 12:14:59.311340 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 12:14:59.311340 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 12:14:59.311340 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 12:14:59.311340 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 12:14:59.311340 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 12:14:59.311340 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 12:14:59.311340 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 12:14:59.311340 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 12:14:59.311340 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 12:14:59.311340 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 12:14:59.311340 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 12:14:59.311340 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 12:14:59.311340 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 12:14:59.311340 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 12:14:59.311340 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 12:14:59.312394 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 12:14:59.312394 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application with Lock( Sep 15 12:14:59.312394 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 12:14:59.312394 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self._enter() Sep 15 12:14:59.312394 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 12:14:59.312394 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 12:14:59.312394 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 12:14:59.312394 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application return self.creator() Sep 15 12:14:59.312394 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 12:14:59.312394 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application created_value = creator( Sep 15 12:14:59.312394 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 12:14:59.312394 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 12:14:59.312394 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 15 12:14:59.312394 dv-cinder-850836-7-smb devstack@keystone.service[81374]: ERROR keystone.server.flask.application Sep 15 12:14:59.312394 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 655/1304] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Sep 15 12:14:59 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 12:14:59.317767 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a9c8eb-2030-4cfb-a3d5-0daed2eca223 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:14:59.397290 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:14:59.420273 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a9c8eb-2030-4cfb-a3d5-0daed2eca223 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:14:59.453759 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7186af75-2775-4093-8c9a-346c6cf85311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:14:59.454363 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7186af75-2775-4093-8c9a-346c6cf85311 None admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:59.454641 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7186af75-2775-4093-8c9a-346c6cf85311 None admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:59.454941 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7186af75-2775-4093-8c9a-346c6cf85311 None admin] PATH_INFO: `/v3/services` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:59.455567 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7186af75-2775-4093-8c9a-346c6cf85311 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:14:59.455869 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7186af75-2775-4093-8c9a-346c6cf85311 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:14:59.457232 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7186af75-2775-4093-8c9a-346c6cf85311 None admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:14:59.462191 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 650/1305] 10.222.0.16 () {56 vars in 1116 bytes} [Thu Sep 15 12:14:59 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:14:59.467980 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63f4ae8-7141-49ff-ad55-6996043b0444 None admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:14:59.564848 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63f4ae8-7141-49ff-ad55-6996043b0444 None admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:14:59.596779 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3222c6-53ae-45f3-aa77-3efbbb0ebe4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:14:59.597372 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3222c6-53ae-45f3-aa77-3efbbb0ebe4f None admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:14:59.597649 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3222c6-53ae-45f3-aa77-3efbbb0ebe4f None admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:14:59.597920 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3222c6-53ae-45f3-aa77-3efbbb0ebe4f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:14:59.598616 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3222c6-53ae-45f3-aa77-3efbbb0ebe4f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:14:59.599987 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3222c6-53ae-45f3-aa77-3efbbb0ebe4f None admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:14:59.619599 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 656/1306] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:14:59 2022] POST /identity/v3/endpoints => generated 331 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:15:09.459280 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=30 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:15:09.614780 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:16:03.174448 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd141b8e-91bf-471a-bf1e-6c1de4a2c286 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:16:03.175738 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd141b8e-91bf-471a-bf1e-6c1de4a2c286 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:16:03.176320 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd141b8e-91bf-471a-bf1e-6c1de4a2c286 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:16:03.184829 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 651/1307] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:16:03 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:16:03.185960 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615be9ba-a0b8-4d72-9c3c-029831a4251d None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:16:03.186428 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615be9ba-a0b8-4d72-9c3c-029831a4251d None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:16:03.186682 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615be9ba-a0b8-4d72-9c3c-029831a4251d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:16:03.310846 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-615be9ba-a0b8-4d72-9c3c-029831a4251d None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:16:03.312096 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-615be9ba-a0b8-4d72-9c3c-029831a4251d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:16:03.422005 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 657/1308] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:16:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:16:03.715904 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f8092-647e-4250-a6b9-3133ec50f964 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:16:03.716445 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f8092-647e-4250-a6b9-3133ec50f964 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:16:03.716723 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f8092-647e-4250-a6b9-3133ec50f964 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:16:03.718268 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 652/1309] 10.222.0.16 () {54 vars in 965 bytes} [Thu Sep 15 12:16:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:16:03.724707 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a7a345-ac5f-4ed3-83bd-9d265e1fa549 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:16:03.725134 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a7a345-ac5f-4ed3-83bd-9d265e1fa549 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:16:03.725510 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a7a345-ac5f-4ed3-83bd-9d265e1fa549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:16:03.824626 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-23a7a345-ac5f-4ed3-83bd-9d265e1fa549 None None] MFA Rules not processed for user `4003dbcee8104aa4a7ce90251bab88a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:16:03.825997 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-23a7a345-ac5f-4ed3-83bd-9d265e1fa549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:16:03.849648 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:16:03.910971 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 658/1310] 10.222.0.16 () {58 vars in 1062 bytes} [Thu Sep 15 12:16:03 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:16:03.919805 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3f8092-647e-4250-a6b9-3133ec50f964 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:16:03.921535 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-3e3f8092-647e-4250-a6b9-3133ec50f964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:16:04.035051 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3f8092-647e-4250-a6b9-3133ec50f964 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:16:04.121543 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2807d449-50e7-4097-afbd-abc6cecf32c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:16:04.122063 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2807d449-50e7-4097-afbd-abc6cecf32c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:16:04.122341 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2807d449-50e7-4097-afbd-abc6cecf32c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:16:04.122609 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2807d449-50e7-4097-afbd-abc6cecf32c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:16:04.124481 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-2807d449-50e7-4097-afbd-abc6cecf32c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:16:04.182226 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:16:04.246543 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2807d449-50e7-4097-afbd-abc6cecf32c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:16:04.248234 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2807d449-50e7-4097-afbd-abc6cecf32c6 service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:16:04.273982 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 653/1311] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:16:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:16:06.772874 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0cb0d7-74af-4797-99d9-dc5ac5a0eedf None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:16:06.773418 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0cb0d7-74af-4797-99d9-dc5ac5a0eedf None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:16:06.773418 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0cb0d7-74af-4797-99d9-dc5ac5a0eedf None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:16:06.774839 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 659/1312] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:16:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:16:06.780114 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121cf747-8020-4ee9-9f91-b433dee00eb1 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:16:06.780564 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121cf747-8020-4ee9-9f91-b433dee00eb1 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:16:06.780662 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121cf747-8020-4ee9-9f91-b433dee00eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:16:06.850831 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-121cf747-8020-4ee9-9f91-b433dee00eb1 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:16:06.851932 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-121cf747-8020-4ee9-9f91-b433dee00eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:16:06.946407 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 654/1313] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:16:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:16:07.225477 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0cb0d7-74af-4797-99d9-dc5ac5a0eedf None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:16:07.227816 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-de0cb0d7-74af-4797-99d9-dc5ac5a0eedf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:16:07.333636 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0cb0d7-74af-4797-99d9-dc5ac5a0eedf None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:16:07.404708 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:16:07.407332 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3082b3-abbe-4a50-8a20-2f35c29bb0aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:16:07.408134 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3082b3-abbe-4a50-8a20-2f35c29bb0aa service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:16:07.408564 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3082b3-abbe-4a50-8a20-2f35c29bb0aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:16:07.409009 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3082b3-abbe-4a50-8a20-2f35c29bb0aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:16:07.410632 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-ba3082b3-abbe-4a50-8a20-2f35c29bb0aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:16:07.517552 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3082b3-abbe-4a50-8a20-2f35c29bb0aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:16:07.518925 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3082b3-abbe-4a50-8a20-2f35c29bb0aa service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:16:07.537299 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 660/1314] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:16:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:16:09.978145 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719520cd-f7ac-4dc8-8797-39d0b9cbc1f9 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:16:09.978572 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719520cd-f7ac-4dc8-8797-39d0b9cbc1f9 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:16:09.978714 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719520cd-f7ac-4dc8-8797-39d0b9cbc1f9 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:16:09.980083 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 655/1315] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:16:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:16:09.985280 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1417d1-79f1-4efd-a517-f658a987172b None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:16:09.985679 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1417d1-79f1-4efd-a517-f658a987172b None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:16:09.985816 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1417d1-79f1-4efd-a517-f658a987172b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:16:10.050812 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-7a1417d1-79f1-4efd-a517-f658a987172b None None] MFA Rules not processed for user `b0dd68fd960b44079ef49a5f9f3b0675`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:16:10.052000 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-7a1417d1-79f1-4efd-a517-f658a987172b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:16:10.102481 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:16:10.152826 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 661/1316] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:16:09 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:16:10.440732 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719520cd-f7ac-4dc8-8797-39d0b9cbc1f9 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:16:10.442303 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-719520cd-f7ac-4dc8-8797-39d0b9cbc1f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:16:10.459445 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:16:10.551622 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719520cd-f7ac-4dc8-8797-39d0b9cbc1f9 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:16:10.623140 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6699c4-ffa0-4d98-8050-103895528b75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:16:10.623735 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6699c4-ffa0-4d98-8050-103895528b75 service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:16:10.624011 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6699c4-ffa0-4d98-8050-103895528b75 service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:16:10.624278 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6699c4-ffa0-4d98-8050-103895528b75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:16:10.625851 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-4e6699c4-ffa0-4d98-8050-103895528b75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:16:10.686237 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:16:10.732895 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6699c4-ffa0-4d98-8050-103895528b75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:16:10.734321 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6699c4-ffa0-4d98-8050-103895528b75 service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:16:10.753548 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 656/1317] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:16:10 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:16:13.415259 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823cdd85-1b21-4348-85f2-782fa6cc9974 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:16:13.415761 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823cdd85-1b21-4348-85f2-782fa6cc9974 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:16:13.415761 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823cdd85-1b21-4348-85f2-782fa6cc9974 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:16:13.417137 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 662/1318] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:16:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:16:13.422358 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863a441a-610f-4021-87fa-5dd124d3f0e4 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:16:13.422759 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863a441a-610f-4021-87fa-5dd124d3f0e4 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:16:13.422929 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863a441a-610f-4021-87fa-5dd124d3f0e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:16:13.486879 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-863a441a-610f-4021-87fa-5dd124d3f0e4 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:16:13.488070 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-863a441a-610f-4021-87fa-5dd124d3f0e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:16:13.580865 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 657/1319] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:16:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:16:13.869909 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823cdd85-1b21-4348-85f2-782fa6cc9974 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:16:13.871469 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-823cdd85-1b21-4348-85f2-782fa6cc9974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:16:13.971278 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823cdd85-1b21-4348-85f2-782fa6cc9974 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:16:14.044810 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1c2a16-4856-446a-b2be-f1c32d4211e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:16:14.045408 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c2a16-4856-446a-b2be-f1c32d4211e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:16:14.045685 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c2a16-4856-446a-b2be-f1c32d4211e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:16:14.045953 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c2a16-4856-446a-b2be-f1c32d4211e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:16:14.047561 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-de1c2a16-4856-446a-b2be-f1c32d4211e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:16:14.054310 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:16:14.154259 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1c2a16-4856-446a-b2be-f1c32d4211e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:16:14.155634 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1c2a16-4856-446a-b2be-f1c32d4211e3 service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:16:14.173554 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 663/1320] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:16:13 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:16:16.968277 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb57f29-06d0-497d-a768-b710026b4cd5 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:16:16.968826 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb57f29-06d0-497d-a768-b710026b4cd5 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:16:16.968826 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb57f29-06d0-497d-a768-b710026b4cd5 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:16:16.970363 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 658/1321] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:16:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:16:16.975694 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ed410-14a3-424e-a5d0-0a25450617d9 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:16:16.976147 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ed410-14a3-424e-a5d0-0a25450617d9 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:16:16.976246 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ed410-14a3-424e-a5d0-0a25450617d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:16:17.050000 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-4c7ed410-14a3-424e-a5d0-0a25450617d9 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:16:17.051259 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-4c7ed410-14a3-424e-a5d0-0a25450617d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:16:17.114368 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:16:17.155630 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 664/1322] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:16:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:16:17.436215 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb57f29-06d0-497d-a768-b710026b4cd5 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:16:17.437760 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-6fb57f29-06d0-497d-a768-b710026b4cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:16:17.457323 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:16:17.540539 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb57f29-06d0-497d-a768-b710026b4cd5 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:16:17.613566 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c88ea52-22d8-472c-848c-4a8b89bcabfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:16:17.614173 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88ea52-22d8-472c-848c-4a8b89bcabfd service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:16:17.614449 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88ea52-22d8-472c-848c-4a8b89bcabfd service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:16:17.614742 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88ea52-22d8-472c-848c-4a8b89bcabfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:16:17.616320 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-4c88ea52-22d8-472c-848c-4a8b89bcabfd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:16:17.686637 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:16:17.724979 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c88ea52-22d8-472c-848c-4a8b89bcabfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:16:17.726443 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c88ea52-22d8-472c-848c-4a8b89bcabfd service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:16:17.744543 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 659/1323] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:16:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:16:19.949960 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c115fbf-cb47-4151-aea2-7839c53c97b6 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:16:19.950540 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c115fbf-cb47-4151-aea2-7839c53c97b6 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:16:19.950540 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c115fbf-cb47-4151-aea2-7839c53c97b6 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:16:19.952015 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 665/1324] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:16:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:16:19.957022 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0360c82e-446b-4db7-9e68-a3a42b18ac30 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:16:19.957432 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0360c82e-446b-4db7-9e68-a3a42b18ac30 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:16:19.957682 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0360c82e-446b-4db7-9e68-a3a42b18ac30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:16:20.027083 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-0360c82e-446b-4db7-9e68-a3a42b18ac30 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:16:20.028228 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-0360c82e-446b-4db7-9e68-a3a42b18ac30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:16:20.130008 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 660/1325] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:16:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:16:20.409438 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c115fbf-cb47-4151-aea2-7839c53c97b6 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:16:20.410993 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-6c115fbf-cb47-4151-aea2-7839c53c97b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:16:20.525162 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c115fbf-cb47-4151-aea2-7839c53c97b6 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:16:20.602908 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b892d866-5d6b-4bc3-a791-16dd13d9133b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:16:20.603520 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b892d866-5d6b-4bc3-a791-16dd13d9133b service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:16:20.603795 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b892d866-5d6b-4bc3-a791-16dd13d9133b service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:16:20.604075 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b892d866-5d6b-4bc3-a791-16dd13d9133b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:16:20.605728 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-b892d866-5d6b-4bc3-a791-16dd13d9133b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:16:20.624698 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:16:20.720920 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b892d866-5d6b-4bc3-a791-16dd13d9133b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:16:20.722411 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b892d866-5d6b-4bc3-a791-16dd13d9133b service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:16:20.740843 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 666/1326] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:16:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:16:22.977053 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4b79ec-eb8c-4c30-93ec-a58658773777 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:16:22.977510 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4b79ec-eb8c-4c30-93ec-a58658773777 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:16:22.977602 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4b79ec-eb8c-4c30-93ec-a58658773777 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:16:22.978952 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 661/1327] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:16:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:16:22.984103 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d7cabb-a08c-4fea-8a5e-9837c816c694 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:16:22.984504 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d7cabb-a08c-4fea-8a5e-9837c816c694 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:16:22.984659 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d7cabb-a08c-4fea-8a5e-9837c816c694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:16:23.051904 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-80d7cabb-a08c-4fea-8a5e-9837c816c694 None None] MFA Rules not processed for user `b0dd68fd960b44079ef49a5f9f3b0675`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:16:23.053014 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-80d7cabb-a08c-4fea-8a5e-9837c816c694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:16:23.117593 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:16:23.149607 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 667/1328] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:16:22 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:16:23.429294 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4b79ec-eb8c-4c30-93ec-a58658773777 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:16:23.430916 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-6f4b79ec-eb8c-4c30-93ec-a58658773777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:16:23.463837 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:16:23.537538 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4b79ec-eb8c-4c30-93ec-a58658773777 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:16:23.609807 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3002b7-d686-48f3-bf54-ed1b170f9e6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:16:23.610329 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3002b7-d686-48f3-bf54-ed1b170f9e6f service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:16:23.610601 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3002b7-d686-48f3-bf54-ed1b170f9e6f service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:16:23.610894 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3002b7-d686-48f3-bf54-ed1b170f9e6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:16:23.612457 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-3e3002b7-d686-48f3-bf54-ed1b170f9e6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:16:23.689864 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:16:23.722283 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3002b7-d686-48f3-bf54-ed1b170f9e6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:16:23.723751 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3002b7-d686-48f3-bf54-ed1b170f9e6f service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:16:23.741428 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 662/1329] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:16:23 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:16:26.143624 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98799b6-ad43-4f12-8ce2-ac516f888d17 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:16:26.144177 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98799b6-ad43-4f12-8ce2-ac516f888d17 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:16:26.144177 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98799b6-ad43-4f12-8ce2-ac516f888d17 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:16:26.145506 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 668/1330] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:16:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:16:26.151329 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d30c0e8-4df1-4512-96f4-72c813d0e284 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:16:26.151729 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d30c0e8-4df1-4512-96f4-72c813d0e284 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:16:26.151877 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d30c0e8-4df1-4512-96f4-72c813d0e284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:16:26.220913 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-9d30c0e8-4df1-4512-96f4-72c813d0e284 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:16:26.222043 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-9d30c0e8-4df1-4512-96f4-72c813d0e284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:16:26.316725 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 663/1331] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:16:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:16:26.615857 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2e264-0e5b-423c-b1d4-ccff2bf3d9e6 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:16:26.616142 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2e264-0e5b-423c-b1d4-ccff2bf3d9e6 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:16:26.616417 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2e264-0e5b-423c-b1d4-ccff2bf3d9e6 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:16:26.617788 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 669/1332] 10.222.0.16 () {54 vars in 965 bytes} [Thu Sep 15 12:16:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:16:26.623320 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2587ed-9c81-4112-bf7c-bb5d14764385 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:16:26.623608 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2587ed-9c81-4112-bf7c-bb5d14764385 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:16:26.623912 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2587ed-9c81-4112-bf7c-bb5d14764385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:16:26.670446 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:16:26.701281 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-dd2587ed-9c81-4112-bf7c-bb5d14764385 None None] MFA Rules not processed for user `4003dbcee8104aa4a7ce90251bab88a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:16:26.702485 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-dd2587ed-9c81-4112-bf7c-bb5d14764385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:16:26.777133 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 664/1333] 10.222.0.16 () {58 vars in 1062 bytes} [Thu Sep 15 12:16:26 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:16:26.785935 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b2e264-0e5b-423c-b1d4-ccff2bf3d9e6 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:16:26.787543 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-10b2e264-0e5b-423c-b1d4-ccff2bf3d9e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:16:26.895223 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b2e264-0e5b-423c-b1d4-ccff2bf3d9e6 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:16:26.970662 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c9fb9a-4ef0-4ca1-93c9-4d6028569bdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:16:26.971636 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c9fb9a-4ef0-4ca1-93c9-4d6028569bdc service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:16:26.971923 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c9fb9a-4ef0-4ca1-93c9-4d6028569bdc service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:16:26.972199 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c9fb9a-4ef0-4ca1-93c9-4d6028569bdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:16:26.973827 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-93c9fb9a-4ef0-4ca1-93c9-4d6028569bdc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:16:27.001067 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:16:27.082643 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c9fb9a-4ef0-4ca1-93c9-4d6028569bdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:16:27.084101 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c9fb9a-4ef0-4ca1-93c9-4d6028569bdc service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:16:27.101903 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 670/1334] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:16:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 12:16:29.498909 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6632a64a-c842-4c36-919d-e6a4eccf5271 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:16:29.499446 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6632a64a-c842-4c36-919d-e6a4eccf5271 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:16:29.499542 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6632a64a-c842-4c36-919d-e6a4eccf5271 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:16:29.500848 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 665/1335] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:16:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:16:29.506305 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20babb01-a628-4e3e-8554-7ebefda0c21d None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:16:29.506760 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20babb01-a628-4e3e-8554-7ebefda0c21d None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:16:29.506872 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20babb01-a628-4e3e-8554-7ebefda0c21d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:16:29.571407 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-20babb01-a628-4e3e-8554-7ebefda0c21d None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:16:29.572596 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-20babb01-a628-4e3e-8554-7ebefda0c21d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:16:29.645329 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:16:29.668718 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 671/1336] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:16:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:16:29.952306 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6632a64a-c842-4c36-919d-e6a4eccf5271 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:16:29.953880 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-6632a64a-c842-4c36-919d-e6a4eccf5271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:16:30.056577 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6632a64a-c842-4c36-919d-e6a4eccf5271 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:16:30.084958 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:16:30.130024 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5983a95-b6b7-4df2-a329-1c108ed728a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:16:30.130620 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5983a95-b6b7-4df2-a329-1c108ed728a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:16:30.130924 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5983a95-b6b7-4df2-a329-1c108ed728a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:16:30.131188 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5983a95-b6b7-4df2-a329-1c108ed728a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:16:30.133379 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-b5983a95-b6b7-4df2-a329-1c108ed728a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:16:30.242841 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5983a95-b6b7-4df2-a329-1c108ed728a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:16:30.244203 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5983a95-b6b7-4df2-a329-1c108ed728a7 service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:16:30.261940 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 666/1337] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:16:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:16:33.024907 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0631b9a9-e70d-43d6-9438-953676756b2b None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:16:33.025456 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0631b9a9-e70d-43d6-9438-953676756b2b None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:16:33.025456 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0631b9a9-e70d-43d6-9438-953676756b2b None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:16:33.026836 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 672/1338] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:16:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:16:33.031989 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd6fec-1436-4a77-97bd-55cf49dd20c4 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:16:33.032404 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd6fec-1436-4a77-97bd-55cf49dd20c4 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:16:33.032536 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd6fec-1436-4a77-97bd-55cf49dd20c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:16:33.097056 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-e6cd6fec-1436-4a77-97bd-55cf49dd20c4 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:16:33.098249 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-e6cd6fec-1436-4a77-97bd-55cf49dd20c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:16:33.106403 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:16:33.197478 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 667/1339] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:16:33 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:16:33.482401 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0631b9a9-e70d-43d6-9438-953676756b2b None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:16:33.483984 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-0631b9a9-e70d-43d6-9438-953676756b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:16:33.583786 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0631b9a9-e70d-43d6-9438-953676756b2b None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:16:33.654761 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addf2760-a2b8-4125-b939-cd640113e9ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:16:33.655349 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf2760-a2b8-4125-b939-cd640113e9ec service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:16:33.655622 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf2760-a2b8-4125-b939-cd640113e9ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:16:33.655884 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf2760-a2b8-4125-b939-cd640113e9ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:16:33.657452 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-addf2760-a2b8-4125-b939-cd640113e9ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:16:33.692441 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:16:33.764712 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addf2760-a2b8-4125-b939-cd640113e9ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:16:33.766131 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addf2760-a2b8-4125-b939-cd640113e9ec service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:16:33.784445 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 673/1340] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:16:33 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:16:37.989756 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd7f218-5070-4797-923f-1a5562780a17 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:16:37.990234 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd7f218-5070-4797-923f-1a5562780a17 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:16:37.990234 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd7f218-5070-4797-923f-1a5562780a17 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:16:37.991636 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 668/1341] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:16:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:16:37.996921 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc48fee-4dec-4b63-be5c-8c75d4b388f6 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:16:37.997307 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc48fee-4dec-4b63-be5c-8c75d4b388f6 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:16:37.997511 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc48fee-4dec-4b63-be5c-8c75d4b388f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:16:38.063229 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-1dc48fee-4dec-4b63-be5c-8c75d4b388f6 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:16:38.064429 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-1dc48fee-4dec-4b63-be5c-8c75d4b388f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:16:38.150922 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:16:38.162232 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 674/1342] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:16:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:16:38.446642 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd7f218-5070-4797-923f-1a5562780a17 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:16:38.448191 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-2dd7f218-5070-4797-923f-1a5562780a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:16:38.551036 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd7f218-5070-4797-923f-1a5562780a17 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:16:38.589097 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:16:38.626079 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3dcc9d-3679-4855-9409-98a4abf45a80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:16:38.626676 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3dcc9d-3679-4855-9409-98a4abf45a80 service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:16:38.627242 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3dcc9d-3679-4855-9409-98a4abf45a80 service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:16:38.627504 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3dcc9d-3679-4855-9409-98a4abf45a80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:16:38.629062 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-4b3dcc9d-3679-4855-9409-98a4abf45a80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:16:38.740003 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3dcc9d-3679-4855-9409-98a4abf45a80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:16:38.741868 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3dcc9d-3679-4855-9409-98a4abf45a80 service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:16:38.759786 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 669/1343] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:16:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:16:41.532810 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95affc8-8fb0-4757-9c48-8bb4071c2e93 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:16:41.533372 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95affc8-8fb0-4757-9c48-8bb4071c2e93 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:16:41.533480 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95affc8-8fb0-4757-9c48-8bb4071c2e93 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:16:41.534883 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 675/1344] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:16:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:16:41.540795 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd59573-179c-4093-87b9-ea23f9dfdbbe None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:16:41.541217 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd59573-179c-4093-87b9-ea23f9dfdbbe None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:16:41.541467 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd59573-179c-4093-87b9-ea23f9dfdbbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:16:41.608381 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-4bd59573-179c-4093-87b9-ea23f9dfdbbe None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:16:41.611705 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-4bd59573-179c-4093-87b9-ea23f9dfdbbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:16:41.632285 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:16:41.718441 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 670/1345] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:16:41 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:16:42.013768 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95affc8-8fb0-4757-9c48-8bb4071c2e93 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:16:42.015319 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-e95affc8-8fb0-4757-9c48-8bb4071c2e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:16:42.123989 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95affc8-8fb0-4757-9c48-8bb4071c2e93 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:16:42.197528 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b76fcc-7250-47b3-a118-76364fc870fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:16:42.198128 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b76fcc-7250-47b3-a118-76364fc870fc service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:16:42.198401 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b76fcc-7250-47b3-a118-76364fc870fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:16:42.198669 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b76fcc-7250-47b3-a118-76364fc870fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:16:42.200272 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-d2b76fcc-7250-47b3-a118-76364fc870fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:16:42.244628 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:16:42.321428 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b76fcc-7250-47b3-a118-76364fc870fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:16:42.322957 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b76fcc-7250-47b3-a118-76364fc870fc service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:16:42.341539 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 676/1346] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:16:42 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:16:46.666789 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d047324-4b84-4b7f-bc9b-a8d6ffeb2891 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:16:46.667261 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d047324-4b84-4b7f-bc9b-a8d6ffeb2891 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:16:46.667352 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d047324-4b84-4b7f-bc9b-a8d6ffeb2891 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:16:46.672786 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 671/1347] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:16:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:16:46.674255 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8edf562-2c96-4397-afb3-d87e65edbfc9 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:16:46.674749 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8edf562-2c96-4397-afb3-d87e65edbfc9 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:16:46.674840 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8edf562-2c96-4397-afb3-d87e65edbfc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:16:46.747363 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-e8edf562-2c96-4397-afb3-d87e65edbfc9 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:16:46.748591 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-e8edf562-2c96-4397-afb3-d87e65edbfc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:16:46.847480 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:16:46.849780 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 677/1348] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:16:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:16:47.131483 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d047324-4b84-4b7f-bc9b-a8d6ffeb2891 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:16:47.133008 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-6d047324-4b84-4b7f-bc9b-a8d6ffeb2891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:16:47.235246 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d047324-4b84-4b7f-bc9b-a8d6ffeb2891 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:16:47.283642 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:16:47.309612 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b6c253-719f-4e4f-a2f1-78e10fb63df2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:16:47.310209 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b6c253-719f-4e4f-a2f1-78e10fb63df2 service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:16:47.310484 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b6c253-719f-4e4f-a2f1-78e10fb63df2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:16:47.310779 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b6c253-719f-4e4f-a2f1-78e10fb63df2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:16:47.312359 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-09b6c253-719f-4e4f-a2f1-78e10fb63df2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:16:47.423662 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b6c253-719f-4e4f-a2f1-78e10fb63df2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:16:47.424999 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b6c253-719f-4e4f-a2f1-78e10fb63df2 service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:16:47.442487 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 672/1349] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:16:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:16:52.364590 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57820c7f-3f6d-4a29-bf53-566622b0a6cc None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:16:52.365079 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57820c7f-3f6d-4a29-bf53-566622b0a6cc None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:16:52.365177 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57820c7f-3f6d-4a29-bf53-566622b0a6cc None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:16:52.367522 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 678/1350] 10.222.0.16 () {54 vars in 921 bytes} [Thu Sep 15 12:16:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:16:52.372807 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda08b5-1ade-4d82-b753-25bc3539205c None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:16:52.373253 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda08b5-1ade-4d82-b753-25bc3539205c None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:16:52.373339 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda08b5-1ade-4d82-b753-25bc3539205c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:16:52.518064 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-cbda08b5-1ade-4d82-b753-25bc3539205c None None] MFA Rules not processed for user `b7ff8a5ddf1e422ca97f92bd9d4e5fb8`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:16:52.519220 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-cbda08b5-1ade-4d82-b753-25bc3539205c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:16:52.541816 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:16:52.649605 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 673/1351] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Sep 15 12:16:52 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:16:56.839856 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b9d200-b28b-40b0-a670-82b2592fd451 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:16:56.840366 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b9d200-b28b-40b0-a670-82b2592fd451 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:16:56.840653 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b9d200-b28b-40b0-a670-82b2592fd451 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:16:56.842978 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 679/1352] 10.222.0.16 () {54 vars in 921 bytes} [Thu Sep 15 12:16:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:16:56.849331 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94822f22-ccb1-4847-91e9-e6a061ba4677 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:16:56.849971 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94822f22-ccb1-4847-91e9-e6a061ba4677 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:16:56.849971 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94822f22-ccb1-4847-91e9-e6a061ba4677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:16:56.935671 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-94822f22-ccb1-4847-91e9-e6a061ba4677 None None] MFA Rules not processed for user `b7ff8a5ddf1e422ca97f92bd9d4e5fb8`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:16:56.937322 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-94822f22-ccb1-4847-91e9-e6a061ba4677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:16:57.021216 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:16:57.065908 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 674/1353] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Sep 15 12:16:56 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:16:58.424864 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4988c9e-9c76-437e-827a-bc42c94f884e None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:16:58.425365 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4988c9e-9c76-437e-827a-bc42c94f884e None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:16:58.425365 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4988c9e-9c76-437e-827a-bc42c94f884e None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:16:58.426807 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 680/1354] 10.222.0.16 () {54 vars in 921 bytes} [Thu Sep 15 12:16:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:16:58.431843 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c9e65f-009f-46d5-b19c-d9d8fac63111 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:16:58.432296 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c9e65f-009f-46d5-b19c-d9d8fac63111 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:16:58.432394 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c9e65f-009f-46d5-b19c-d9d8fac63111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:16:58.508155 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-43c9e65f-009f-46d5-b19c-d9d8fac63111 None None] MFA Rules not processed for user `b7ff8a5ddf1e422ca97f92bd9d4e5fb8`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:16:58.509380 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-43c9e65f-009f-46d5-b19c-d9d8fac63111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:16:58.618817 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 675/1355] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Sep 15 12:16:58 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:17:02.149653 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2f2d82-8d3c-4d57-b49a-35fbe3f1e341 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:17:02.150144 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2f2d82-8d3c-4d57-b49a-35fbe3f1e341 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:17:02.150144 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2f2d82-8d3c-4d57-b49a-35fbe3f1e341 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:17:02.151506 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 681/1356] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:17:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:17:02.157285 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9ac0b4-1247-4509-8081-5e11ccb754da None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:17:02.157727 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9ac0b4-1247-4509-8081-5e11ccb754da None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:17:02.158477 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9ac0b4-1247-4509-8081-5e11ccb754da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:17:02.202207 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:17:02.242125 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-0a9ac0b4-1247-4509-8081-5e11ccb754da None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:17:02.243600 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-0a9ac0b4-1247-4509-8081-5e11ccb754da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:17:02.353582 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 676/1357] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:17:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:17:02.658989 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b491e0d-878a-4707-bee4-56dd23ace596 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:17:02.659563 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b491e0d-878a-4707-bee4-56dd23ace596 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:17:02.660370 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b491e0d-878a-4707-bee4-56dd23ace596 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:17:02.663039 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 682/1358] 10.222.0.16 () {54 vars in 962 bytes} [Thu Sep 15 12:17:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:17:02.684777 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6954a254-543a-40c1-9013-a755a4f347a6 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:17:02.685962 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6954a254-543a-40c1-9013-a755a4f347a6 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:17:02.685962 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6954a254-543a-40c1-9013-a755a4f347a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:17:02.770256 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-6954a254-543a-40c1-9013-a755a4f347a6 None None] MFA Rules not processed for user `9d05c52570474820b4ba0e2cdad5c13f`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:17:02.772054 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-6954a254-543a-40c1-9013-a755a4f347a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:17:02.828061 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:17:02.904785 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 677/1359] 10.222.0.16 () {58 vars in 1059 bytes} [Thu Sep 15 12:17:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:17:02.913676 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b491e0d-878a-4707-bee4-56dd23ace596 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:17:02.915237 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-4b491e0d-878a-4707-bee4-56dd23ace596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:17:03.074842 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b491e0d-878a-4707-bee4-56dd23ace596 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:17:03.152344 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:17:03.194984 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af101bb8-6c5a-4e0d-b066-458783a2f5ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d05c52570474820b4ba0e2cdad5c13f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:17:03.195597 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af101bb8-6c5a-4e0d-b066-458783a2f5ff service nova] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:17:03.195869 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af101bb8-6c5a-4e0d-b066-458783a2f5ff service nova] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:17:03.196144 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af101bb8-6c5a-4e0d-b066-458783a2f5ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:17:03.197724 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-af101bb8-6c5a-4e0d-b066-458783a2f5ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:17:03.307603 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af101bb8-6c5a-4e0d-b066-458783a2f5ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:17:03.309245 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af101bb8-6c5a-4e0d-b066-458783a2f5ff service nova] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:17:03.329143 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 683/1360] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:17:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 12:17:05.723059 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5766cc22-9854-4716-a310-f8608e45f684 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:17:05.723059 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5766cc22-9854-4716-a310-f8608e45f684 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:17:05.723795 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5766cc22-9854-4716-a310-f8608e45f684 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:17:05.724793 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 678/1361] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:17:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:17:05.729880 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06108943-3419-48f1-b231-8017328e4917 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:17:05.730263 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06108943-3419-48f1-b231-8017328e4917 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:17:05.730507 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06108943-3419-48f1-b231-8017328e4917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:17:05.800220 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-06108943-3419-48f1-b231-8017328e4917 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:17:05.801422 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-06108943-3419-48f1-b231-8017328e4917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:17:05.845239 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:17:05.907936 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 684/1362] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:17:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:17:06.203487 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5766cc22-9854-4716-a310-f8608e45f684 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:17:06.205242 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-5766cc22-9854-4716-a310-f8608e45f684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:17:06.385074 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5766cc22-9854-4716-a310-f8608e45f684 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:17:06.396220 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:17:06.509601 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb31c9df-4f88-4c88-b78c-4372bd9634fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d05c52570474820b4ba0e2cdad5c13f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:17:06.510131 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb31c9df-4f88-4c88-b78c-4372bd9634fe service nova] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:17:06.510403 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb31c9df-4f88-4c88-b78c-4372bd9634fe service nova] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:17:06.510669 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb31c9df-4f88-4c88-b78c-4372bd9634fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:17:06.512299 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-fb31c9df-4f88-4c88-b78c-4372bd9634fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:17:06.607747 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb31c9df-4f88-4c88-b78c-4372bd9634fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:17:06.609357 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb31c9df-4f88-4c88-b78c-4372bd9634fe service nova] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:17:06.628261 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 679/1363] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:17:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:17:09.128824 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ee4eb-2adf-4264-8f21-eae65c7c644d None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:17:09.129342 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ee4eb-2adf-4264-8f21-eae65c7c644d None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:17:09.129342 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ee4eb-2adf-4264-8f21-eae65c7c644d None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:17:09.130964 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 685/1364] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:17:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:17:09.136364 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d8e19-fbe8-492f-9791-39933a6c1a0a None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:17:09.136784 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d8e19-fbe8-492f-9791-39933a6c1a0a None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:17:09.137026 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d8e19-fbe8-492f-9791-39933a6c1a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:17:09.153365 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:17:09.208403 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-1b4d8e19-fbe8-492f-9791-39933a6c1a0a None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:17:09.209960 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-1b4d8e19-fbe8-492f-9791-39933a6c1a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:17:09.317913 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 680/1365] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:17:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:17:09.609555 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ca904-d7b4-4af2-8222-3292bf225f11 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:17:09.609932 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ca904-d7b4-4af2-8222-3292bf225f11 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:17:09.610314 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ca904-d7b4-4af2-8222-3292bf225f11 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:17:09.611821 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 686/1366] 10.222.0.16 () {54 vars in 962 bytes} [Thu Sep 15 12:17:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:17:09.617963 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e8c1a-7b77-4fa7-8d4c-d7f8ac0c6ead None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:17:09.618321 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e8c1a-7b77-4fa7-8d4c-d7f8ac0c6ead None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:17:09.618667 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e8c1a-7b77-4fa7-8d4c-d7f8ac0c6ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:17:09.705448 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-0f7e8c1a-7b77-4fa7-8d4c-d7f8ac0c6ead None None] MFA Rules not processed for user `9d05c52570474820b4ba0e2cdad5c13f`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:17:09.706801 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-0f7e8c1a-7b77-4fa7-8d4c-d7f8ac0c6ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:17:09.745334 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:17:09.835116 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 681/1367] 10.222.0.16 () {58 vars in 1059 bytes} [Thu Sep 15 12:17:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:17:09.842718 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925ca904-d7b4-4af2-8222-3292bf225f11 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:17:09.844502 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-925ca904-d7b4-4af2-8222-3292bf225f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:17:10.011682 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925ca904-d7b4-4af2-8222-3292bf225f11 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:17:10.035445 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:17:10.138330 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a604ec3-6105-4b7e-9e9e-e75f8139bf13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d05c52570474820b4ba0e2cdad5c13f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:17:10.139059 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a604ec3-6105-4b7e-9e9e-e75f8139bf13 service nova] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:17:10.139323 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a604ec3-6105-4b7e-9e9e-e75f8139bf13 service nova] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:17:10.139495 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a604ec3-6105-4b7e-9e9e-e75f8139bf13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:17:10.141104 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-3a604ec3-6105-4b7e-9e9e-e75f8139bf13 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:17:10.246362 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a604ec3-6105-4b7e-9e9e-e75f8139bf13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:17:10.247960 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a604ec3-6105-4b7e-9e9e-e75f8139bf13 service nova] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:17:10.267917 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 687/1368] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:17:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:17:10.337889 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe29c7-6291-42ea-a8f9-0c6fda79b19c None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:17:10.338431 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe29c7-6291-42ea-a8f9-0c6fda79b19c None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:17:10.338431 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe29c7-6291-42ea-a8f9-0c6fda79b19c None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:17:10.343071 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 682/1369] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:17:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:17:10.345457 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e115b116-d91c-41b6-a118-68b83cb2372e None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:17:10.345905 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e115b116-d91c-41b6-a118-68b83cb2372e None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:17:10.346244 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e115b116-d91c-41b6-a118-68b83cb2372e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:17:10.399944 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:17:10.445691 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-e115b116-d91c-41b6-a118-68b83cb2372e None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:17:10.447219 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-e115b116-d91c-41b6-a118-68b83cb2372e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:17:10.566836 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 688/1370] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:17:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:17:10.912718 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55340c7-900b-48e5-97d5-6309ddd90c88 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:17:10.912718 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55340c7-900b-48e5-97d5-6309ddd90c88 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:17:10.912718 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55340c7-900b-48e5-97d5-6309ddd90c88 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:17:10.915607 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 683/1371] 10.222.0.16 () {54 vars in 964 bytes} [Thu Sep 15 12:17:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:17:10.918860 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7491c-9bba-44ae-821a-5a27389b866b None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:17:10.919218 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7491c-9bba-44ae-821a-5a27389b866b None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:17:10.919566 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7491c-9bba-44ae-821a-5a27389b866b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:17:11.020954 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-35f7491c-9bba-44ae-821a-5a27389b866b None None] MFA Rules not processed for user `ceafc5e4283841528053f01931f10293`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:17:11.022310 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-35f7491c-9bba-44ae-821a-5a27389b866b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:17:11.070864 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:17:11.102666 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 689/1372] 10.222.0.16 () {58 vars in 1061 bytes} [Thu Sep 15 12:17:10 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:17:11.110498 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55340c7-900b-48e5-97d5-6309ddd90c88 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:17:11.112297 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-f55340c7-900b-48e5-97d5-6309ddd90c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:17:11.235212 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55340c7-900b-48e5-97d5-6309ddd90c88 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:17:11.290094 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:17:11.329766 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f69427d-799d-4f5d-bf0b-74a3243dbe89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceafc5e4283841528053f01931f10293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:17:11.330413 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f69427d-799d-4f5d-bf0b-74a3243dbe89 service cinder] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:17:11.330861 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f69427d-799d-4f5d-bf0b-74a3243dbe89 service cinder] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:17:11.330962 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f69427d-799d-4f5d-bf0b-74a3243dbe89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:17:11.332503 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-4f69427d-799d-4f5d-bf0b-74a3243dbe89 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:17:11.457988 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f69427d-799d-4f5d-bf0b-74a3243dbe89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:17:11.459688 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f69427d-799d-4f5d-bf0b-74a3243dbe89 service cinder] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:17:11.483276 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 684/1373] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:17:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:17:12.555203 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa31e30-bb44-4b7f-9d14-cf4346f4768c None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:17:12.555747 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa31e30-bb44-4b7f-9d14-cf4346f4768c None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:17:12.555747 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa31e30-bb44-4b7f-9d14-cf4346f4768c None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:17:12.557342 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 690/1374] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:17:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:17:12.563151 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f370b1-4a70-4c4b-ac37-9627feca0145 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:17:12.563562 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f370b1-4a70-4c4b-ac37-9627feca0145 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:17:12.563688 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f370b1-4a70-4c4b-ac37-9627feca0145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:17:12.632223 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-25f370b1-4a70-4c4b-ac37-9627feca0145 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:17:12.633582 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-25f370b1-4a70-4c4b-ac37-9627feca0145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:17:12.654626 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:17:12.730712 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 685/1375] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:17:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:17:13.033298 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa31e30-bb44-4b7f-9d14-cf4346f4768c None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:17:13.034890 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-4fa31e30-bb44-4b7f-9d14-cf4346f4768c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:17:13.194197 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa31e30-bb44-4b7f-9d14-cf4346f4768c None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:17:13.256085 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:17:13.318600 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f883b661-a4d7-48bd-8a2a-5ec2449adf68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d05c52570474820b4ba0e2cdad5c13f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:17:13.319222 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f883b661-a4d7-48bd-8a2a-5ec2449adf68 service nova] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:17:13.319495 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f883b661-a4d7-48bd-8a2a-5ec2449adf68 service nova] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:17:13.319757 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f883b661-a4d7-48bd-8a2a-5ec2449adf68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:17:13.321341 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-f883b661-a4d7-48bd-8a2a-5ec2449adf68 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:17:13.415715 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f883b661-a4d7-48bd-8a2a-5ec2449adf68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:17:13.417329 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f883b661-a4d7-48bd-8a2a-5ec2449adf68 service nova] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:17:13.435931 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 691/1376] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:17:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:17:15.668628 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac529333-e11c-49c4-ba56-c859f6190dc8 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:17:15.669256 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac529333-e11c-49c4-ba56-c859f6190dc8 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:17:15.669256 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac529333-e11c-49c4-ba56-c859f6190dc8 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:17:15.670639 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 686/1377] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:17:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:17:15.675751 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c613ea-42a1-440a-8c13-ccaf326a7e45 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:17:15.676161 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c613ea-42a1-440a-8c13-ccaf326a7e45 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:17:15.676299 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c613ea-42a1-440a-8c13-ccaf326a7e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:17:15.745693 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-79c613ea-42a1-440a-8c13-ccaf326a7e45 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:17:15.746911 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-79c613ea-42a1-440a-8c13-ccaf326a7e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:17:15.754420 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:17:15.854286 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 692/1378] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:17:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:17:16.172538 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac529333-e11c-49c4-ba56-c859f6190dc8 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:17:16.174158 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-ac529333-e11c-49c4-ba56-c859f6190dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:17:16.337394 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac529333-e11c-49c4-ba56-c859f6190dc8 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:17:16.341325 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:17:16.469238 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e86219-db72-41ad-aa31-ee12d4e703dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d05c52570474820b4ba0e2cdad5c13f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:17:16.469913 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e86219-db72-41ad-aa31-ee12d4e703dc service nova] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:17:16.470513 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e86219-db72-41ad-aa31-ee12d4e703dc service nova] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:17:16.470831 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e86219-db72-41ad-aa31-ee12d4e703dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:17:16.472549 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-23e86219-db72-41ad-aa31-ee12d4e703dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:17:16.568046 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e86219-db72-41ad-aa31-ee12d4e703dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:17:16.569646 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e86219-db72-41ad-aa31-ee12d4e703dc service nova] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:17:16.588953 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 687/1379] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:17:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:17:18.810597 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb6fd7-7ef3-44e0-a2e7-d76cfdc88377 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:17:18.811078 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb6fd7-7ef3-44e0-a2e7-d76cfdc88377 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:17:18.811364 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb6fd7-7ef3-44e0-a2e7-d76cfdc88377 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:17:18.812842 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 693/1380] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:17:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:17:18.818474 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c814776d-44b2-4850-8bf1-8fb650f0ee5e None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:17:18.818980 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c814776d-44b2-4850-8bf1-8fb650f0ee5e None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:17:18.819162 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c814776d-44b2-4850-8bf1-8fb650f0ee5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:17:18.831259 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:17:18.902655 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-c814776d-44b2-4850-8bf1-8fb650f0ee5e None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:17:18.904006 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-c814776d-44b2-4850-8bf1-8fb650f0ee5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:17:19.045955 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 688/1381] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:17:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:17:19.350032 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cb6fd7-7ef3-44e0-a2e7-d76cfdc88377 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:17:19.351609 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-d9cb6fd7-7ef3-44e0-a2e7-d76cfdc88377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:17:19.489803 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:17:19.500690 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cb6fd7-7ef3-44e0-a2e7-d76cfdc88377 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:17:19.616756 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea4a30c-032e-4ce5-bece-0bcfa87c925e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d05c52570474820b4ba0e2cdad5c13f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:17:19.617319 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea4a30c-032e-4ce5-bece-0bcfa87c925e service nova] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:17:19.617600 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea4a30c-032e-4ce5-bece-0bcfa87c925e service nova] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:17:19.617875 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea4a30c-032e-4ce5-bece-0bcfa87c925e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:17:19.619605 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-dea4a30c-032e-4ce5-bece-0bcfa87c925e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:17:19.714945 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea4a30c-032e-4ce5-bece-0bcfa87c925e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:17:19.716533 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea4a30c-032e-4ce5-bece-0bcfa87c925e service nova] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:17:19.726972 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:17:19.735204 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 694/1382] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:17:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:17:22.058355 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ae0bb-854a-4e93-a456-a22b5aa57412 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:17:22.059030 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ae0bb-854a-4e93-a456-a22b5aa57412 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:17:22.059030 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ae0bb-854a-4e93-a456-a22b5aa57412 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:17:22.060291 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 689/1383] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:17:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:17:22.066295 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df97c7-d33d-40ab-a045-9020c3c49b3a None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:17:22.066747 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df97c7-d33d-40ab-a045-9020c3c49b3a None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:17:22.066865 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df97c7-d33d-40ab-a045-9020c3c49b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:17:22.140023 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-57df97c7-d33d-40ab-a045-9020c3c49b3a None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:17:22.141251 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-57df97c7-d33d-40ab-a045-9020c3c49b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:17:22.255969 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 695/1384] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:17:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:17:22.556116 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134ae0bb-854a-4e93-a456-a22b5aa57412 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:17:22.557616 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-134ae0bb-854a-4e93-a456-a22b5aa57412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:17:22.656272 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:17:22.729186 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134ae0bb-854a-4e93-a456-a22b5aa57412 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:17:22.847459 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc41ef3-43a7-47fa-bf81-14d2a6266008 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d05c52570474820b4ba0e2cdad5c13f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:17:22.847981 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc41ef3-43a7-47fa-bf81-14d2a6266008 service nova] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:17:22.848255 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc41ef3-43a7-47fa-bf81-14d2a6266008 service nova] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:17:22.848548 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc41ef3-43a7-47fa-bf81-14d2a6266008 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:17:22.850830 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-ffc41ef3-43a7-47fa-bf81-14d2a6266008 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:17:22.902886 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:17:22.944233 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc41ef3-43a7-47fa-bf81-14d2a6266008 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:17:22.945804 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc41ef3-43a7-47fa-bf81-14d2a6266008 service nova] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:17:22.963794 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 690/1385] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:17:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:17:25.496264 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e6e8ff-b2ac-40e7-82d9-df35c69ad575 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:17:25.496801 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e6e8ff-b2ac-40e7-82d9-df35c69ad575 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:17:25.496801 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e6e8ff-b2ac-40e7-82d9-df35c69ad575 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:17:25.498161 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 696/1386] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:17:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:17:25.503985 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee051eaf-cb50-48e2-a5d1-8c594ded0fca None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:17:25.504460 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee051eaf-cb50-48e2-a5d1-8c594ded0fca None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:17:25.504566 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee051eaf-cb50-48e2-a5d1-8c594ded0fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:17:25.572696 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-ee051eaf-cb50-48e2-a5d1-8c594ded0fca None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:17:25.573914 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-ee051eaf-cb50-48e2-a5d1-8c594ded0fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:17:25.673340 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 691/1387] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:17:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:17:25.972211 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e6e8ff-b2ac-40e7-82d9-df35c69ad575 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:17:25.974505 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-46e6e8ff-b2ac-40e7-82d9-df35c69ad575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:17:26.059745 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:17:26.131155 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e6e8ff-b2ac-40e7-82d9-df35c69ad575 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:17:26.257181 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec057cdf-3fd2-4e28-8035-38bda653746f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d05c52570474820b4ba0e2cdad5c13f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:17:26.258135 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec057cdf-3fd2-4e28-8035-38bda653746f service nova] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:17:26.258492 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec057cdf-3fd2-4e28-8035-38bda653746f service nova] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:17:26.258875 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec057cdf-3fd2-4e28-8035-38bda653746f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:17:26.261123 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-ec057cdf-3fd2-4e28-8035-38bda653746f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:17:26.311539 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:17:26.370067 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec057cdf-3fd2-4e28-8035-38bda653746f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:17:26.371696 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec057cdf-3fd2-4e28-8035-38bda653746f service nova] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:17:26.389562 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 697/1388] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:17:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:17:28.623277 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb8d0be-3024-4def-b230-d622f1e7343d None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:17:28.623789 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb8d0be-3024-4def-b230-d622f1e7343d None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:17:28.623897 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb8d0be-3024-4def-b230-d622f1e7343d None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:17:28.625325 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 692/1389] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:17:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:17:28.631305 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b3190c-e14a-4dd0-a947-9005d50aa9d5 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:17:28.631703 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b3190c-e14a-4dd0-a947-9005d50aa9d5 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:17:28.631844 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b3190c-e14a-4dd0-a947-9005d50aa9d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:17:28.637450 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319972d1-aee0-455f-ba64-ea29639e5092 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:17:28.637753 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319972d1-aee0-455f-ba64-ea29639e5092 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:17:28.638026 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319972d1-aee0-455f-ba64-ea29639e5092 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:17:28.639338 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 693/1390] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:17:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:17:28.644167 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8de93fa-0579-42f8-8da7-a2b7ad25adbc None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:17:28.644451 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8de93fa-0579-42f8-8da7-a2b7ad25adbc None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:17:28.644748 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8de93fa-0579-42f8-8da7-a2b7ad25adbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:17:28.691494 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:17:28.707241 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-c0b3190c-e14a-4dd0-a947-9005d50aa9d5 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:17:28.708470 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-c0b3190c-e14a-4dd0-a947-9005d50aa9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:17:28.725718 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-d8de93fa-0579-42f8-8da7-a2b7ad25adbc None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:17:28.726954 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-d8de93fa-0579-42f8-8da7-a2b7ad25adbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:17:28.806901 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 698/1391] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:17:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:17:28.823846 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 694/1392] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:17:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:17:29.121839 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b3190c-e14a-4dd0-a947-9005d50aa9d5 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:17:29.123089 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-c0b3190c-e14a-4dd0-a947-9005d50aa9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:17:29.127718 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861d356-135c-49ec-a6cf-000c8083f777 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:17:29.128000 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861d356-135c-49ec-a6cf-000c8083f777 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:17:29.128272 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861d356-135c-49ec-a6cf-000c8083f777 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:17:29.129607 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 695/1393] 10.222.0.16 () {54 vars in 962 bytes} [Thu Sep 15 12:17:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 12:17:29.134832 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2651440d-6f9f-4aea-ac70-5af0c16eedf1 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:17:29.135186 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2651440d-6f9f-4aea-ac70-5af0c16eedf1 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:17:29.135521 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2651440d-6f9f-4aea-ac70-5af0c16eedf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:17:29.137223 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:17:29.213684 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-2651440d-6f9f-4aea-ac70-5af0c16eedf1 None None] MFA Rules not processed for user `d057b651769b4ae99c1d4f2b0fc31fb4`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:17:29.214918 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-2651440d-6f9f-4aea-ac70-5af0c16eedf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:17:29.238244 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b3190c-e14a-4dd0-a947-9005d50aa9d5 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:17:29.264553 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:17:29.294119 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 696/1394] 10.222.0.16 () {58 vars in 1059 bytes} [Thu Sep 15 12:17:29 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:17:29.303136 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2651440d-6f9f-4aea-ac70-5af0c16eedf1 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:17:29.310445 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2651440d-6f9f-4aea-ac70-5af0c16eedf1 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:17:29.358469 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3ed5a6-f4f9-476b-9fe0-e154814b8f64 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d05c52570474820b4ba0e2cdad5c13f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:17:29.359197 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ed5a6-f4f9-476b-9fe0-e154814b8f64 service nova] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:17:29.359482 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ed5a6-f4f9-476b-9fe0-e154814b8f64 service nova] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:17:29.359754 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ed5a6-f4f9-476b-9fe0-e154814b8f64 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:17:29.361367 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-8b3ed5a6-f4f9-476b-9fe0-e154814b8f64 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:17:29.370678 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:17:29.392587 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dcee9e-a944-4fe1-b9bc-0a1bc42c6d66 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd057b651769b4ae99c1d4f2b0fc31fb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:17:29.393347 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dcee9e-a944-4fe1-b9bc-0a1bc42c6d66 service glance] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:17:29.393943 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dcee9e-a944-4fe1-b9bc-0a1bc42c6d66 service glance] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:17:29.394215 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dcee9e-a944-4fe1-b9bc-0a1bc42c6d66 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:17:29.396355 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-c8dcee9e-a944-4fe1-b9bc-0a1bc42c6d66 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:17:29.455656 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3ed5a6-f4f9-476b-9fe0-e154814b8f64 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:17:29.457289 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3ed5a6-f4f9-476b-9fe0-e154814b8f64 service nova] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:17:29.477460 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 699/1395] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:17:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:17:29.512923 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dcee9e-a944-4fe1-b9bc-0a1bc42c6d66 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:17:29.514365 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dcee9e-a944-4fe1-b9bc-0a1bc42c6d66 service glance] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:17:29.528345 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:17:29.533817 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 697/1396] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:17:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 12:17:30.283194 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21730c3f-245a-4e91-95fd-b567786cbe4d None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:17:30.283719 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21730c3f-245a-4e91-95fd-b567786cbe4d None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:17:30.283871 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21730c3f-245a-4e91-95fd-b567786cbe4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:17:30.351961 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-21730c3f-245a-4e91-95fd-b567786cbe4d None None] MFA Rules not processed for user `b4614bede59c47ea813a73fcc0840a2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:17:30.353167 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-21730c3f-245a-4e91-95fd-b567786cbe4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:17:30.438397 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:17:30.442850 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 700/1397] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Sep 15 12:17:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:17:30.483521 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1e9f66-7c36-4d8d-a013-6b4a1233c784 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:17:30.484017 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1e9f66-7c36-4d8d-a013-6b4a1233c784 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:17:30.484221 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1e9f66-7c36-4d8d-a013-6b4a1233c784 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:17:30.485707 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 698/1398] 10.222.0.16 () {54 vars in 943 bytes} [Thu Sep 15 12:17:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:17:30.492034 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c7bfc-3200-4cb9-8610-4e370592aaca None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:17:30.492316 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c7bfc-3200-4cb9-8610-4e370592aaca None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:17:30.492586 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c7bfc-3200-4cb9-8610-4e370592aaca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:17:30.567779 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-487c7bfc-3200-4cb9-8610-4e370592aaca None None] MFA Rules not processed for user `ee33b730d0ec428ca2cd3af4ebf723e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:17:30.568972 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-487c7bfc-3200-4cb9-8610-4e370592aaca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:17:30.675007 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 701/1399] 10.222.0.16 () {58 vars in 1040 bytes} [Thu Sep 15 12:17:30 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:17:30.684936 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1e9f66-7c36-4d8d-a013-6b4a1233c784 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:17:30.686542 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-1b1e9f66-7c36-4d8d-a013-6b4a1233c784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:17:30.822801 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1e9f66-7c36-4d8d-a013-6b4a1233c784 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:17:30.905456 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:17:30.924978 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f683411-6fe6-4812-85f7-b9b0cc134020 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee33b730d0ec428ca2cd3af4ebf723e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:17:30.925613 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f683411-6fe6-4812-85f7-b9b0cc134020 service swift] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:17:30.925888 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f683411-6fe6-4812-85f7-b9b0cc134020 service swift] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:17:30.926158 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f683411-6fe6-4812-85f7-b9b0cc134020 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:17:30.928503 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-6f683411-6fe6-4812-85f7-b9b0cc134020 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:17:31.013549 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f683411-6fe6-4812-85f7-b9b0cc134020 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:17:31.015315 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f683411-6fe6-4812-85f7-b9b0cc134020 service swift] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:17:31.023311 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 699/1400] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Sep 15 12:17:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 12:17:31.689824 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df3bc7-a16e-4799-a53b-be4f871ebf38 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:17:31.690388 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df3bc7-a16e-4799-a53b-be4f871ebf38 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:17:31.690388 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df3bc7-a16e-4799-a53b-be4f871ebf38 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:17:31.691886 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 702/1401] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:17:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:17:31.696957 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5afb50-dd0f-461f-b794-3bda4e55f85d None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:17:31.697410 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5afb50-dd0f-461f-b794-3bda4e55f85d None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:17:31.697496 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5afb50-dd0f-461f-b794-3bda4e55f85d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:17:31.781196 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-ef5afb50-dd0f-461f-b794-3bda4e55f85d None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:17:31.782496 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-ef5afb50-dd0f-461f-b794-3bda4e55f85d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:17:31.857597 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:17:31.893330 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 700/1402] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:17:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:17:32.189168 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16df3bc7-a16e-4799-a53b-be4f871ebf38 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:17:32.191119 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-16df3bc7-a16e-4799-a53b-be4f871ebf38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:17:32.259883 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:17:32.361779 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16df3bc7-a16e-4799-a53b-be4f871ebf38 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:17:32.483831 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf27fd1c-0743-4441-bb25-fd2d4ee3bb6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d05c52570474820b4ba0e2cdad5c13f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:17:32.484437 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf27fd1c-0743-4441-bb25-fd2d4ee3bb6a service nova] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:17:32.484720 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf27fd1c-0743-4441-bb25-fd2d4ee3bb6a service nova] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:17:32.484993 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf27fd1c-0743-4441-bb25-fd2d4ee3bb6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:17:32.486590 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-bf27fd1c-0743-4441-bb25-fd2d4ee3bb6a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:17:32.505844 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:17:32.586366 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf27fd1c-0743-4441-bb25-fd2d4ee3bb6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:17:32.588688 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf27fd1c-0743-4441-bb25-fd2d4ee3bb6a service nova] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:17:32.611970 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 703/1403] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:17:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:17:34.829640 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985fca1b-e658-4ba0-8d0b-dc80261e819e None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:17:34.830653 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985fca1b-e658-4ba0-8d0b-dc80261e819e None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:17:34.830969 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985fca1b-e658-4ba0-8d0b-dc80261e819e None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:17:34.832406 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 701/1404] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:17:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:17:34.837839 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e470d55a-236f-48a4-9661-808ce4e27248 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:17:34.838342 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e470d55a-236f-48a4-9661-808ce4e27248 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:17:34.838437 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e470d55a-236f-48a4-9661-808ce4e27248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:17:34.907577 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-e470d55a-236f-48a4-9661-808ce4e27248 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:17:34.908712 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-e470d55a-236f-48a4-9661-808ce4e27248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:17:35.025020 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:17:35.031589 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 704/1405] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:17:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:17:35.321952 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985fca1b-e658-4ba0-8d0b-dc80261e819e None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:17:35.323972 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-985fca1b-e658-4ba0-8d0b-dc80261e819e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:17:35.480709 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985fca1b-e658-4ba0-8d0b-dc80261e819e None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:17:35.540181 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:17:35.725785 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6bb240-2647-4886-a6a6-781202918d10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d05c52570474820b4ba0e2cdad5c13f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:17:35.726522 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6bb240-2647-4886-a6a6-781202918d10 service nova] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:17:35.726886 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6bb240-2647-4886-a6a6-781202918d10 service nova] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:17:35.727162 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6bb240-2647-4886-a6a6-781202918d10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:17:35.728798 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-fb6bb240-2647-4886-a6a6-781202918d10 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:17:35.829461 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6bb240-2647-4886-a6a6-781202918d10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:17:35.831153 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6bb240-2647-4886-a6a6-781202918d10 service nova] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:17:35.852349 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 702/1406] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:17:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:17:38.064392 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773268ae-c587-429e-a1e9-305ed93b5183 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:17:38.064934 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773268ae-c587-429e-a1e9-305ed93b5183 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:17:38.064934 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773268ae-c587-429e-a1e9-305ed93b5183 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:17:38.066262 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 705/1407] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:17:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:17:38.071974 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4824607b-63d7-4e9e-9a4e-3b1353aa2fa9 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:17:38.072416 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4824607b-63d7-4e9e-9a4e-3b1353aa2fa9 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:17:38.072522 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4824607b-63d7-4e9e-9a4e-3b1353aa2fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:17:38.144546 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-4824607b-63d7-4e9e-9a4e-3b1353aa2fa9 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:17:38.145779 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-4824607b-63d7-4e9e-9a4e-3b1353aa2fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:17:38.161451 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:17:38.261787 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 703/1408] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:17:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:17:38.589355 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773268ae-c587-429e-a1e9-305ed93b5183 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:17:38.589355 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-773268ae-c587-429e-a1e9-305ed93b5183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:17:38.765209 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773268ae-c587-429e-a1e9-305ed93b5183 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:17:38.837495 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:17:38.891873 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efecb9c-859b-4849-9017-23082b7266b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d05c52570474820b4ba0e2cdad5c13f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:17:38.892584 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efecb9c-859b-4849-9017-23082b7266b5 service nova] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:17:38.892879 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efecb9c-859b-4849-9017-23082b7266b5 service nova] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:17:38.893174 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efecb9c-859b-4849-9017-23082b7266b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:17:38.894799 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-0efecb9c-859b-4849-9017-23082b7266b5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:17:38.992246 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efecb9c-859b-4849-9017-23082b7266b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:17:38.995428 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efecb9c-859b-4849-9017-23082b7266b5 service nova] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:17:39.013779 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 706/1409] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:17:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:17:48.259997 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=38 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:17:49.011460 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=64 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:17:53.543089 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a755f05f-22cf-42fc-aa8b-838f017ee033 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:17:53.543700 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a755f05f-22cf-42fc-aa8b-838f017ee033 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:17:53.543700 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a755f05f-22cf-42fc-aa8b-838f017ee033 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:17:53.544962 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 704/1410] 10.222.0.16 () {54 vars in 918 bytes} [Thu Sep 15 12:17:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:17:53.549848 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3309151f-0cb6-4a86-b572-5655ad7bfb67 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:17:53.550256 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3309151f-0cb6-4a86-b572-5655ad7bfb67 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:17:53.550365 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3309151f-0cb6-4a86-b572-5655ad7bfb67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:17:53.625060 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-3309151f-0cb6-4a86-b572-5655ad7bfb67 None None] MFA Rules not processed for user `b7ff8a5ddf1e422ca97f92bd9d4e5fb8`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:17:53.626258 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-3309151f-0cb6-4a86-b572-5655ad7bfb67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:17:53.731831 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 707/1411] 10.222.0.16 () {58 vars in 1015 bytes} [Thu Sep 15 12:17:53 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:17:53.746115 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb96e95-616e-4558-91e1-16ce6353a627 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:17:53.746403 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb96e95-616e-4558-91e1-16ce6353a627 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:17:53.746677 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb96e95-616e-4558-91e1-16ce6353a627 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:17:53.748089 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 705/1412] 10.222.0.16 () {54 vars in 918 bytes} [Thu Sep 15 12:17:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:17:53.752862 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24884486-c517-4ed5-8cb0-2b53ba6e413d None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:17:53.753142 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24884486-c517-4ed5-8cb0-2b53ba6e413d None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:17:53.753411 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24884486-c517-4ed5-8cb0-2b53ba6e413d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:17:53.825809 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:17:53.829069 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-24884486-c517-4ed5-8cb0-2b53ba6e413d None None] MFA Rules not processed for user `9d05c52570474820b4ba0e2cdad5c13f`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:17:53.830772 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-24884486-c517-4ed5-8cb0-2b53ba6e413d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:17:53.946923 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 708/1413] 10.222.0.16 () {58 vars in 1015 bytes} [Thu Sep 15 12:17:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:17:56.549492 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f56e27-158c-4f02-8b44-19a099d4b0c4 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:17:56.550057 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f56e27-158c-4f02-8b44-19a099d4b0c4 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:17:56.550057 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f56e27-158c-4f02-8b44-19a099d4b0c4 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:17:56.552030 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 706/1414] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 12:17:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:17:56.557319 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f043c-312c-4b9c-901a-67b4f6fb27ae None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:17:56.557739 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f043c-312c-4b9c-901a-67b4f6fb27ae None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:17:56.557858 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f043c-312c-4b9c-901a-67b4f6fb27ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:17:56.623037 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-257f043c-312c-4b9c-901a-67b4f6fb27ae None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:17:56.624262 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-257f043c-312c-4b9c-901a-67b4f6fb27ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:17:56.680574 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:17:56.723648 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 709/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 12:17:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:17:57.011117 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f56e27-158c-4f02-8b44-19a099d4b0c4 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:17:57.012803 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-21f56e27-158c-4f02-8b44-19a099d4b0c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:17:57.156706 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f56e27-158c-4f02-8b44-19a099d4b0c4 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:17:57.227784 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:17:57.267048 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794db287-ae8d-4005-8746-90ca3310f84e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d05c52570474820b4ba0e2cdad5c13f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:17:57.267641 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794db287-ae8d-4005-8746-90ca3310f84e service nova] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:17:57.267911 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794db287-ae8d-4005-8746-90ca3310f84e service nova] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:17:57.268175 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794db287-ae8d-4005-8746-90ca3310f84e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:17:57.270333 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-794db287-ae8d-4005-8746-90ca3310f84e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:17:57.355881 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794db287-ae8d-4005-8746-90ca3310f84e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:17:57.357454 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794db287-ae8d-4005-8746-90ca3310f84e service nova] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:17:57.374708 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 707/1416] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:17:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:17:58.513139 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0252851-507c-444c-af96-beb6e7be4172 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:17:58.513720 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0252851-507c-444c-af96-beb6e7be4172 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:17:58.513720 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0252851-507c-444c-af96-beb6e7be4172 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:17:58.515056 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 710/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 15 12:17:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:17:58.521907 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a502a-516f-4329-82a4-fd9d0b1b4d8d None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:17:58.522376 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a502a-516f-4329-82a4-fd9d0b1b4d8d None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:17:58.522493 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a502a-516f-4329-82a4-fd9d0b1b4d8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:17:58.596445 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-267a502a-516f-4329-82a4-fd9d0b1b4d8d None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:17:58.598230 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-267a502a-516f-4329-82a4-fd9d0b1b4d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:17:58.625799 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:17:58.694946 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 708/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 15 12:17:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:17:58.846033 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0252851-507c-444c-af96-beb6e7be4172 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:17:58.848142 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-c0252851-507c-444c-af96-beb6e7be4172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:17:59.003510 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0252851-507c-444c-af96-beb6e7be4172 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:17:59.044309 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:17:59.121951 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e70e6e8-20cd-4845-bcfc-7be21ce96b2f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d05c52570474820b4ba0e2cdad5c13f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:17:59.122561 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e70e6e8-20cd-4845-bcfc-7be21ce96b2f service nova] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:17:59.122872 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e70e6e8-20cd-4845-bcfc-7be21ce96b2f service nova] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:17:59.123143 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e70e6e8-20cd-4845-bcfc-7be21ce96b2f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:17:59.124721 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-4e70e6e8-20cd-4845-bcfc-7be21ce96b2f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:17:59.215873 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e70e6e8-20cd-4845-bcfc-7be21ce96b2f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:17:59.217638 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e70e6e8-20cd-4845-bcfc-7be21ce96b2f service nova] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:17:59.235999 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 711/1419] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:17:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:18:00.401754 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc36e86-f645-4820-b802-6b0c2bd2a6b1 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:18:00.402332 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc36e86-f645-4820-b802-6b0c2bd2a6b1 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:18:00.402332 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc36e86-f645-4820-b802-6b0c2bd2a6b1 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:18:00.403675 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 709/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 15 12:18:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:18:00.410055 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7f2d3-d6d9-4e89-abac-840d3cfdab71 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:18:00.410465 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7f2d3-d6d9-4e89-abac-840d3cfdab71 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:18:00.410606 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7f2d3-d6d9-4e89-abac-840d3cfdab71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:18:00.464199 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:18:00.486318 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-7ab7f2d3-d6d9-4e89-abac-840d3cfdab71 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:18:00.487561 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-7ab7f2d3-d6d9-4e89-abac-840d3cfdab71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:18:00.581860 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 712/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 15 12:18:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:18:00.736839 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc36e86-f645-4820-b802-6b0c2bd2a6b1 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:18:00.738350 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-2cc36e86-f645-4820-b802-6b0c2bd2a6b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:18:00.880574 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc36e86-f645-4820-b802-6b0c2bd2a6b1 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:18:00.892305 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:18:00.991330 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ecd67e-421f-4f7c-9ad6-de3baef17132 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d05c52570474820b4ba0e2cdad5c13f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:18:00.991857 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ecd67e-421f-4f7c-9ad6-de3baef17132 service nova] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:18:00.992128 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ecd67e-421f-4f7c-9ad6-de3baef17132 service nova] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:18:00.992390 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ecd67e-421f-4f7c-9ad6-de3baef17132 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:18:00.993960 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-95ecd67e-421f-4f7c-9ad6-de3baef17132 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:18:01.080939 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ecd67e-421f-4f7c-9ad6-de3baef17132 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:18:01.083129 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ecd67e-421f-4f7c-9ad6-de3baef17132 service nova] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:18:01.100346 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 710/1422] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:18:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:18:02.202973 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba31e3d2-5063-4a75-88a7-da17ec464e00 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:18:02.203433 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba31e3d2-5063-4a75-88a7-da17ec464e00 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:18:02.203537 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba31e3d2-5063-4a75-88a7-da17ec464e00 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:18:02.204840 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 713/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 15 12:18:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:18:02.211843 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953e67a8-1fc0-4c73-9b6d-6bc615528c69 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:18:02.212297 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953e67a8-1fc0-4c73-9b6d-6bc615528c69 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:18:02.212443 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953e67a8-1fc0-4c73-9b6d-6bc615528c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:18:02.232579 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:18:02.288485 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-953e67a8-1fc0-4c73-9b6d-6bc615528c69 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:18:02.289683 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-953e67a8-1fc0-4c73-9b6d-6bc615528c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:18:02.383771 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 711/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 15 12:18:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:18:02.538881 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba31e3d2-5063-4a75-88a7-da17ec464e00 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:18:02.540331 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-ba31e3d2-5063-4a75-88a7-da17ec464e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:18:02.655138 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:18:02.690785 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba31e3d2-5063-4a75-88a7-da17ec464e00 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:18:02.807248 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c2887a-430e-4fb0-b720-c08912afa2fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d05c52570474820b4ba0e2cdad5c13f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:18:02.807760 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c2887a-430e-4fb0-b720-c08912afa2fc service nova] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:18:02.808038 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c2887a-430e-4fb0-b720-c08912afa2fc service nova] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:18:02.808308 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c2887a-430e-4fb0-b720-c08912afa2fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:18:02.810026 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-65c2887a-430e-4fb0-b720-c08912afa2fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:18:02.887015 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:18:02.900234 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c2887a-430e-4fb0-b720-c08912afa2fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:18:02.901808 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c2887a-430e-4fb0-b720-c08912afa2fc service nova] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:18:02.919155 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 714/1425] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:18:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:18:04.025825 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f6508-1d95-486f-89e8-716554358709 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:18:04.026347 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f6508-1d95-486f-89e8-716554358709 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:18:04.026347 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f6508-1d95-486f-89e8-716554358709 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:18:04.027743 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 712/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 15 12:18:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:18:04.034069 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede2ec1c-d214-44bc-aa44-6bdaeda215be None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:18:04.034493 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede2ec1c-d214-44bc-aa44-6bdaeda215be None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:18:04.034618 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede2ec1c-d214-44bc-aa44-6bdaeda215be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:18:04.108971 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-ede2ec1c-d214-44bc-aa44-6bdaeda215be None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:18:04.110185 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-ede2ec1c-d214-44bc-aa44-6bdaeda215be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:18:04.208575 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 715/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 15 12:18:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:18:04.357741 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48f6508-1d95-486f-89e8-716554358709 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:18:04.359304 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-d48f6508-1d95-486f-89e8-716554358709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:18:04.443531 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:18:04.504960 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48f6508-1d95-486f-89e8-716554358709 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:18:04.616425 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c791ca-ee0c-4761-99d8-0130dac73f94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d05c52570474820b4ba0e2cdad5c13f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:18:04.617028 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c791ca-ee0c-4761-99d8-0130dac73f94 service nova] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:18:04.617304 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c791ca-ee0c-4761-99d8-0130dac73f94 service nova] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:18:04.617569 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c791ca-ee0c-4761-99d8-0130dac73f94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:18:04.619185 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-d5c791ca-ee0c-4761-99d8-0130dac73f94 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:18:04.667188 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:18:04.710853 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c791ca-ee0c-4761-99d8-0130dac73f94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:18:04.712448 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c791ca-ee0c-4761-99d8-0130dac73f94 service nova] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:18:04.730369 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 713/1428] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:18:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:18:05.792609 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81367d1-0028-4599-b023-97c110f74538 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:18:05.793173 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81367d1-0028-4599-b023-97c110f74538 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:18:05.793173 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81367d1-0028-4599-b023-97c110f74538 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:18:05.794483 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 716/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 15 12:18:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:18:05.801293 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094c4c6-35fb-469f-acf1-7f5f40031407 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:18:05.801757 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094c4c6-35fb-469f-acf1-7f5f40031407 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:18:05.801863 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094c4c6-35fb-469f-acf1-7f5f40031407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:18:05.875084 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-3094c4c6-35fb-469f-acf1-7f5f40031407 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:18:05.876269 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-3094c4c6-35fb-469f-acf1-7f5f40031407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:18:05.973816 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 714/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 15 12:18:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:18:06.121298 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81367d1-0028-4599-b023-97c110f74538 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:18:06.122765 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-a81367d1-0028-4599-b023-97c110f74538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:18:06.171915 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:18:06.268309 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81367d1-0028-4599-b023-97c110f74538 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:18:06.381577 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01aa58c-b483-4e39-8e99-9c2e566da2ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d05c52570474820b4ba0e2cdad5c13f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:18:06.382095 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01aa58c-b483-4e39-8e99-9c2e566da2ea service nova] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:18:06.382369 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01aa58c-b483-4e39-8e99-9c2e566da2ea service nova] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:18:06.382635 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01aa58c-b483-4e39-8e99-9c2e566da2ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:18:06.384335 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-e01aa58c-b483-4e39-8e99-9c2e566da2ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:18:06.391452 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:18:06.472735 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01aa58c-b483-4e39-8e99-9c2e566da2ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:18:06.474340 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01aa58c-b483-4e39-8e99-9c2e566da2ea service nova] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:18:06.492227 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 717/1431] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:18:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:18:07.542299 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd5730a-4f95-4fa4-9e36-d2179b66dad1 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:18:07.542870 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd5730a-4f95-4fa4-9e36-d2179b66dad1 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:18:07.542870 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd5730a-4f95-4fa4-9e36-d2179b66dad1 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:18:07.544217 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 715/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 15 12:18:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:18:07.550343 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db598a-8fdc-4531-874e-bd02167816a3 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:18:07.550837 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db598a-8fdc-4531-874e-bd02167816a3 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:18:07.550954 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db598a-8fdc-4531-874e-bd02167816a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:18:07.625844 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-f1db598a-8fdc-4531-874e-bd02167816a3 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:18:07.627324 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-f1db598a-8fdc-4531-874e-bd02167816a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:18:07.693830 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:18:07.723129 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 718/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 15 12:18:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:18:07.870872 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd5730a-4f95-4fa4-9e36-d2179b66dad1 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:18:07.872352 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-dbd5730a-4f95-4fa4-9e36-d2179b66dad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:18:07.891222 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:18:08.017671 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd5730a-4f95-4fa4-9e36-d2179b66dad1 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:18:08.103337 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:18:08.129440 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e2be93-5602-4854-8864-9ec3738f0eb4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d05c52570474820b4ba0e2cdad5c13f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:18:08.129977 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e2be93-5602-4854-8864-9ec3738f0eb4 service nova] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:18:08.130255 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e2be93-5602-4854-8864-9ec3738f0eb4 service nova] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:18:08.130518 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e2be93-5602-4854-8864-9ec3738f0eb4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:18:08.132100 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-07e2be93-5602-4854-8864-9ec3738f0eb4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:18:08.229395 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e2be93-5602-4854-8864-9ec3738f0eb4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:18:08.231005 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e2be93-5602-4854-8864-9ec3738f0eb4 service nova] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:18:08.248903 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 716/1434] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:18:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:18:09.301979 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bda9bd-840b-4fa2-826d-1c6baf29540b None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:18:09.302545 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bda9bd-840b-4fa2-826d-1c6baf29540b None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:18:09.302545 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bda9bd-840b-4fa2-826d-1c6baf29540b None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:18:09.303818 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 719/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 15 12:18:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 12:18:09.309999 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc7de67-68b1-40eb-bfb2-e8458c71f9b8 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:18:09.310441 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc7de67-68b1-40eb-bfb2-e8458c71f9b8 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:18:09.310559 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc7de67-68b1-40eb-bfb2-e8458c71f9b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:18:09.384979 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-3bc7de67-68b1-40eb-bfb2-e8458c71f9b8 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:18:09.386174 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-3bc7de67-68b1-40eb-bfb2-e8458c71f9b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:18:09.427667 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:18:09.488983 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 717/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 15 12:18:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:18:09.638602 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bda9bd-840b-4fa2-826d-1c6baf29540b None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:18:09.640056 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-02bda9bd-840b-4fa2-826d-1c6baf29540b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:18:09.784209 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bda9bd-840b-4fa2-826d-1c6baf29540b None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:18:09.840456 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:18:09.898891 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797c97c5-1938-41b2-b850-ef1d012a2ac2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d05c52570474820b4ba0e2cdad5c13f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:18:09.899426 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c97c5-1938-41b2-b850-ef1d012a2ac2 service nova] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:18:09.899703 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c97c5-1938-41b2-b850-ef1d012a2ac2 service nova] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:18:09.899975 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c97c5-1938-41b2-b850-ef1d012a2ac2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:18:09.901574 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-797c97c5-1938-41b2-b850-ef1d012a2ac2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:18:09.992773 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797c97c5-1938-41b2-b850-ef1d012a2ac2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:18:09.994377 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797c97c5-1938-41b2-b850-ef1d012a2ac2 service nova] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:18:10.012672 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 720/1437] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:18:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:18:11.053461 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be5bc0-000b-4e87-8cb0-00afec19ec9c None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:18:11.054029 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be5bc0-000b-4e87-8cb0-00afec19ec9c None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:18:11.054029 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be5bc0-000b-4e87-8cb0-00afec19ec9c None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:18:11.055414 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 718/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 15 12:18:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:18:11.061450 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9012c51a-591e-4c5c-9418-d12e048b1cae None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:18:11.061911 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9012c51a-591e-4c5c-9418-d12e048b1cae None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:18:11.062015 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9012c51a-591e-4c5c-9418-d12e048b1cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:18:11.141280 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-9012c51a-591e-4c5c-9418-d12e048b1cae None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:18:11.142482 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-9012c51a-591e-4c5c-9418-d12e048b1cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:18:11.144975 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:18:11.240125 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 721/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 15 12:18:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:18:11.387846 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17be5bc0-000b-4e87-8cb0-00afec19ec9c None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:18:11.389418 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-17be5bc0-000b-4e87-8cb0-00afec19ec9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:18:11.536576 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17be5bc0-000b-4e87-8cb0-00afec19ec9c None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:18:11.563136 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:18:11.648025 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbe3e71-0ad8-4ee8-935e-5063bc517f7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d05c52570474820b4ba0e2cdad5c13f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:18:11.648624 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe3e71-0ad8-4ee8-935e-5063bc517f7f service nova] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:18:11.648894 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe3e71-0ad8-4ee8-935e-5063bc517f7f service nova] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:18:11.649156 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe3e71-0ad8-4ee8-935e-5063bc517f7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:18:11.650751 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-adbe3e71-0ad8-4ee8-935e-5063bc517f7f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:18:11.738743 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbe3e71-0ad8-4ee8-935e-5063bc517f7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:18:11.740605 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbe3e71-0ad8-4ee8-935e-5063bc517f7f service nova] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:18:11.758147 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 719/1440] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:18:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:18:13.822124 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ffb5a-6481-4967-bc9f-df1b4d8a98c6 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:18:13.822722 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ffb5a-6481-4967-bc9f-df1b4d8a98c6 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:18:13.822722 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ffb5a-6481-4967-bc9f-df1b4d8a98c6 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:18:13.824063 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 722/1441] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 12:18:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:18:13.829429 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d1c4dd-5e68-4ab3-a9a8-e184868d596b None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:18:13.829830 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d1c4dd-5e68-4ab3-a9a8-e184868d596b None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:18:13.829974 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d1c4dd-5e68-4ab3-a9a8-e184868d596b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:18:13.871703 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:18:13.897075 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-f7d1c4dd-5e68-4ab3-a9a8-e184868d596b None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:18:13.898265 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-f7d1c4dd-5e68-4ab3-a9a8-e184868d596b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:18:13.999266 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 720/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 12:18:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:18:14.283518 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938ffb5a-6481-4967-bc9f-df1b4d8a98c6 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:18:14.285703 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-938ffb5a-6481-4967-bc9f-df1b4d8a98c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:18:14.386342 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938ffb5a-6481-4967-bc9f-df1b4d8a98c6 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:18:14.418487 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:18:14.464234 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406d089a-fd81-432c-8ae6-5ba864226ba2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:18:14.464845 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d089a-fd81-432c-8ae6-5ba864226ba2 service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:18:14.465125 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d089a-fd81-432c-8ae6-5ba864226ba2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:18:14.465616 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d089a-fd81-432c-8ae6-5ba864226ba2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:18:14.468829 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-406d089a-fd81-432c-8ae6-5ba864226ba2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:18:14.577354 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406d089a-fd81-432c-8ae6-5ba864226ba2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:18:14.578712 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406d089a-fd81-432c-8ae6-5ba864226ba2 service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:18:14.597491 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 723/1443] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:18:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:18:16.987115 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb8dd85-3785-43ce-a5e2-5915f4be4b68 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:18:16.987600 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb8dd85-3785-43ce-a5e2-5915f4be4b68 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:18:16.987692 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb8dd85-3785-43ce-a5e2-5915f4be4b68 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:18:16.988976 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 721/1444] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 12:18:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:18:16.994255 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04825ae9-67e7-4654-8850-434ccd01ba88 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:18:16.994678 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04825ae9-67e7-4654-8850-434ccd01ba88 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:18:16.994835 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04825ae9-67e7-4654-8850-434ccd01ba88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:18:17.059429 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-04825ae9-67e7-4654-8850-434ccd01ba88 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:18:17.060617 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-04825ae9-67e7-4654-8850-434ccd01ba88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:18:17.073469 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:18:17.156360 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 724/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 12:18:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:18:17.438276 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb8dd85-3785-43ce-a5e2-5915f4be4b68 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:18:17.439853 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-6bb8dd85-3785-43ce-a5e2-5915f4be4b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:18:17.540325 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb8dd85-3785-43ce-a5e2-5915f4be4b68 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:18:17.552723 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:18:17.613581 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64739fa1-08ec-49a5-91d0-5525619938c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:18:17.614179 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64739fa1-08ec-49a5-91d0-5525619938c1 service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:18:17.614453 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64739fa1-08ec-49a5-91d0-5525619938c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:18:17.614759 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64739fa1-08ec-49a5-91d0-5525619938c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:18:17.616404 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-64739fa1-08ec-49a5-91d0-5525619938c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:18:17.723282 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64739fa1-08ec-49a5-91d0-5525619938c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:18:17.724641 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64739fa1-08ec-49a5-91d0-5525619938c1 service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:18:17.742224 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 722/1446] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:18:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:18:20.197307 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e422ee2-f151-4d67-91f1-e3e9b1a2910e None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:18:20.197865 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e422ee2-f151-4d67-91f1-e3e9b1a2910e None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:18:20.197976 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e422ee2-f151-4d67-91f1-e3e9b1a2910e None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:18:20.199406 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 725/1447] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 12:18:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:18:20.204498 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf05b6-4044-484e-a5c9-975b35572b55 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:18:20.204930 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf05b6-4044-484e-a5c9-975b35572b55 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:18:20.205029 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf05b6-4044-484e-a5c9-975b35572b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:18:20.254778 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:18:20.273223 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-babf05b6-4044-484e-a5c9-975b35572b55 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:18:20.274437 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-babf05b6-4044-484e-a5c9-975b35572b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:18:20.369974 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 723/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 12:18:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:18:20.662531 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e422ee2-f151-4d67-91f1-e3e9b1a2910e None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:18:20.664425 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-2e422ee2-f151-4d67-91f1-e3e9b1a2910e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:18:20.766828 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e422ee2-f151-4d67-91f1-e3e9b1a2910e None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:18:20.808837 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:18:20.843942 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5b72d2-8777-400f-9348-db3b0a3af6a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:18:20.844538 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b72d2-8777-400f-9348-db3b0a3af6a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:18:20.844811 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b72d2-8777-400f-9348-db3b0a3af6a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:18:20.845078 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b72d2-8777-400f-9348-db3b0a3af6a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:18:20.847202 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-eb5b72d2-8777-400f-9348-db3b0a3af6a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:18:21.073005 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5b72d2-8777-400f-9348-db3b0a3af6a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:18:21.074422 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5b72d2-8777-400f-9348-db3b0a3af6a8 service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:18:21.092401 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 726/1449] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:18:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:18:23.369327 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d81b0-f0f4-4029-86b8-ad43b660d70a None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:18:23.369835 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d81b0-f0f4-4029-86b8-ad43b660d70a None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:18:23.369835 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d81b0-f0f4-4029-86b8-ad43b660d70a None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:18:23.371172 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 724/1450] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 12:18:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:18:23.376719 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8148041-411f-422a-81b5-43cd84c02702 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:18:23.377392 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8148041-411f-422a-81b5-43cd84c02702 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:18:23.377520 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8148041-411f-422a-81b5-43cd84c02702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:18:23.442800 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-d8148041-411f-422a-81b5-43cd84c02702 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:18:23.444018 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-d8148041-411f-422a-81b5-43cd84c02702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:18:23.464280 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:18:23.540458 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 727/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 12:18:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:18:23.828472 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5d81b0-f0f4-4029-86b8-ad43b660d70a None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:18:23.829992 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-7e5d81b0-f0f4-4029-86b8-ad43b660d70a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:18:23.933382 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5d81b0-f0f4-4029-86b8-ad43b660d70a None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:18:23.953699 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:18:24.009153 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0daa9a-a76c-4148-b415-122c5af7557b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:18:24.009764 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0daa9a-a76c-4148-b415-122c5af7557b service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:18:24.010039 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0daa9a-a76c-4148-b415-122c5af7557b service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:18:24.010305 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0daa9a-a76c-4148-b415-122c5af7557b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:18:24.011951 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-5b0daa9a-a76c-4148-b415-122c5af7557b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:18:24.119546 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0daa9a-a76c-4148-b415-122c5af7557b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:18:24.120947 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0daa9a-a76c-4148-b415-122c5af7557b service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:18:24.138960 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 725/1452] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:18:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:18:26.440490 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e95ee-2112-4c1a-ab97-c4c717270498 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:18:26.441014 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e95ee-2112-4c1a-ab97-c4c717270498 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:18:26.441014 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e95ee-2112-4c1a-ab97-c4c717270498 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:18:26.442400 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 728/1453] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 12:18:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:18:26.448098 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1961261-168a-401b-9877-301230b2d649 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:18:26.448504 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1961261-168a-401b-9877-301230b2d649 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:18:26.448629 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1961261-168a-401b-9877-301230b2d649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:18:26.511783 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:18:26.514810 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-e1961261-168a-401b-9877-301230b2d649 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:18:26.516575 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-e1961261-168a-401b-9877-301230b2d649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:18:26.619806 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 726/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 12:18:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:18:26.906816 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e95ee-2112-4c1a-ab97-c4c717270498 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:18:26.908360 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-ac8e95ee-2112-4c1a-ab97-c4c717270498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:18:27.011098 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e95ee-2112-4c1a-ab97-c4c717270498 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:18:27.059215 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:18:27.082837 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6b48ad-03f5-45aa-9c6d-754cc134c033 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:18:27.083427 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b48ad-03f5-45aa-9c6d-754cc134c033 service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:18:27.083699 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b48ad-03f5-45aa-9c6d-754cc134c033 service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:18:27.083961 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b48ad-03f5-45aa-9c6d-754cc134c033 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:18:27.085538 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-7d6b48ad-03f5-45aa-9c6d-754cc134c033 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:18:27.191877 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6b48ad-03f5-45aa-9c6d-754cc134c033 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:18:27.193312 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6b48ad-03f5-45aa-9c6d-754cc134c033 service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:18:27.212950 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 729/1455] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:18:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:18:29.371813 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e84cd7-436e-4bd1-806c-9c01cb8a6b7a None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:18:29.372337 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e84cd7-436e-4bd1-806c-9c01cb8a6b7a None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:18:29.372337 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e84cd7-436e-4bd1-806c-9c01cb8a6b7a None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:18:29.373667 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 727/1456] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 12:18:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:18:29.379356 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afdece5-1e6e-4ed1-a14f-c952da30585b None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:18:29.379763 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afdece5-1e6e-4ed1-a14f-c952da30585b None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:18:29.379895 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afdece5-1e6e-4ed1-a14f-c952da30585b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:18:29.443643 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-9afdece5-1e6e-4ed1-a14f-c952da30585b None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:18:29.444823 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-9afdece5-1e6e-4ed1-a14f-c952da30585b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:18:29.473613 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:18:29.543014 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 730/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 12:18:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:18:29.826347 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e84cd7-436e-4bd1-806c-9c01cb8a6b7a None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:18:29.827931 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-37e84cd7-436e-4bd1-806c-9c01cb8a6b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:18:29.945844 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e84cd7-436e-4bd1-806c-9c01cb8a6b7a None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:18:29.976669 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:18:30.024742 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15369f0-b42c-4694-8ae4-a397ccbe4213 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:18:30.025610 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15369f0-b42c-4694-8ae4-a397ccbe4213 service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:18:30.025889 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15369f0-b42c-4694-8ae4-a397ccbe4213 service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:18:30.026161 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15369f0-b42c-4694-8ae4-a397ccbe4213 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:18:30.028549 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-a15369f0-b42c-4694-8ae4-a397ccbe4213 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:18:30.135255 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15369f0-b42c-4694-8ae4-a397ccbe4213 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:18:30.136598 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15369f0-b42c-4694-8ae4-a397ccbe4213 service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:18:30.154498 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 728/1458] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:18:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:18:32.378605 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87726986-9fb6-4dd7-98d3-9ca22e9c2618 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:18:32.379182 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87726986-9fb6-4dd7-98d3-9ca22e9c2618 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:18:32.379182 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87726986-9fb6-4dd7-98d3-9ca22e9c2618 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:18:32.380496 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 731/1459] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 12:18:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:18:32.385589 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e92618f-50b2-4fa4-a435-5acc8d116a83 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:18:32.385989 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e92618f-50b2-4fa4-a435-5acc8d116a83 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:18:32.386132 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e92618f-50b2-4fa4-a435-5acc8d116a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:18:32.450735 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-3e92618f-50b2-4fa4-a435-5acc8d116a83 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:18:32.451939 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-3e92618f-50b2-4fa4-a435-5acc8d116a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:18:32.460638 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:18:32.546680 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 729/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 12:18:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:18:32.831559 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87726986-9fb6-4dd7-98d3-9ca22e9c2618 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:18:32.833106 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-87726986-9fb6-4dd7-98d3-9ca22e9c2618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:18:32.932935 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87726986-9fb6-4dd7-98d3-9ca22e9c2618 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:18:32.990216 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:18:33.008803 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712d6148-0f05-4e26-8ff6-07360a9f6db5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:18:33.009403 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d6148-0f05-4e26-8ff6-07360a9f6db5 service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:18:33.009678 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d6148-0f05-4e26-8ff6-07360a9f6db5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:18:33.009948 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d6148-0f05-4e26-8ff6-07360a9f6db5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:18:33.011557 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-712d6148-0f05-4e26-8ff6-07360a9f6db5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:18:33.117673 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712d6148-0f05-4e26-8ff6-07360a9f6db5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:18:33.119125 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712d6148-0f05-4e26-8ff6-07360a9f6db5 service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:18:33.137750 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 732/1461] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:18:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:18:35.357643 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529bf220-6584-4844-af6e-6a9039b76cab None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:18:35.358255 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529bf220-6584-4844-af6e-6a9039b76cab None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:18:35.358255 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529bf220-6584-4844-af6e-6a9039b76cab None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:18:35.359562 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 730/1462] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 12:18:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:18:35.365588 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01aa507-f355-4fec-bc47-45d2dc7582b3 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:18:35.366047 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01aa507-f355-4fec-bc47-45d2dc7582b3 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:18:35.366191 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01aa507-f355-4fec-bc47-45d2dc7582b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:18:35.430604 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-b01aa507-f355-4fec-bc47-45d2dc7582b3 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:18:35.431829 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-b01aa507-f355-4fec-bc47-45d2dc7582b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:18:35.469522 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:18:35.526796 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 733/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 12:18:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:18:35.810249 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529bf220-6584-4844-af6e-6a9039b76cab None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:18:35.811809 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-529bf220-6584-4844-af6e-6a9039b76cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:18:35.914198 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529bf220-6584-4844-af6e-6a9039b76cab None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:18:35.953123 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:18:35.990230 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b046bc7-1f3e-4522-82ce-b7ab70a5ba72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:18:35.990869 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b046bc7-1f3e-4522-82ce-b7ab70a5ba72 service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:18:35.991147 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b046bc7-1f3e-4522-82ce-b7ab70a5ba72 service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:18:35.991410 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b046bc7-1f3e-4522-82ce-b7ab70a5ba72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:18:35.992975 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-3b046bc7-1f3e-4522-82ce-b7ab70a5ba72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:18:36.102077 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b046bc7-1f3e-4522-82ce-b7ab70a5ba72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:18:36.103458 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b046bc7-1f3e-4522-82ce-b7ab70a5ba72 service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:18:36.120836 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 731/1464] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:18:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:18:38.284264 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b3036d-e962-4ca9-b100-42fe234f5c76 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:18:38.284804 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b3036d-e962-4ca9-b100-42fe234f5c76 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:18:38.284804 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b3036d-e962-4ca9-b100-42fe234f5c76 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:18:38.286094 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 734/1465] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 12:18:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:18:38.291398 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b076a3-8335-497a-b95a-4208fc4b39fe None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:18:38.291827 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b076a3-8335-497a-b95a-4208fc4b39fe None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:18:38.291968 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b076a3-8335-497a-b95a-4208fc4b39fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:18:38.356850 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-04b076a3-8335-497a-b95a-4208fc4b39fe None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:18:38.358054 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-04b076a3-8335-497a-b95a-4208fc4b39fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:18:38.376113 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:18:38.454753 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 732/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 12:18:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:18:38.740237 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b3036d-e962-4ca9-b100-42fe234f5c76 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:18:38.741791 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-90b3036d-e962-4ca9-b100-42fe234f5c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:18:38.842115 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b3036d-e962-4ca9-b100-42fe234f5c76 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:18:38.908198 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:18:38.916127 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8681b58a-45cb-41d4-bf1f-d0008ae96b75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:18:38.916756 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8681b58a-45cb-41d4-bf1f-d0008ae96b75 service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:18:38.917033 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8681b58a-45cb-41d4-bf1f-d0008ae96b75 service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:18:38.917309 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8681b58a-45cb-41d4-bf1f-d0008ae96b75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:18:38.918952 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-8681b58a-45cb-41d4-bf1f-d0008ae96b75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:18:39.027900 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8681b58a-45cb-41d4-bf1f-d0008ae96b75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:18:39.029324 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8681b58a-45cb-41d4-bf1f-d0008ae96b75 service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:18:39.048192 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 735/1467] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:18:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:18:41.220367 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0156b0ec-49e0-4f05-8055-870831ddacd7 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:18:41.220898 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0156b0ec-49e0-4f05-8055-870831ddacd7 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:18:41.220898 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0156b0ec-49e0-4f05-8055-870831ddacd7 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:18:41.222203 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 733/1468] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 12:18:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:18:41.227537 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c253b0-b682-4a09-8b12-fd9917743ab9 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:18:41.227964 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c253b0-b682-4a09-8b12-fd9917743ab9 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:18:41.228082 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c253b0-b682-4a09-8b12-fd9917743ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:18:41.292717 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-30c253b0-b682-4a09-8b12-fd9917743ab9 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:18:41.293899 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-30c253b0-b682-4a09-8b12-fd9917743ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:18:41.341536 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:18:41.390044 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 736/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 12:18:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:18:41.670997 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0156b0ec-49e0-4f05-8055-870831ddacd7 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:18:41.672640 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-0156b0ec-49e0-4f05-8055-870831ddacd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:18:41.775677 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0156b0ec-49e0-4f05-8055-870831ddacd7 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:18:41.822863 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:18:41.848209 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b28408-2504-420a-8189-5060febfc42d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:18:41.848800 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b28408-2504-420a-8189-5060febfc42d service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:18:41.849073 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b28408-2504-420a-8189-5060febfc42d service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:18:41.849338 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b28408-2504-420a-8189-5060febfc42d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:18:41.850929 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-d2b28408-2504-420a-8189-5060febfc42d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:18:41.959249 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b28408-2504-420a-8189-5060febfc42d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:18:41.960704 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b28408-2504-420a-8189-5060febfc42d service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:18:41.978890 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 734/1470] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:18:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:18:51.388606 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=22 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:18:51.976529 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=66 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:19:01.888997 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1de929-fd83-4df5-a73e-4138a09f53e2 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:19:01.889526 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1de929-fd83-4df5-a73e-4138a09f53e2 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:19:01.889526 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1de929-fd83-4df5-a73e-4138a09f53e2 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:19:01.890917 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 737/1471] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:19:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:19:01.896162 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460698f7-d039-48bd-93d1-99db7dd12cb7 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:19:01.896710 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460698f7-d039-48bd-93d1-99db7dd12cb7 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:19:01.896710 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460698f7-d039-48bd-93d1-99db7dd12cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:19:01.967549 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-460698f7-d039-48bd-93d1-99db7dd12cb7 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:19:01.968716 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-460698f7-d039-48bd-93d1-99db7dd12cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:19:02.066674 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 735/1472] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:19:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:19:02.369671 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb598f1-0015-4269-bb20-2c235b960be9 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:19:02.369986 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb598f1-0015-4269-bb20-2c235b960be9 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:19:02.370261 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb598f1-0015-4269-bb20-2c235b960be9 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:19:02.371643 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 738/1473] 10.222.0.16 () {54 vars in 962 bytes} [Thu Sep 15 12:19:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:19:02.377414 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e18530f-92fc-4f58-b5d2-9110d80f9f4b None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:19:02.377700 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e18530f-92fc-4f58-b5d2-9110d80f9f4b None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:19:02.377972 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e18530f-92fc-4f58-b5d2-9110d80f9f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:19:02.452961 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-5e18530f-92fc-4f58-b5d2-9110d80f9f4b None None] MFA Rules not processed for user `d057b651769b4ae99c1d4f2b0fc31fb4`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:19:02.454141 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-5e18530f-92fc-4f58-b5d2-9110d80f9f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:19:02.475970 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:19:02.532122 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 736/1474] 10.222.0.16 () {58 vars in 1059 bytes} [Thu Sep 15 12:19:02 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:19:02.539823 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb598f1-0015-4269-bb20-2c235b960be9 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:19:02.541325 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-0eb598f1-0015-4269-bb20-2c235b960be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:19:02.644375 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb598f1-0015-4269-bb20-2c235b960be9 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:19:02.718326 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ba16df-d6bb-4804-bdf9-693a02232010 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd057b651769b4ae99c1d4f2b0fc31fb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:19:02.718958 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba16df-d6bb-4804-bdf9-693a02232010 service glance] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:19:02.719238 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba16df-d6bb-4804-bdf9-693a02232010 service glance] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:19:02.719504 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba16df-d6bb-4804-bdf9-693a02232010 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:19:02.721630 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-f4ba16df-d6bb-4804-bdf9-693a02232010 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:19:02.774912 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:19:02.830143 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ba16df-d6bb-4804-bdf9-693a02232010 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:19:02.831652 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ba16df-d6bb-4804-bdf9-693a02232010 service glance] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:19:02.849990 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 739/1475] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:19:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 12:19:05.081582 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db536a7f-7b89-42fc-a1a5-b7f6a0e5dbbb None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:19:05.082137 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db536a7f-7b89-42fc-a1a5-b7f6a0e5dbbb None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:19:05.082137 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db536a7f-7b89-42fc-a1a5-b7f6a0e5dbbb None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:19:05.083511 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 737/1476] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:19:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 12:19:05.089013 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987edca6-f85d-466b-a686-18afc8214571 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:19:05.089431 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987edca6-f85d-466b-a686-18afc8214571 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:19:05.089536 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987edca6-f85d-466b-a686-18afc8214571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:19:05.154111 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-987edca6-f85d-466b-a686-18afc8214571 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:19:05.155345 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-987edca6-f85d-466b-a686-18afc8214571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:19:05.249666 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 740/1477] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:19:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:19:05.528498 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db536a7f-7b89-42fc-a1a5-b7f6a0e5dbbb None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:19:05.529968 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-db536a7f-7b89-42fc-a1a5-b7f6a0e5dbbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:19:05.655634 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db536a7f-7b89-42fc-a1a5-b7f6a0e5dbbb None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:19:05.704761 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:19:05.748128 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb95d63-9d9c-4fef-88e2-216489d02e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:19:05.748728 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb95d63-9d9c-4fef-88e2-216489d02e32 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:19:05.749004 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb95d63-9d9c-4fef-88e2-216489d02e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:19:05.749268 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb95d63-9d9c-4fef-88e2-216489d02e32 admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:19:05.749894 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb95d63-9d9c-4fef-88e2-216489d02e32 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:19:05.751638 dv-cinder-850836-7-smb devstack@keystone.service[81375]: WARNING py.warnings [None req-beb95d63-9d9c-4fef-88e2-216489d02e32 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 12:19:05.751638 dv-cinder-850836-7-smb devstack@keystone.service[81375]: warnings.warn(msg) Sep 15 12:19:05.751638 dv-cinder-850836-7-smb devstack@keystone.service[81375]: Sep 15 12:19:05.753037 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb95d63-9d9c-4fef-88e2-216489d02e32 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:19:05.771446 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 738/1478] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Sep 15 12:19:05 2022] GET /identity/v3/projects => generated 2553 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:19:07.952609 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1803894-cb63-4e17-b1a9-068a977677cf None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:19:07.953210 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1803894-cb63-4e17-b1a9-068a977677cf None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:19:07.953210 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1803894-cb63-4e17-b1a9-068a977677cf None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:19:07.954652 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 741/1479] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:19:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:19:07.960216 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f116e-f1c4-465e-a599-6a58ba2aed66 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:19:07.960648 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f116e-f1c4-465e-a599-6a58ba2aed66 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:19:07.960784 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f116e-f1c4-465e-a599-6a58ba2aed66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:19:08.029483 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-8e4f116e-f1c4-465e-a599-6a58ba2aed66 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:19:08.030711 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-8e4f116e-f1c4-465e-a599-6a58ba2aed66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:19:08.125319 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 739/1480] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:19:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:19:08.418374 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1803894-cb63-4e17-b1a9-068a977677cf None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:19:08.419939 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-e1803894-cb63-4e17-b1a9-068a977677cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:19:08.429506 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:19:08.564538 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1803894-cb63-4e17-b1a9-068a977677cf None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:19:08.643057 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:19:08.676218 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6054be-93ad-4be0-ba2d-761d6529c9ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d05c52570474820b4ba0e2cdad5c13f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:19:08.676814 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6054be-93ad-4be0-ba2d-761d6529c9ec service nova] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:19:08.677088 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6054be-93ad-4be0-ba2d-761d6529c9ec service nova] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:19:08.677387 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6054be-93ad-4be0-ba2d-761d6529c9ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:19:08.678987 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-ed6054be-93ad-4be0-ba2d-761d6529c9ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:19:08.768192 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6054be-93ad-4be0-ba2d-761d6529c9ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:19:08.769757 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6054be-93ad-4be0-ba2d-761d6529c9ec service nova] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:19:08.787026 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 742/1481] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:19:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:19:11.084940 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f349e1-f3d0-423b-a1a6-805548708d8b None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:19:11.085496 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f349e1-f3d0-423b-a1a6-805548708d8b None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:19:11.085496 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f349e1-f3d0-423b-a1a6-805548708d8b None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:19:11.086882 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 740/1482] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:19:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:19:11.092355 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d55907-c4e9-4a78-ae61-191ce28a1ac0 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:19:11.092748 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d55907-c4e9-4a78-ae61-191ce28a1ac0 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:19:11.092905 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d55907-c4e9-4a78-ae61-191ce28a1ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:19:11.158578 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-46d55907-c4e9-4a78-ae61-191ce28a1ac0 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:19:11.159801 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-46d55907-c4e9-4a78-ae61-191ce28a1ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:19:11.204735 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:19:11.255183 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 743/1483] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:19:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:19:11.540707 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f349e1-f3d0-423b-a1a6-805548708d8b None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:19:11.542276 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-15f349e1-f3d0-423b-a1a6-805548708d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:19:11.566674 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:19:11.647368 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f349e1-f3d0-423b-a1a6-805548708d8b None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:19:11.718472 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b107d2e3-a509-4f1a-8096-2b05be53ac00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:19:11.719132 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107d2e3-a509-4f1a-8096-2b05be53ac00 service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:19:11.719437 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107d2e3-a509-4f1a-8096-2b05be53ac00 service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:19:11.719710 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107d2e3-a509-4f1a-8096-2b05be53ac00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:19:11.721312 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-b107d2e3-a509-4f1a-8096-2b05be53ac00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:19:11.795816 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:19:11.830489 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b107d2e3-a509-4f1a-8096-2b05be53ac00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:19:11.831946 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b107d2e3-a509-4f1a-8096-2b05be53ac00 service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:19:11.849575 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 741/1484] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:19:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:19:14.075150 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5580b6e8-770d-4739-b53f-3454f6579a67 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:19:14.075707 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5580b6e8-770d-4739-b53f-3454f6579a67 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:19:14.075707 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5580b6e8-770d-4739-b53f-3454f6579a67 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:19:14.077040 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 744/1485] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:19:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:19:14.082398 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a802f5ca-444c-4e1b-8f19-3a510b4794b6 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:19:14.082858 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a802f5ca-444c-4e1b-8f19-3a510b4794b6 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:19:14.082969 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a802f5ca-444c-4e1b-8f19-3a510b4794b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:19:14.148745 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-a802f5ca-444c-4e1b-8f19-3a510b4794b6 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:19:14.149944 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-a802f5ca-444c-4e1b-8f19-3a510b4794b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:19:14.244367 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 742/1486] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:19:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:19:14.539127 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5580b6e8-770d-4739-b53f-3454f6579a67 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:19:14.540651 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-5580b6e8-770d-4739-b53f-3454f6579a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:19:14.644336 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5580b6e8-770d-4739-b53f-3454f6579a67 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:19:14.715523 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:19:14.717015 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab24e9f-547a-431a-a737-cbe78beb41c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:19:14.717679 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab24e9f-547a-431a-a737-cbe78beb41c2 service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:19:14.718209 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab24e9f-547a-431a-a737-cbe78beb41c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:19:14.718635 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab24e9f-547a-431a-a737-cbe78beb41c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:19:14.720987 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-4ab24e9f-547a-431a-a737-cbe78beb41c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:19:14.827720 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab24e9f-547a-431a-a737-cbe78beb41c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:19:14.829083 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab24e9f-547a-431a-a737-cbe78beb41c2 service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:19:14.847335 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 745/1487] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:19:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:19:17.154331 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82eec4b-87e0-4c6c-b7cd-a94e34581f57 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:19:17.154943 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82eec4b-87e0-4c6c-b7cd-a94e34581f57 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:19:17.154943 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82eec4b-87e0-4c6c-b7cd-a94e34581f57 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:19:17.156216 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 743/1488] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:19:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:19:17.161544 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5372fa-e299-4de2-b3b4-b2d042a1741f None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:19:17.161941 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5372fa-e299-4de2-b3b4-b2d042a1741f None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:19:17.162087 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5372fa-e299-4de2-b3b4-b2d042a1741f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:19:17.226785 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-4a5372fa-e299-4de2-b3b4-b2d042a1741f None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:19:17.227908 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-4a5372fa-e299-4de2-b3b4-b2d042a1741f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:19:17.294462 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:19:17.338745 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 746/1489] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:19:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:19:17.631561 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82eec4b-87e0-4c6c-b7cd-a94e34581f57 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:19:17.633161 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-a82eec4b-87e0-4c6c-b7cd-a94e34581f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:19:17.669331 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:19:17.735890 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82eec4b-87e0-4c6c-b7cd-a94e34581f57 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:19:17.808485 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e560d46-ac41-4278-88e9-d18fa4ff56af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:19:17.809077 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e560d46-ac41-4278-88e9-d18fa4ff56af service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:19:17.809352 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e560d46-ac41-4278-88e9-d18fa4ff56af service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:19:17.809617 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e560d46-ac41-4278-88e9-d18fa4ff56af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:19:17.811212 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-8e560d46-ac41-4278-88e9-d18fa4ff56af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:19:17.889020 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:19:17.918524 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e560d46-ac41-4278-88e9-d18fa4ff56af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:19:17.919982 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e560d46-ac41-4278-88e9-d18fa4ff56af service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:19:17.937330 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 744/1490] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:19:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:19:20.340089 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88f9a9b-8df2-49e9-8e23-fba303874528 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:19:20.340614 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88f9a9b-8df2-49e9-8e23-fba303874528 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:19:20.340614 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88f9a9b-8df2-49e9-8e23-fba303874528 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:19:20.341876 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 747/1491] 10.222.0.16 () {54 vars in 927 bytes} [Thu Sep 15 12:19:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:19:20.347058 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131edbca-058e-4c87-9584-ce348a5e4f98 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:19:20.347479 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131edbca-058e-4c87-9584-ce348a5e4f98 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:19:20.347592 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131edbca-058e-4c87-9584-ce348a5e4f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:19:20.412055 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-131edbca-058e-4c87-9584-ce348a5e4f98 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:19:20.413235 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-131edbca-058e-4c87-9584-ce348a5e4f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:19:20.508995 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 745/1492] 10.222.0.16 () {58 vars in 1024 bytes} [Thu Sep 15 12:19:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:19:20.794352 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88f9a9b-8df2-49e9-8e23-fba303874528 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:19:20.795958 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-b88f9a9b-8df2-49e9-8e23-fba303874528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:19:20.898518 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88f9a9b-8df2-49e9-8e23-fba303874528 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:19:20.972489 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f680f379-859c-42d1-94d9-26e29a7d3443 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:19:20.973110 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680f379-859c-42d1-94d9-26e29a7d3443 service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:19:20.973389 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680f379-859c-42d1-94d9-26e29a7d3443 service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:19:20.973663 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680f379-859c-42d1-94d9-26e29a7d3443 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:19:20.975369 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-f680f379-859c-42d1-94d9-26e29a7d3443 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:19:20.984356 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:19:21.084802 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f680f379-859c-42d1-94d9-26e29a7d3443 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:19:21.086227 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f680f379-859c-42d1-94d9-26e29a7d3443 service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:19:21.104771 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 748/1493] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:19:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:19:30.507490 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=82 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:19:31.102494 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=50 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:20:36.881699 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03534f6b-59e5-48f8-9f27-15f8e554cf25 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:20:36.882280 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03534f6b-59e5-48f8-9f27-15f8e554cf25 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:20:36.882280 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03534f6b-59e5-48f8-9f27-15f8e554cf25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:20:36.960152 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-03534f6b-59e5-48f8-9f27-15f8e554cf25 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:20:36.961292 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-03534f6b-59e5-48f8-9f27-15f8e554cf25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:20:37.057767 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 746/1494] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:20:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:20:37.066402 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f71d31a-b6ad-483e-b632-840649e9b695 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:20:37.066950 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f71d31a-b6ad-483e-b632-840649e9b695 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:20:37.067053 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f71d31a-b6ad-483e-b632-840649e9b695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:20:37.142861 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-2f71d31a-b6ad-483e-b632-840649e9b695 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:20:37.144031 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-2f71d31a-b6ad-483e-b632-840649e9b695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:20:37.237094 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 749/1495] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:20:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:20:37.241587 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03534f6b-59e5-48f8-9f27-15f8e554cf25 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:20:37.242805 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-03534f6b-59e5-48f8-9f27-15f8e554cf25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:20:37.254816 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03534f6b-59e5-48f8-9f27-15f8e554cf25 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:20:37.314937 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:20:37.348693 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a9673-9cc8-4736-aeb6-099c51138e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:20:37.349299 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a9673-9cc8-4736-aeb6-099c51138e9b admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:20:37.349579 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a9673-9cc8-4736-aeb6-099c51138e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:20:37.349851 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a9673-9cc8-4736-aeb6-099c51138e9b admin admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:20:37.350523 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1a9673-9cc8-4736-aeb6-099c51138e9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:20:37.350854 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1a9673-9cc8-4736-aeb6-099c51138e9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:20:37.351867 dv-cinder-850836-7-smb devstack@keystone.service[81375]: WARNING py.warnings [None req-4a1a9673-9cc8-4736-aeb6-099c51138e9b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 12:20:37.351867 dv-cinder-850836-7-smb devstack@keystone.service[81375]: warnings.warn(msg) Sep 15 12:20:37.351867 dv-cinder-850836-7-smb devstack@keystone.service[81375]: Sep 15 12:20:37.352743 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1a9673-9cc8-4736-aeb6-099c51138e9b admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:20:37.364313 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 747/1496] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 15 12:20:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:20:37.372524 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f71d31a-b6ad-483e-b632-840649e9b695 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:20:37.382154 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f71d31a-b6ad-483e-b632-840649e9b695 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:20:37.441135 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:20:37.473960 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4310eedf-a57d-4ce9-88dc-6d8990852910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:20:37.474547 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4310eedf-a57d-4ce9-88dc-6d8990852910 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:20:37.474855 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4310eedf-a57d-4ce9-88dc-6d8990852910 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:20:37.475122 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4310eedf-a57d-4ce9-88dc-6d8990852910 admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:20:37.475735 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4310eedf-a57d-4ce9-88dc-6d8990852910 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:20:37.477433 dv-cinder-850836-7-smb devstack@keystone.service[81374]: WARNING py.warnings [None req-4310eedf-a57d-4ce9-88dc-6d8990852910 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 12:20:37.477433 dv-cinder-850836-7-smb devstack@keystone.service[81374]: warnings.warn(msg) Sep 15 12:20:37.477433 dv-cinder-850836-7-smb devstack@keystone.service[81374]: Sep 15 12:20:37.478595 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4310eedf-a57d-4ce9-88dc-6d8990852910 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:20:37.534274 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 750/1497] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:20:37 2022] POST /identity/v3/projects => generated 377 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:20:37.538415 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a9673-9cc8-4736-aeb6-099c51138e9b admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:20:37.539949 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-4a1a9673-9cc8-4736-aeb6-099c51138e9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:20:37.573178 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a9673-9cc8-4736-aeb6-099c51138e9b admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:20:37.666031 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2c4f49-20e2-4fdf-b657-6e9ff52cc3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:20:37.666629 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c4f49-20e2-4fdf-b657-6e9ff52cc3d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:20:37.666933 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c4f49-20e2-4fdf-b657-6e9ff52cc3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:20:37.667204 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c4f49-20e2-4fdf-b657-6e9ff52cc3d7 admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:20:37.667815 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2c4f49-20e2-4fdf-b657-6e9ff52cc3d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:20:37.668873 dv-cinder-850836-7-smb devstack@keystone.service[81375]: WARNING py.warnings [None req-cf2c4f49-20e2-4fdf-b657-6e9ff52cc3d7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 12:20:37.668873 dv-cinder-850836-7-smb devstack@keystone.service[81375]: warnings.warn(msg) Sep 15 12:20:37.668873 dv-cinder-850836-7-smb devstack@keystone.service[81375]: Sep 15 12:20:37.670197 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2c4f49-20e2-4fdf-b657-6e9ff52cc3d7 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:20:37.718564 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 748/1498] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:20:37 2022] POST /identity/v3/users => generated 289 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:20:37.723076 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4310eedf-a57d-4ce9-88dc-6d8990852910 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:20:37.724626 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-4310eedf-a57d-4ce9-88dc-6d8990852910 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:20:37.785805 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4310eedf-a57d-4ce9-88dc-6d8990852910 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:20:37.867142 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:20:37.881264 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35a3782-5404-402f-aa6f-f1f181f801be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:20:37.881871 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35a3782-5404-402f-aa6f-f1f181f801be admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:20:37.882145 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35a3782-5404-402f-aa6f-f1f181f801be admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:20:37.882411 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35a3782-5404-402f-aa6f-f1f181f801be admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:20:37.883073 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35a3782-5404-402f-aa6f-f1f181f801be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:20:37.884069 dv-cinder-850836-7-smb devstack@keystone.service[81374]: WARNING py.warnings [None req-d35a3782-5404-402f-aa6f-f1f181f801be admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 12:20:37.884069 dv-cinder-850836-7-smb devstack@keystone.service[81374]: warnings.warn(msg) Sep 15 12:20:37.884069 dv-cinder-850836-7-smb devstack@keystone.service[81374]: Sep 15 12:20:37.884943 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35a3782-5404-402f-aa6f-f1f181f801be admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:20:37.897496 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 751/1499] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:20:37 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:20:37.901696 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2c4f49-20e2-4fdf-b657-6e9ff52cc3d7 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:20:37.903217 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-cf2c4f49-20e2-4fdf-b657-6e9ff52cc3d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:20:37.915099 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2c4f49-20e2-4fdf-b657-6e9ff52cc3d7 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:20:37.940207 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:20:38.010548 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357d8cb3-3dbf-446f-8d67-ab076b629e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:20:38.011181 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d8cb3-3dbf-446f-8d67-ab076b629e6d admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:20:38.011456 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d8cb3-3dbf-446f-8d67-ab076b629e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:20:38.011719 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d8cb3-3dbf-446f-8d67-ab076b629e6d admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:20:38.012343 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357d8cb3-3dbf-446f-8d67-ab076b629e6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:20:38.013352 dv-cinder-850836-7-smb devstack@keystone.service[81375]: WARNING py.warnings [None req-357d8cb3-3dbf-446f-8d67-ab076b629e6d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 12:20:38.013352 dv-cinder-850836-7-smb devstack@keystone.service[81375]: warnings.warn(msg) Sep 15 12:20:38.013352 dv-cinder-850836-7-smb devstack@keystone.service[81375]: Sep 15 12:20:38.014222 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357d8cb3-3dbf-446f-8d67-ab076b629e6d admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:20:38.026205 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 749/1500] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:20:37 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:20:38.030907 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35a3782-5404-402f-aa6f-f1f181f801be admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:20:38.032440 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-d35a3782-5404-402f-aa6f-f1f181f801be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:20:38.065408 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35a3782-5404-402f-aa6f-f1f181f801be admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:20:38.156796 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166596ec-4474-401b-b694-1ba55bcf1fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:20:38.157442 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166596ec-4474-401b-b694-1ba55bcf1fc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:20:38.157713 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166596ec-4474-401b-b694-1ba55bcf1fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:20:38.157978 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166596ec-4474-401b-b694-1ba55bcf1fc1 admin admin] PATH_INFO: `/v3/projects/9e9970b48bc546489e45ec05e98d6403/users/2bc20d50fdd64347899ec99132afd668/roles/9371e5bbc55848949eb951a815f817f2` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:20:38.179564 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166596ec-4474-401b-b694-1ba55bcf1fc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e9970b48bc546489e45ec05e98d6403, user_id=2bc20d50fdd64347899ec99132afd668, role_id=9371e5bbc55848949eb951a815f817f2)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:20:38.180565 dv-cinder-850836-7-smb devstack@keystone.service[81374]: WARNING py.warnings [None req-166596ec-4474-401b-b694-1ba55bcf1fc1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 12:20:38.180565 dv-cinder-850836-7-smb devstack@keystone.service[81374]: warnings.warn(msg) Sep 15 12:20:38.180565 dv-cinder-850836-7-smb devstack@keystone.service[81374]: Sep 15 12:20:38.182479 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166596ec-4474-401b-b694-1ba55bcf1fc1 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:20:38.212410 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 752/1501] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:20:38 2022] PUT /identity/v3/projects/9e9970b48bc546489e45ec05e98d6403/users/2bc20d50fdd64347899ec99132afd668/roles/9371e5bbc55848949eb951a815f817f2 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:20:38.225185 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3a276-8a8c-4632-869b-8df87829d0c6 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:20:38.225501 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3a276-8a8c-4632-869b-8df87829d0c6 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:20:38.225772 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3a276-8a8c-4632-869b-8df87829d0c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:20:38.284101 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-c9a3a276-8a8c-4632-869b-8df87829d0c6 None None] MFA Rules not processed for user `2bc20d50fdd64347899ec99132afd668`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:20:38.285303 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-c9a3a276-8a8c-4632-869b-8df87829d0c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:20:38.361862 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 750/1502] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:20:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:20:38.374910 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca7f181-8043-44d3-abb1-9d92ca01331d None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:20:38.375190 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca7f181-8043-44d3-abb1-9d92ca01331d None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:20:38.375459 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca7f181-8043-44d3-abb1-9d92ca01331d None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:20:38.377069 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 753/1503] 10.222.0.16 () {54 vars in 964 bytes} [Thu Sep 15 12:20:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:20:38.381777 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db49ad1-bd62-4a8f-9cd8-d518b8a30708 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:20:38.382064 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db49ad1-bd62-4a8f-9cd8-d518b8a30708 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:20:38.382338 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db49ad1-bd62-4a8f-9cd8-d518b8a30708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:20:38.414256 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:20:38.458832 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-8db49ad1-bd62-4a8f-9cd8-d518b8a30708 None None] MFA Rules not processed for user `ceafc5e4283841528053f01931f10293`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:20:38.460018 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-8db49ad1-bd62-4a8f-9cd8-d518b8a30708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:20:38.532559 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 751/1504] 10.222.0.16 () {58 vars in 1061 bytes} [Thu Sep 15 12:20:38 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:20:38.540315 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca7f181-8043-44d3-abb1-9d92ca01331d None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:20:38.541804 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-9ca7f181-8043-44d3-abb1-9d92ca01331d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:20:38.590908 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:20:38.644667 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca7f181-8043-44d3-abb1-9d92ca01331d None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:20:38.717488 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db55735a-29af-4f8b-988b-e0521aebd8f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceafc5e4283841528053f01931f10293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:20:38.718117 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db55735a-29af-4f8b-988b-e0521aebd8f2 service cinder] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:20:38.718395 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db55735a-29af-4f8b-988b-e0521aebd8f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:20:38.718664 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db55735a-29af-4f8b-988b-e0521aebd8f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:20:38.720287 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-db55735a-29af-4f8b-988b-e0521aebd8f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:20:38.817490 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db55735a-29af-4f8b-988b-e0521aebd8f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:20:38.818940 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db55735a-29af-4f8b-988b-e0521aebd8f2 service cinder] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:20:38.822305 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:20:38.837104 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 754/1505] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:20:38 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:20:38.883092 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5edd9c-3884-43fe-86a7-323789be3857 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:20:38.883380 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5edd9c-3884-43fe-86a7-323789be3857 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:20:38.883655 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5edd9c-3884-43fe-86a7-323789be3857 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:20:38.884915 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 752/1506] 10.222.0.16 () {52 vars in 830 bytes} [Thu Sep 15 12:20:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:20:38.888423 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db55735a-29af-4f8b-988b-e0521aebd8f2 service cinder] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:20:38.889620 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-db55735a-29af-4f8b-988b-e0521aebd8f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:20:38.992085 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db55735a-29af-4f8b-988b-e0521aebd8f2 service cinder] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:20:39.084199 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480ce85c-9aab-4275-9c91-9fcd98007a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:20:39.084837 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480ce85c-9aab-4275-9c91-9fcd98007a01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:20:39.085094 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480ce85c-9aab-4275-9c91-9fcd98007a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:20:39.085362 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480ce85c-9aab-4275-9c91-9fcd98007a01 admin admin] PATH_INFO: `/v3/users/2bc20d50fdd64347899ec99132afd668` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:20:39.097806 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480ce85c-9aab-4275-9c91-9fcd98007a01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bc20d50fdd64347899ec99132afd668)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:20:39.098845 dv-cinder-850836-7-smb devstack@keystone.service[81374]: WARNING py.warnings [None req-480ce85c-9aab-4275-9c91-9fcd98007a01 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 12:20:39.098845 dv-cinder-850836-7-smb devstack@keystone.service[81374]: warnings.warn(msg) Sep 15 12:20:39.098845 dv-cinder-850836-7-smb devstack@keystone.service[81374]: Sep 15 12:20:39.100043 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480ce85c-9aab-4275-9c91-9fcd98007a01 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:20:39.109981 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:20:39.167850 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-480ce85c-9aab-4275-9c91-9fcd98007a01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bc20d50fdd64347899ec99132afd668'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:20:39.177192 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-480ce85c-9aab-4275-9c91-9fcd98007a01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bc20d50fdd64347899ec99132afd668'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:20:39.177617 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-480ce85c-9aab-4275-9c91-9fcd98007a01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bc20d50fdd64347899ec99132afd668'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:20:39.178189 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-480ce85c-9aab-4275-9c91-9fcd98007a01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bc20d50fdd64347899ec99132afd668'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:20:39.192557 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-480ce85c-9aab-4275-9c91-9fcd98007a01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bc20d50fdd64347899ec99132afd668'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:20:39.222562 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 755/1507] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:20:38 2022] DELETE /identity/v3/users/2bc20d50fdd64347899ec99132afd668 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:20:39.228090 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8f6a3-446e-411f-b7ad-fadd756a9ca1 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:20:39.228630 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8f6a3-446e-411f-b7ad-fadd756a9ca1 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:20:39.229146 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8f6a3-446e-411f-b7ad-fadd756a9ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:20:39.289433 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-89d8f6a3-446e-411f-b7ad-fadd756a9ca1 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:20:39.290656 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-89d8f6a3-446e-411f-b7ad-fadd756a9ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:20:39.364783 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:20:39.377976 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 753/1508] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:20:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:20:39.387905 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480ce85c-9aab-4275-9c91-9fcd98007a01 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:20:39.389146 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-480ce85c-9aab-4275-9c91-9fcd98007a01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:20:39.489651 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480ce85c-9aab-4275-9c91-9fcd98007a01 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:20:39.543650 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:20:39.564426 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd357a6b-0491-499b-9a85-b5f926ec7f4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:20:39.565033 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd357a6b-0491-499b-9a85-b5f926ec7f4c service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:20:39.565310 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd357a6b-0491-499b-9a85-b5f926ec7f4c service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:20:39.565578 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd357a6b-0491-499b-9a85-b5f926ec7f4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:20:39.567203 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-bd357a6b-0491-499b-9a85-b5f926ec7f4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:20:39.675779 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd357a6b-0491-499b-9a85-b5f926ec7f4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:20:39.677371 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd357a6b-0491-499b-9a85-b5f926ec7f4c service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:20:39.695321 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 756/1509] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:20:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:20:40.022719 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d8f6a3-446e-411f-b7ad-fadd756a9ca1 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:20:40.024190 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-89d8f6a3-446e-411f-b7ad-fadd756a9ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:20:40.035361 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d8f6a3-446e-411f-b7ad-fadd756a9ca1 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:20:40.133255 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d7c3cf-bde0-4841-8214-67be2c32e353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:20:40.133875 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d7c3cf-bde0-4841-8214-67be2c32e353 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:20:40.134154 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d7c3cf-bde0-4841-8214-67be2c32e353 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:20:40.134426 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d7c3cf-bde0-4841-8214-67be2c32e353 admin admin] PATH_INFO: `/v3/projects/9e9970b48bc546489e45ec05e98d6403` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:20:40.145433 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d7c3cf-bde0-4841-8214-67be2c32e353 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e9970b48bc546489e45ec05e98d6403)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:20:40.146452 dv-cinder-850836-7-smb devstack@keystone.service[81375]: WARNING py.warnings [None req-e4d7c3cf-bde0-4841-8214-67be2c32e353 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 12:20:40.146452 dv-cinder-850836-7-smb devstack@keystone.service[81375]: warnings.warn(msg) Sep 15 12:20:40.146452 dv-cinder-850836-7-smb devstack@keystone.service[81375]: Sep 15 12:20:40.147681 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d7c3cf-bde0-4841-8214-67be2c32e353 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:20:40.205026 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-e4d7c3cf-bde0-4841-8214-67be2c32e353 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e9970b48bc546489e45ec05e98d6403', 'request_id': 'req-e4d7c3cf-bde0-4841-8214-67be2c32e353'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:20:40.211029 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-e4d7c3cf-bde0-4841-8214-67be2c32e353 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e9970b48bc546489e45ec05e98d6403', 'request_id': 'req-e4d7c3cf-bde0-4841-8214-67be2c32e353'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:20:40.219583 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-e4d7c3cf-bde0-4841-8214-67be2c32e353 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e9970b48bc546489e45ec05e98d6403', 'request_id': 'req-e4d7c3cf-bde0-4841-8214-67be2c32e353'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:20:40.248589 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-e4d7c3cf-bde0-4841-8214-67be2c32e353 admin admin] The token cache is being invalidate because project 9e9970b48bc546489e45ec05e98d6403 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:20:40.249705 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-e4d7c3cf-bde0-4841-8214-67be2c32e353 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:20:40.249810 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-e4d7c3cf-bde0-4841-8214-67be2c32e353 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:20:40.251240 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 754/1510] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:20:40 2022] DELETE /identity/v3/projects/9e9970b48bc546489e45ec05e98d6403 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:20:49.692872 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=62 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:20:50.246609 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:22:16.229531 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeada5b-6f20-4fca-b533-b9273ef80af3 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:22:16.230091 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeada5b-6f20-4fca-b533-b9273ef80af3 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:22:16.230091 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeada5b-6f20-4fca-b533-b9273ef80af3 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:22:16.231375 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 757/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 15 12:22:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:22:16.236617 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7f877-3236-4ad7-afc6-0603a38cfc62 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:22:16.237022 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7f877-3236-4ad7-afc6-0603a38cfc62 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:22:16.237156 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7f877-3236-4ad7-afc6-0603a38cfc62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:22:16.316857 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-ffb7f877-3236-4ad7-afc6-0603a38cfc62 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:22:16.318038 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-ffb7f877-3236-4ad7-afc6-0603a38cfc62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:22:16.419746 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 755/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 15 12:22:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:22:16.575014 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeada5b-6f20-4fca-b533-b9273ef80af3 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:22:16.577101 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-faeada5b-6f20-4fca-b533-b9273ef80af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:22:16.693481 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeada5b-6f20-4fca-b533-b9273ef80af3 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:22:16.698893 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7153d341-bd00-43b4-82cf-3dcf0e884b7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d05c52570474820b4ba0e2cdad5c13f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:22:16.699500 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7153d341-bd00-43b4-82cf-3dcf0e884b7a service nova] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:22:16.699777 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7153d341-bd00-43b4-82cf-3dcf0e884b7a service nova] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:22:16.700042 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7153d341-bd00-43b4-82cf-3dcf0e884b7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:22:16.707969 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7153d341-bd00-43b4-82cf-3dcf0e884b7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:22:16.709566 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7153d341-bd00-43b4-82cf-3dcf0e884b7a service nova] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:22:16.719377 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 758/1513] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:22:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:22:17.800544 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41e342-d32f-4149-ae03-bdaa6f765540 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:22:17.801081 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41e342-d32f-4149-ae03-bdaa6f765540 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:22:17.801081 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41e342-d32f-4149-ae03-bdaa6f765540 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:22:17.802406 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 756/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 15 12:22:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:22:17.808358 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d333c-a143-4de8-8b44-bf2bf15d9b03 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:22:17.808793 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d333c-a143-4de8-8b44-bf2bf15d9b03 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:22:17.808903 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d333c-a143-4de8-8b44-bf2bf15d9b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:22:17.828449 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-a49d333c-a143-4de8-8b44-bf2bf15d9b03 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:22:17.829624 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-a49d333c-a143-4de8-8b44-bf2bf15d9b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:22:17.837461 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 759/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 15 12:22:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:22:17.988810 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b41e342-d32f-4149-ae03-bdaa6f765540 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:22:18.003068 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b41e342-d32f-4149-ae03-bdaa6f765540 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:22:18.008406 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d639758-f6e6-478f-92da-8c538f38e4ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d05c52570474820b4ba0e2cdad5c13f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:22:18.008991 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d639758-f6e6-478f-92da-8c538f38e4ef service nova] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:22:18.009264 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d639758-f6e6-478f-92da-8c538f38e4ef service nova] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:22:18.009534 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d639758-f6e6-478f-92da-8c538f38e4ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:22:18.017807 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d639758-f6e6-478f-92da-8c538f38e4ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:22:18.019410 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d639758-f6e6-478f-92da-8c538f38e4ef service nova] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:22:18.028427 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 757/1516] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:22:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:22:18.222536 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f8e2b-6cb0-4a25-bce7-1ebf41e6ff5c None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:22:18.222874 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f8e2b-6cb0-4a25-bce7-1ebf41e6ff5c None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:22:18.223124 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f8e2b-6cb0-4a25-bce7-1ebf41e6ff5c None None] PATH_INFO: `/v3` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:22:18.224420 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 760/1517] 10.222.0.50 () {54 vars in 925 bytes} [Thu Sep 15 12:22:18 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:22:18.231456 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5820a9-0748-46b5-b603-1b5cfbe1426d None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:22:18.231739 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5820a9-0748-46b5-b603-1b5cfbe1426d None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:22:18.232009 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5820a9-0748-46b5-b603-1b5cfbe1426d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:22:18.297712 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-4d5820a9-0748-46b5-b603-1b5cfbe1426d None None] MFA Rules not processed for user `b7ff8a5ddf1e422ca97f92bd9d4e5fb8`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:22:18.298966 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-4d5820a9-0748-46b5-b603-1b5cfbe1426d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:22:18.316221 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:22:18.369559 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 758/1518] 10.222.0.50 () {58 vars in 1015 bytes} [Thu Sep 15 12:22:18 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:22:27.823058 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=56 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:22:27.967898 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878e74c-d5e9-49c7-801a-a47463d4dacd None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:22:27.968182 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878e74c-d5e9-49c7-801a-a47463d4dacd None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:22:27.968461 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878e74c-d5e9-49c7-801a-a47463d4dacd None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:22:27.970295 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 761/1519] 10.222.0.16 () {54 vars in 961 bytes} [Thu Sep 15 12:22:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:22:27.975464 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee0a2c2-eb76-482a-a91d-08403ae5e57f None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:22:27.975931 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee0a2c2-eb76-482a-a91d-08403ae5e57f None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:22:27.976037 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee0a2c2-eb76-482a-a91d-08403ae5e57f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:22:27.996095 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-cee0a2c2-eb76-482a-a91d-08403ae5e57f None None] MFA Rules not processed for user `b7ff8a5ddf1e422ca97f92bd9d4e5fb8`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:22:27.997273 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-cee0a2c2-eb76-482a-a91d-08403ae5e57f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:22:28.005927 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 759/1520] 10.222.0.16 () {58 vars in 1058 bytes} [Thu Sep 15 12:22:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:22:28.013381 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a878e74c-d5e9-49c7-801a-a47463d4dacd None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:22:28.026846 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a878e74c-d5e9-49c7-801a-a47463d4dacd None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:22:28.032191 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50f4aff-0d35-4c7a-b06e-0643ee456049 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ff8a5ddf1e422ca97f92bd9d4e5fb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:22:28.032801 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50f4aff-0d35-4c7a-b06e-0643ee456049 service placement] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:22:28.033074 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50f4aff-0d35-4c7a-b06e-0643ee456049 service placement] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:22:28.033338 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50f4aff-0d35-4c7a-b06e-0643ee456049 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:22:28.041475 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50f4aff-0d35-4c7a-b06e-0643ee456049 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:22:28.043067 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50f4aff-0d35-4c7a-b06e-0643ee456049 service placement] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:22:28.052922 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 762/1521] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:22:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:22:29.497525 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de73bcb-7846-4794-a4ae-1608a9c28d00 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:22:29.498103 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de73bcb-7846-4794-a4ae-1608a9c28d00 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:22:29.498103 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de73bcb-7846-4794-a4ae-1608a9c28d00 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:22:29.499403 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 760/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 15 12:22:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:22:29.505976 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b00f4-fa2f-4996-b661-288b370ea1d2 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:22:29.506415 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b00f4-fa2f-4996-b661-288b370ea1d2 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:22:29.506615 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b00f4-fa2f-4996-b661-288b370ea1d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:22:29.525691 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-7b4b00f4-fa2f-4996-b661-288b370ea1d2 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:22:29.526883 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-7b4b00f4-fa2f-4996-b661-288b370ea1d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:22:29.535081 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 763/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 15 12:22:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:22:29.687470 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de73bcb-7846-4794-a4ae-1608a9c28d00 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:22:29.701384 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de73bcb-7846-4794-a4ae-1608a9c28d00 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:22:29.707235 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fce82de-e6cc-4ad8-8b23-3b8cb0b25aae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d05c52570474820b4ba0e2cdad5c13f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:22:29.707816 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce82de-e6cc-4ad8-8b23-3b8cb0b25aae service nova] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:22:29.708091 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce82de-e6cc-4ad8-8b23-3b8cb0b25aae service nova] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:22:29.708357 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce82de-e6cc-4ad8-8b23-3b8cb0b25aae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:22:29.716141 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fce82de-e6cc-4ad8-8b23-3b8cb0b25aae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:22:29.717699 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fce82de-e6cc-4ad8-8b23-3b8cb0b25aae service nova] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:22:29.727392 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 761/1524] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:22:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:22:30.811296 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0453fd-10c6-4a87-9dbc-03885ba29abf None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:22:30.811793 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0453fd-10c6-4a87-9dbc-03885ba29abf None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:22:30.811898 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0453fd-10c6-4a87-9dbc-03885ba29abf None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:22:30.813168 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 764/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 15 12:22:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:22:30.819555 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323ac4b9-b553-4bad-a6f9-7f7b285f7bda None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:22:30.820011 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323ac4b9-b553-4bad-a6f9-7f7b285f7bda None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:22:30.820148 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323ac4b9-b553-4bad-a6f9-7f7b285f7bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:22:30.839127 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-323ac4b9-b553-4bad-a6f9-7f7b285f7bda None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:22:30.840335 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-323ac4b9-b553-4bad-a6f9-7f7b285f7bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:22:30.848742 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 762/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 15 12:22:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:22:31.011210 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0453fd-10c6-4a87-9dbc-03885ba29abf None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:22:31.027135 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0453fd-10c6-4a87-9dbc-03885ba29abf None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:22:31.032434 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0457cdc-329c-49f7-9ec9-d56fb2b576ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d05c52570474820b4ba0e2cdad5c13f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:22:31.033539 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0457cdc-329c-49f7-9ec9-d56fb2b576ba service nova] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:22:31.033813 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0457cdc-329c-49f7-9ec9-d56fb2b576ba service nova] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:22:31.034176 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0457cdc-329c-49f7-9ec9-d56fb2b576ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:22:31.044624 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0457cdc-329c-49f7-9ec9-d56fb2b576ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:22:31.046237 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0457cdc-329c-49f7-9ec9-d56fb2b576ba service nova] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:22:31.056488 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 765/1527] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:22:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:22:35.388194 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2adaf5-fd3e-4651-8a54-7aef15dcffdc None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:22:35.388722 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2adaf5-fd3e-4651-8a54-7aef15dcffdc None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:22:35.388722 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2adaf5-fd3e-4651-8a54-7aef15dcffdc None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:22:35.389986 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 763/1528] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 12:22:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:22:35.395962 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f850e2-8913-4779-832b-3abbe6cd839b None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:22:35.396341 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f850e2-8913-4779-832b-3abbe6cd839b None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:22:35.396532 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f850e2-8913-4779-832b-3abbe6cd839b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:22:35.416385 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-f2f850e2-8913-4779-832b-3abbe6cd839b None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:22:35.417655 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-f2f850e2-8913-4779-832b-3abbe6cd839b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:22:35.425814 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 766/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 12:22:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:22:35.727835 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2adaf5-fd3e-4651-8a54-7aef15dcffdc None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:22:35.729652 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-4b2adaf5-fd3e-4651-8a54-7aef15dcffdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:22:35.806377 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2adaf5-fd3e-4651-8a54-7aef15dcffdc None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:22:35.809887 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97506962-a0b8-440c-9519-bbd843576467 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:22:35.810512 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97506962-a0b8-440c-9519-bbd843576467 service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:22:35.810814 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97506962-a0b8-440c-9519-bbd843576467 service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:22:35.811085 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97506962-a0b8-440c-9519-bbd843576467 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:22:35.820441 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97506962-a0b8-440c-9519-bbd843576467 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:22:35.821913 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97506962-a0b8-440c-9519-bbd843576467 service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:22:35.830999 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 764/1530] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:22:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 12:22:37.962403 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ddf357-aa2e-4c73-af1e-58af8ec0f726 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:22:37.963007 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ddf357-aa2e-4c73-af1e-58af8ec0f726 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:22:37.963007 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ddf357-aa2e-4c73-af1e-58af8ec0f726 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:22:37.964310 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 767/1531] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 12:22:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:22:37.969544 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65161e7e-0f85-4d73-b83a-e9ee5d70309e None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:22:37.969997 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65161e7e-0f85-4d73-b83a-e9ee5d70309e None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:22:37.970579 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65161e7e-0f85-4d73-b83a-e9ee5d70309e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:22:37.989582 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-65161e7e-0f85-4d73-b83a-e9ee5d70309e None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:22:37.990776 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-65161e7e-0f85-4d73-b83a-e9ee5d70309e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:22:37.998423 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 765/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 12:22:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:22:38.290110 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ddf357-aa2e-4c73-af1e-58af8ec0f726 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:22:38.301632 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ddf357-aa2e-4c73-af1e-58af8ec0f726 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:22:38.305860 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a571db42-03cf-441a-9a6c-3d0e001cad26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:22:38.306491 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571db42-03cf-441a-9a6c-3d0e001cad26 service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:22:38.306802 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571db42-03cf-441a-9a6c-3d0e001cad26 service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:22:38.307073 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571db42-03cf-441a-9a6c-3d0e001cad26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:22:38.316508 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a571db42-03cf-441a-9a6c-3d0e001cad26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:22:38.317920 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a571db42-03cf-441a-9a6c-3d0e001cad26 service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:22:38.329409 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 768/1533] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:22:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:22:42.085199 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d85d3e-83c3-442d-8514-28be94ad1b85 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:22:42.085757 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d85d3e-83c3-442d-8514-28be94ad1b85 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:22:42.085757 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d85d3e-83c3-442d-8514-28be94ad1b85 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:22:42.087137 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 766/1534] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 12:22:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:22:42.092319 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927a369f-2670-451a-b253-5be988ace494 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:22:42.092760 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927a369f-2670-451a-b253-5be988ace494 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:22:42.092872 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927a369f-2670-451a-b253-5be988ace494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:22:42.113087 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-927a369f-2670-451a-b253-5be988ace494 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:22:42.114273 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-927a369f-2670-451a-b253-5be988ace494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:22:42.121943 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 769/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 12:22:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:22:42.423732 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d85d3e-83c3-442d-8514-28be94ad1b85 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:22:42.425460 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-22d85d3e-83c3-442d-8514-28be94ad1b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:22:42.492377 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:22:42.506851 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d85d3e-83c3-442d-8514-28be94ad1b85 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:22:42.510407 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeb0f7e-f25b-4f2f-ab16-207ffcf9be6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceafc5e4283841528053f01931f10293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:22:42.511036 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeb0f7e-f25b-4f2f-ab16-207ffcf9be6c service cinder] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:22:42.511318 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeb0f7e-f25b-4f2f-ab16-207ffcf9be6c service cinder] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:22:42.511597 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeb0f7e-f25b-4f2f-ab16-207ffcf9be6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:22:42.520463 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeb0f7e-f25b-4f2f-ab16-207ffcf9be6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:22:42.521909 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeb0f7e-f25b-4f2f-ab16-207ffcf9be6c service cinder] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:22:42.531278 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 767/1536] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:22:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:22:44.655403 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be975420-a957-4a01-bc91-1ec7907e87e0 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:22:44.655908 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be975420-a957-4a01-bc91-1ec7907e87e0 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:22:44.655908 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be975420-a957-4a01-bc91-1ec7907e87e0 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:22:44.657932 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 770/1537] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 12:22:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:22:44.663255 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf40ffa7-ad37-40d0-9076-902b41e0cefd None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:22:44.663640 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf40ffa7-ad37-40d0-9076-902b41e0cefd None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:22:44.663797 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf40ffa7-ad37-40d0-9076-902b41e0cefd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:22:44.683298 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-bf40ffa7-ad37-40d0-9076-902b41e0cefd None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:22:44.684506 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-bf40ffa7-ad37-40d0-9076-902b41e0cefd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:22:44.692202 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 768/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 12:22:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:22:44.995246 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be975420-a957-4a01-bc91-1ec7907e87e0 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:22:44.996936 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-be975420-a957-4a01-bc91-1ec7907e87e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:22:45.010663 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be975420-a957-4a01-bc91-1ec7907e87e0 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:22:45.014125 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5a2aa1-fc65-4277-bedd-a225736bdbbd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceafc5e4283841528053f01931f10293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:22:45.014735 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a2aa1-fc65-4277-bedd-a225736bdbbd service cinder] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:22:45.015044 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a2aa1-fc65-4277-bedd-a225736bdbbd service cinder] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:22:45.015316 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a2aa1-fc65-4277-bedd-a225736bdbbd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:22:45.023962 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5a2aa1-fc65-4277-bedd-a225736bdbbd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:22:45.025365 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5a2aa1-fc65-4277-bedd-a225736bdbbd service cinder] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:22:45.035104 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 771/1539] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:22:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:22:54.678028 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=11 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:22:55.030464 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=33 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:24:18.965530 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10dcfbe-b242-41a1-bbb6-cfa3a7c92ee8 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:18.966612 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10dcfbe-b242-41a1-bbb6-cfa3a7c92ee8 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:18.967149 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10dcfbe-b242-41a1-bbb6-cfa3a7c92ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:19.012188 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-c10dcfbe-b242-41a1-bbb6-cfa3a7c92ee8 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:24:19.014826 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-c10dcfbe-b242-41a1-bbb6-cfa3a7c92ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:19.032828 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 769/1540] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:24:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:24:19.042057 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c0241a-615f-4c29-8ed7-07aa551a38b2 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:19.042633 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c0241a-615f-4c29-8ed7-07aa551a38b2 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:19.042633 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c0241a-615f-4c29-8ed7-07aa551a38b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:19.075434 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-f6c0241a-615f-4c29-8ed7-07aa551a38b2 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:24:19.076973 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-f6c0241a-615f-4c29-8ed7-07aa551a38b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:19.080110 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f72e63-97c6-4ade-97fb-0390e8d38be0 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:19.080592 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f72e63-97c6-4ade-97fb-0390e8d38be0 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:19.081019 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f72e63-97c6-4ade-97fb-0390e8d38be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:19.093861 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 772/1541] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:24:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:24:19.098805 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c0241a-615f-4c29-8ed7-07aa551a38b2 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:19.112058 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c0241a-615f-4c29-8ed7-07aa551a38b2 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:19.118677 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0dc94d-d138-4bd4-80ef-607d1f972378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:19.124007 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0dc94d-d138-4bd4-80ef-607d1f972378 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:19.125081 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0dc94d-d138-4bd4-80ef-607d1f972378 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:19.125576 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0dc94d-d138-4bd4-80ef-607d1f972378 admin admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:19.125906 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-d9f72e63-97c6-4ade-97fb-0390e8d38be0 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:24:19.126997 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0dc94d-d138-4bd4-80ef-607d1f972378 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:24:19.127531 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0dc94d-d138-4bd4-80ef-607d1f972378 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:19.127693 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-d9f72e63-97c6-4ade-97fb-0390e8d38be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:19.134724 dv-cinder-850836-7-smb devstack@keystone.service[81374]: WARNING py.warnings [None req-bc0dc94d-d138-4bd4-80ef-607d1f972378 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 12:24:19.134724 dv-cinder-850836-7-smb devstack@keystone.service[81374]: warnings.warn(msg) Sep 15 12:24:19.134724 dv-cinder-850836-7-smb devstack@keystone.service[81374]: Sep 15 12:24:19.134724 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0dc94d-d138-4bd4-80ef-607d1f972378 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:19.150371 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 773/1542] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 15 12:24:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:24:19.159767 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 770/1543] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:24:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:24:19.160227 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0dc94d-d138-4bd4-80ef-607d1f972378 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:19.169764 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bad32b-2f58-49c6-9ba6-16dd5dc1073a None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:19.170105 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bad32b-2f58-49c6-9ba6-16dd5dc1073a None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:19.170317 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bad32b-2f58-49c6-9ba6-16dd5dc1073a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:19.176973 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0dc94d-d138-4bd4-80ef-607d1f972378 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:19.194266 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39fe27e-edbe-43be-890f-3255b0285745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:19.194923 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39fe27e-edbe-43be-890f-3255b0285745 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:19.195207 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39fe27e-edbe-43be-890f-3255b0285745 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:19.195483 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39fe27e-edbe-43be-890f-3255b0285745 admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:19.196132 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39fe27e-edbe-43be-890f-3255b0285745 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:19.198042 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39fe27e-edbe-43be-890f-3255b0285745 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:19.228854 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-55bad32b-2f58-49c6-9ba6-16dd5dc1073a None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:24:19.230196 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-55bad32b-2f58-49c6-9ba6-16dd5dc1073a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:19.274408 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 771/1544] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:24:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:24:19.279307 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bdbcae-de1a-40ea-bedb-c995aa46234a None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:19.279661 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bdbcae-de1a-40ea-bedb-c995aa46234a None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:19.279909 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bdbcae-de1a-40ea-bedb-c995aa46234a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:19.282309 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 774/1545] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:24:19 2022] POST /identity/v3/projects => generated 389 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 12:24:19.287235 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39fe27e-edbe-43be-890f-3255b0285745 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:19.322497 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-b8bdbcae-de1a-40ea-bedb-c995aa46234a None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:24:19.324707 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-b8bdbcae-de1a-40ea-bedb-c995aa46234a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:19.413645 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39fe27e-edbe-43be-890f-3255b0285745 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:19.417148 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 772/1546] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:24:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:24:19.417791 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bdbcae-de1a-40ea-bedb-c995aa46234a None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:19.426181 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbf0aa2-509f-4092-a2b9-149c8724e444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:19.426842 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf0aa2-509f-4092-a2b9-149c8724e444 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:19.427127 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf0aa2-509f-4092-a2b9-149c8724e444 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:19.427411 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbf0aa2-509f-4092-a2b9-149c8724e444 admin admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:19.428070 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbf0aa2-509f-4092-a2b9-149c8724e444 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:24:19.428376 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbf0aa2-509f-4092-a2b9-149c8724e444 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:19.429984 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbf0aa2-509f-4092-a2b9-149c8724e444 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:19.437887 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bdbcae-de1a-40ea-bedb-c995aa46234a None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:19.450522 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3f18a7-7c06-40a0-8306-e78120a050ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:19.451181 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f18a7-7c06-40a0-8306-e78120a050ee admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:19.453679 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f18a7-7c06-40a0-8306-e78120a050ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:19.453985 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f18a7-7c06-40a0-8306-e78120a050ee admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:19.454637 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3f18a7-7c06-40a0-8306-e78120a050ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:19.456621 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3f18a7-7c06-40a0-8306-e78120a050ee admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:19.461194 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 775/1547] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 15 12:24:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:24:19.462924 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd39420-5ad4-4433-b7b5-dcba3ffb853d None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:19.463211 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd39420-5ad4-4433-b7b5-dcba3ffb853d None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:19.463488 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd39420-5ad4-4433-b7b5-dcba3ffb853d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:19.495653 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-3fd39420-5ad4-4433-b7b5-dcba3ffb853d None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:24:19.496900 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-3fd39420-5ad4-4433-b7b5-dcba3ffb853d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:19.499753 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 773/1548] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:24:19 2022] POST /identity/v3/users => generated 295 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:24:19.501059 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a0c9f1-374d-4720-ae72-2e097400ddfb None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:19.501423 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a0c9f1-374d-4720-ae72-2e097400ddfb None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:19.501878 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a0c9f1-374d-4720-ae72-2e097400ddfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:19.505895 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 776/1549] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:24:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:24:19.507062 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a5afb2-c9d3-4f78-98a7-b53701f8a5e5 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:19.507411 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a5afb2-c9d3-4f78-98a7-b53701f8a5e5 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:19.507627 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a5afb2-c9d3-4f78-98a7-b53701f8a5e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:19.523442 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-95a0c9f1-374d-4720-ae72-2e097400ddfb None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:24:19.524652 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-95a0c9f1-374d-4720-ae72-2e097400ddfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:19.527803 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-30a5afb2-c9d3-4f78-98a7-b53701f8a5e5 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:24:19.528982 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-30a5afb2-c9d3-4f78-98a7-b53701f8a5e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:19.533927 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 774/1550] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:24:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:24:19.534710 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a0c9f1-374d-4720-ae72-2e097400ddfb None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:19.539674 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 777/1551] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:24:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:24:19.540937 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfaa592-a9b4-45cd-9b4b-ff1b2205e85c None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:19.541250 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfaa592-a9b4-45cd-9b4b-ff1b2205e85c None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:19.541524 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfaa592-a9b4-45cd-9b4b-ff1b2205e85c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:19.544856 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a0c9f1-374d-4720-ae72-2e097400ddfb None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:19.550114 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e914104-30af-4deb-af8a-45bec2ac0dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:19.550779 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e914104-30af-4deb-af8a-45bec2ac0dce admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:19.552193 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e914104-30af-4deb-af8a-45bec2ac0dce admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:19.552193 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e914104-30af-4deb-af8a-45bec2ac0dce admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:19.552193 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e914104-30af-4deb-af8a-45bec2ac0dce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:19.553066 dv-cinder-850836-7-smb devstack@keystone.service[81375]: WARNING py.warnings [None req-2e914104-30af-4deb-af8a-45bec2ac0dce admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 12:24:19.553066 dv-cinder-850836-7-smb devstack@keystone.service[81375]: warnings.warn(msg) Sep 15 12:24:19.553066 dv-cinder-850836-7-smb devstack@keystone.service[81375]: Sep 15 12:24:19.554268 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e914104-30af-4deb-af8a-45bec2ac0dce admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:19.563433 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-0cfaa592-a9b4-45cd-9b4b-ff1b2205e85c None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:24:19.564761 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-0cfaa592-a9b4-45cd-9b4b-ff1b2205e85c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:19.573387 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 778/1552] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:24:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:24:19.574656 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6cb1a1-f190-4cdb-94c8-f0d09c227255 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:19.575057 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6cb1a1-f190-4cdb-94c8-f0d09c227255 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:19.575401 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6cb1a1-f190-4cdb-94c8-f0d09c227255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:19.600058 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 775/1553] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:24:19 2022] POST /identity/v3/projects => generated 375 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:24:19.600303 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-4f6cb1a1-f190-4cdb-94c8-f0d09c227255 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:24:19.600303 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-4f6cb1a1-f190-4cdb-94c8-f0d09c227255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:19.600501 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a8f90c-b530-47a8-aa92-f7392885f409 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:19.600501 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a8f90c-b530-47a8-aa92-f7392885f409 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:19.600501 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a8f90c-b530-47a8-aa92-f7392885f409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:19.628408 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-38a8f90c-b530-47a8-aa92-f7392885f409 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:24:19.629620 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-38a8f90c-b530-47a8-aa92-f7392885f409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:19.668277 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 779/1554] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:24:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:24:19.669341 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6cb1a1-f190-4cdb-94c8-f0d09c227255 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:19.678987 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6cb1a1-f190-4cdb-94c8-f0d09c227255 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:19.683607 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc038f4f-dbe7-431a-b814-af61093a3709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:19.684197 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc038f4f-dbe7-431a-b814-af61093a3709 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:19.684476 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc038f4f-dbe7-431a-b814-af61093a3709 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:19.684746 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc038f4f-dbe7-431a-b814-af61093a3709 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:19.685379 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc038f4f-dbe7-431a-b814-af61093a3709 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:19.687534 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc038f4f-dbe7-431a-b814-af61093a3709 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:19.694729 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 776/1555] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:24:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:24:19.694885 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0f8834-97fe-4585-a0cb-14f81503a815 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:19.695322 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0f8834-97fe-4585-a0cb-14f81503a815 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:19.695430 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0f8834-97fe-4585-a0cb-14f81503a815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:19.698655 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 780/1556] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:24:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:24:19.699541 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc038f4f-dbe7-431a-b814-af61093a3709 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:19.711175 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc038f4f-dbe7-431a-b814-af61093a3709 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:19.715789 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90f5798-1a89-427d-8e63-fd4f78cc701c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:19.716378 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f5798-1a89-427d-8e63-fd4f78cc701c admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:19.716659 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f5798-1a89-427d-8e63-fd4f78cc701c admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:19.716931 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f5798-1a89-427d-8e63-fd4f78cc701c admin admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:19.717563 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90f5798-1a89-427d-8e63-fd4f78cc701c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:24:19.717865 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90f5798-1a89-427d-8e63-fd4f78cc701c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:19.718703 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-9d0f8834-97fe-4585-a0cb-14f81503a815 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:24:19.719526 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90f5798-1a89-427d-8e63-fd4f78cc701c admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:19.719875 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-9d0f8834-97fe-4585-a0cb-14f81503a815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:19.727867 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 777/1557] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:24:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:24:19.728630 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:24:19.728950 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c92da6-0d40-4cdc-bd6b-4d748471cba7 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:19.729233 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c92da6-0d40-4cdc-bd6b-4d748471cba7 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:19.729557 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c92da6-0d40-4cdc-bd6b-4d748471cba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:19.736244 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 781/1558] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 15 12:24:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:24:19.737640 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397aef1d-995f-45ac-8505-63a26a36900e None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:19.737922 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397aef1d-995f-45ac-8505-63a26a36900e None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:19.738219 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397aef1d-995f-45ac-8505-63a26a36900e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:19.756823 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-92c92da6-0d40-4cdc-bd6b-4d748471cba7 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:24:19.758023 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-92c92da6-0d40-4cdc-bd6b-4d748471cba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:19.760339 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-397aef1d-995f-45ac-8505-63a26a36900e None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:24:19.761574 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-397aef1d-995f-45ac-8505-63a26a36900e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:19.766470 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 778/1559] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:24:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:24:19.767321 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c92da6-0d40-4cdc-bd6b-4d748471cba7 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:19.770634 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 782/1560] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:24:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:24:19.772088 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf935644-32ee-442f-bb3d-f3cd898b8f78 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:19.772378 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf935644-32ee-442f-bb3d-f3cd898b8f78 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:19.772656 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf935644-32ee-442f-bb3d-f3cd898b8f78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:19.776902 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c92da6-0d40-4cdc-bd6b-4d748471cba7 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:19.781392 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abc330c-da33-46d3-bd76-51255e077bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:19.781971 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abc330c-da33-46d3-bd76-51255e077bcf admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:19.782247 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abc330c-da33-46d3-bd76-51255e077bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:19.782513 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abc330c-da33-46d3-bd76-51255e077bcf admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:19.783163 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abc330c-da33-46d3-bd76-51255e077bcf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:19.785093 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abc330c-da33-46d3-bd76-51255e077bcf admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:19.792328 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-cf935644-32ee-442f-bb3d-f3cd898b8f78 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:24:19.793525 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-cf935644-32ee-442f-bb3d-f3cd898b8f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:19.802839 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 783/1561] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:24:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:24:19.804078 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79435a91-8862-4796-abc8-2bcc69610608 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:19.804367 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79435a91-8862-4796-abc8-2bcc69610608 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:19.804655 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79435a91-8862-4796-abc8-2bcc69610608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:19.807298 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 779/1562] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:24:19 2022] POST /identity/v3/users => generated 288 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:24:19.807986 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abc330c-da33-46d3-bd76-51255e077bcf admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:19.815032 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:24:19.819158 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abc330c-da33-46d3-bd76-51255e077bcf admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:19.825226 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458ec2ac-d797-411b-8e23-3a471d895eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:19.825908 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458ec2ac-d797-411b-8e23-3a471d895eaa admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:19.826390 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458ec2ac-d797-411b-8e23-3a471d895eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:19.826931 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458ec2ac-d797-411b-8e23-3a471d895eaa admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:19.827732 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-79435a91-8862-4796-abc8-2bcc69610608 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:24:19.828340 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458ec2ac-d797-411b-8e23-3a471d895eaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:19.829413 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-79435a91-8862-4796-abc8-2bcc69610608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:19.830113 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458ec2ac-d797-411b-8e23-3a471d895eaa admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:19.837656 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 784/1563] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:24:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:24:19.838604 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79435a91-8862-4796-abc8-2bcc69610608 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:19.847437 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 780/1564] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:24:19 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:24:19.847437 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458ec2ac-d797-411b-8e23-3a471d895eaa admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:19.848194 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79435a91-8862-4796-abc8-2bcc69610608 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:19.852804 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00362bf6-43dc-47cf-9c5f-aeb8dad96e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:19.853391 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00362bf6-43dc-47cf-9c5f-aeb8dad96e82 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:19.853668 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00362bf6-43dc-47cf-9c5f-aeb8dad96e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:19.853939 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00362bf6-43dc-47cf-9c5f-aeb8dad96e82 admin admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:19.854577 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00362bf6-43dc-47cf-9c5f-aeb8dad96e82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:24:19.854718 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458ec2ac-d797-411b-8e23-3a471d895eaa admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:19.854908 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00362bf6-43dc-47cf-9c5f-aeb8dad96e82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:19.856485 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00362bf6-43dc-47cf-9c5f-aeb8dad96e82 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:19.859278 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5775203b-9fe9-4f82-8697-5c5f7a3bfe56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:19.859852 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5775203b-9fe9-4f82-8697-5c5f7a3bfe56 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:19.860134 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5775203b-9fe9-4f82-8697-5c5f7a3bfe56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:19.860406 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5775203b-9fe9-4f82-8697-5c5f7a3bfe56 admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:19.861023 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5775203b-9fe9-4f82-8697-5c5f7a3bfe56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:19.863054 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5775203b-9fe9-4f82-8697-5c5f7a3bfe56 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:19.868409 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 785/1565] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 15 12:24:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:24:19.869345 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00362bf6-43dc-47cf-9c5f-aeb8dad96e82 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:19.879643 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00362bf6-43dc-47cf-9c5f-aeb8dad96e82 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:19.884802 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1993c86f-99a5-4048-a1ea-46e63b263675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:19.885396 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1993c86f-99a5-4048-a1ea-46e63b263675 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:19.885673 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1993c86f-99a5-4048-a1ea-46e63b263675 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:19.885975 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1993c86f-99a5-4048-a1ea-46e63b263675 admin admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:19.886616 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1993c86f-99a5-4048-a1ea-46e63b263675 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:24:19.886953 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1993c86f-99a5-4048-a1ea-46e63b263675 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:19.888537 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1993c86f-99a5-4048-a1ea-46e63b263675 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:19.902668 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 781/1566] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:24:19 2022] POST /identity/v3/projects => generated 385 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:24:19.903525 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5775203b-9fe9-4f82-8697-5c5f7a3bfe56 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:19.913008 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 786/1567] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 15 12:24:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:24:19.913008 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1993c86f-99a5-4048-a1ea-46e63b263675 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:19.918586 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1993c86f-99a5-4048-a1ea-46e63b263675 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:19.977844 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ecb47a-6c02-43c3-b9ef-4de532109f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:19.978120 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5775203b-9fe9-4f82-8697-5c5f7a3bfe56 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:19.978571 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ecb47a-6c02-43c3-b9ef-4de532109f1a admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:19.978736 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ecb47a-6c02-43c3-b9ef-4de532109f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:19.979008 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ecb47a-6c02-43c3-b9ef-4de532109f1a admin admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:19.979648 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ecb47a-6c02-43c3-b9ef-4de532109f1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:24:19.979948 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ecb47a-6c02-43c3-b9ef-4de532109f1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:19.981555 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ecb47a-6c02-43c3-b9ef-4de532109f1a admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:19.983282 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a7817d-c25a-4f17-bfab-228aab16aa11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:19.984417 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7817d-c25a-4f17-bfab-228aab16aa11 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:19.984696 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7817d-c25a-4f17-bfab-228aab16aa11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:19.984969 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7817d-c25a-4f17-bfab-228aab16aa11 admin admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:19.985606 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a7817d-c25a-4f17-bfab-228aab16aa11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:24:19.985905 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a7817d-c25a-4f17-bfab-228aab16aa11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:19.987551 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a7817d-c25a-4f17-bfab-228aab16aa11 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:19.993988 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 787/1568] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 15 12:24:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:24:19.995619 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ecb47a-6c02-43c3-b9ef-4de532109f1a admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:20.000143 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 782/1569] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 15 12:24:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:24:20.000885 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a7817d-c25a-4f17-bfab-228aab16aa11 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:20.010439 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ecb47a-6c02-43c3-b9ef-4de532109f1a admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:20.011113 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a7817d-c25a-4f17-bfab-228aab16aa11 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:20.015764 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d8945b-764a-4037-a837-68b47f77a416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:20.015922 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc75b4c-361c-4ca0-ba91-53f60dbde67d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:20.016356 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d8945b-764a-4037-a837-68b47f77a416 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:20.016490 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc75b4c-361c-4ca0-ba91-53f60dbde67d admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:20.016631 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc75b4c-361c-4ca0-ba91-53f60dbde67d admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:20.016736 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d8945b-764a-4037-a837-68b47f77a416 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:20.016898 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc75b4c-361c-4ca0-ba91-53f60dbde67d admin admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:20.017007 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d8945b-764a-4037-a837-68b47f77a416 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:20.017526 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc75b4c-361c-4ca0-ba91-53f60dbde67d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:24:20.017647 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d8945b-764a-4037-a837-68b47f77a416 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:20.017826 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc75b4c-361c-4ca0-ba91-53f60dbde67d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:20.019167 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d8945b-764a-4037-a837-68b47f77a416 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:20.019471 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc75b4c-361c-4ca0-ba91-53f60dbde67d admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:20.029588 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 788/1570] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:24:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:24:20.030367 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d8945b-764a-4037-a837-68b47f77a416 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:20.039243 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 783/1571] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 15 12:24:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:24:20.039243 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc75b4c-361c-4ca0-ba91-53f60dbde67d admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:20.041959 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d8945b-764a-4037-a837-68b47f77a416 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:20.043120 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc75b4c-361c-4ca0-ba91-53f60dbde67d admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:20.048016 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1bd7c2-c5bf-4da6-b9ae-e05be74bb04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:20.048016 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1bd7c2-c5bf-4da6-b9ae-e05be74bb04e admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:20.049363 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1bd7c2-c5bf-4da6-b9ae-e05be74bb04e admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:20.049363 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1bd7c2-c5bf-4da6-b9ae-e05be74bb04e admin admin] PATH_INFO: `/v3/projects/a7cff15dfaaf4708be5432039c412c59/users/fc120edcf30a4775a502c8e31811da4e/roles/9371e5bbc55848949eb951a815f817f2` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:20.049578 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2feb30-c46d-4cf7-b7b4-2527eb9c6929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:20.049680 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2feb30-c46d-4cf7-b7b4-2527eb9c6929 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:20.049913 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2feb30-c46d-4cf7-b7b4-2527eb9c6929 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:20.050187 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2feb30-c46d-4cf7-b7b4-2527eb9c6929 admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:20.050821 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2feb30-c46d-4cf7-b7b4-2527eb9c6929 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:20.052706 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2feb30-c46d-4cf7-b7b4-2527eb9c6929 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:20.064305 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1bd7c2-c5bf-4da6-b9ae-e05be74bb04e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7cff15dfaaf4708be5432039c412c59, user_id=fc120edcf30a4775a502c8e31811da4e, role_id=9371e5bbc55848949eb951a815f817f2)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:20.066947 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1bd7c2-c5bf-4da6-b9ae-e05be74bb04e admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:20.080662 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 789/1572] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:24:20 2022] PUT /identity/v3/projects/a7cff15dfaaf4708be5432039c412c59/users/fc120edcf30a4775a502c8e31811da4e/roles/9371e5bbc55848949eb951a815f817f2 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:24:20.084323 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 784/1573] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:24:20 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:24:20.084458 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1bd7c2-c5bf-4da6-b9ae-e05be74bb04e admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:20.084557 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2feb30-c46d-4cf7-b7b4-2527eb9c6929 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:20.146495 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1bd7c2-c5bf-4da6-b9ae-e05be74bb04e admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:20.148279 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2feb30-c46d-4cf7-b7b4-2527eb9c6929 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:20.151083 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7258d6b0-6f95-45fa-b244-c42f4553034c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:20.151692 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7258d6b0-6f95-45fa-b244-c42f4553034c admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:20.151945 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7258d6b0-6f95-45fa-b244-c42f4553034c admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:20.152215 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7258d6b0-6f95-45fa-b244-c42f4553034c admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:20.152837 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7258d6b0-6f95-45fa-b244-c42f4553034c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:20.152958 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f614a86-5916-4b81-99a6-93bf2941295e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:20.153434 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f614a86-5916-4b81-99a6-93bf2941295e admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:20.153711 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f614a86-5916-4b81-99a6-93bf2941295e admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:20.153836 dv-cinder-850836-7-smb devstack@keystone.service[81374]: WARNING py.warnings [None req-7258d6b0-6f95-45fa-b244-c42f4553034c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 12:24:20.153836 dv-cinder-850836-7-smb devstack@keystone.service[81374]: warnings.warn(msg) Sep 15 12:24:20.153836 dv-cinder-850836-7-smb devstack@keystone.service[81374]: Sep 15 12:24:20.154112 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f614a86-5916-4b81-99a6-93bf2941295e admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:20.154592 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f614a86-5916-4b81-99a6-93bf2941295e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:20.155053 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7258d6b0-6f95-45fa-b244-c42f4553034c admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:20.156511 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f614a86-5916-4b81-99a6-93bf2941295e admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:20.178233 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 790/1574] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:24:20 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:24:20.178993 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7258d6b0-6f95-45fa-b244-c42f4553034c admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:20.183731 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:24:20.185633 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 785/1575] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:24:20 2022] POST /identity/v3/projects => generated 373 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:24:20.186597 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f614a86-5916-4b81-99a6-93bf2941295e admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:20.190733 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7258d6b0-6f95-45fa-b244-c42f4553034c admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:20.206849 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:24:20.250643 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb1dff0-1519-4583-a96f-138a4c02d2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:20.251284 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb1dff0-1519-4583-a96f-138a4c02d2c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:20.251563 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb1dff0-1519-4583-a96f-138a4c02d2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:20.252089 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb1dff0-1519-4583-a96f-138a4c02d2c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:20.252719 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb1dff0-1519-4583-a96f-138a4c02d2c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:20.254622 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb1dff0-1519-4583-a96f-138a4c02d2c7 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:20.256784 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f614a86-5916-4b81-99a6-93bf2941295e admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:20.261867 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc05e35-a482-4fff-8eab-87e5534eedbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:20.262470 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc05e35-a482-4fff-8eab-87e5534eedbb admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:20.262781 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc05e35-a482-4fff-8eab-87e5534eedbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:20.263057 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc05e35-a482-4fff-8eab-87e5534eedbb admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:20.263682 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc05e35-a482-4fff-8eab-87e5534eedbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:20.265622 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc05e35-a482-4fff-8eab-87e5534eedbb admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:20.283495 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 791/1576] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:24:20 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:24:20.284512 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb1dff0-1519-4583-a96f-138a4c02d2c7 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:20.297605 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 786/1577] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:24:20 2022] POST /identity/v3/projects => generated 377 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:24:20.298896 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc05e35-a482-4fff-8eab-87e5534eedbb admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:20.347605 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb1dff0-1519-4583-a96f-138a4c02d2c7 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:20.361580 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc05e35-a482-4fff-8eab-87e5534eedbb admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:20.366099 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf320bd-cb00-4893-b26b-26d939e39be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:20.366839 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf320bd-cb00-4893-b26b-26d939e39be5 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:20.367105 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf320bd-cb00-4893-b26b-26d939e39be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:20.367372 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf320bd-cb00-4893-b26b-26d939e39be5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:20.367993 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf320bd-cb00-4893-b26b-26d939e39be5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:20.369902 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf320bd-cb00-4893-b26b-26d939e39be5 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:20.399954 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 787/1578] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:24:20 2022] POST /identity/v3/projects => generated 389 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:24:20.399954 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf320bd-cb00-4893-b26b-26d939e39be5 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:20.406371 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640e1016-03db-40c4-89b2-3b5fc5b1bdf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:20.407171 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e1016-03db-40c4-89b2-3b5fc5b1bdf5 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:20.407449 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e1016-03db-40c4-89b2-3b5fc5b1bdf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:20.407715 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e1016-03db-40c4-89b2-3b5fc5b1bdf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:20.408359 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640e1016-03db-40c4-89b2-3b5fc5b1bdf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:20.409948 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640e1016-03db-40c4-89b2-3b5fc5b1bdf5 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:20.420205 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 792/1579] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:24:20 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:24:20.422081 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cea27b-fbe2-443a-a7f7-57b42b093937 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:20.422359 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cea27b-fbe2-443a-a7f7-57b42b093937 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:20.422656 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cea27b-fbe2-443a-a7f7-57b42b093937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:20.440751 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-24cea27b-fbe2-443a-a7f7-57b42b093937 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:24:20.441937 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-24cea27b-fbe2-443a-a7f7-57b42b093937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:20.460026 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf320bd-cb00-4893-b26b-26d939e39be5 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:20.464908 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b77a29-69fa-47e5-af48-d608bd35d9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:20.465639 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b77a29-69fa-47e5-af48-d608bd35d9c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:20.465944 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b77a29-69fa-47e5-af48-d608bd35d9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:20.466237 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b77a29-69fa-47e5-af48-d608bd35d9c0 admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:20.466890 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b77a29-69fa-47e5-af48-d608bd35d9c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:20.467408 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:24:20.469461 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b77a29-69fa-47e5-af48-d608bd35d9c0 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:20.492043 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 788/1580] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:24:20 2022] POST /identity/v3/users => generated 286 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:24:20.492883 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b77a29-69fa-47e5-af48-d608bd35d9c0 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:20.502420 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b77a29-69fa-47e5-af48-d608bd35d9c0 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:20.505892 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 793/1581] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:24:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:24:20.506715 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cea27b-fbe2-443a-a7f7-57b42b093937 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:20.507451 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a4b744-f992-46a4-8535-a975d55bee11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:20.508039 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a4b744-f992-46a4-8535-a975d55bee11 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:20.508343 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a4b744-f992-46a4-8535-a975d55bee11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:20.508619 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a4b744-f992-46a4-8535-a975d55bee11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:20.509254 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a4b744-f992-46a4-8535-a975d55bee11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:20.511090 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a4b744-f992-46a4-8535-a975d55bee11 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:20.515602 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cea27b-fbe2-443a-a7f7-57b42b093937 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:20.520346 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad25d11-d688-4924-9507-ccc72413e2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:20.520931 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad25d11-d688-4924-9507-ccc72413e2ed admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:20.521212 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad25d11-d688-4924-9507-ccc72413e2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:20.521480 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad25d11-d688-4924-9507-ccc72413e2ed admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:20.521910 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 789/1582] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:24:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:24:20.522103 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad25d11-d688-4924-9507-ccc72413e2ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:20.522593 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a4b744-f992-46a4-8535-a975d55bee11 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:20.524117 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad25d11-d688-4924-9507-ccc72413e2ed admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:20.528433 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:24:20.532844 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a4b744-f992-46a4-8535-a975d55bee11 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:20.539239 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436ef0e0-deb2-4dcc-8bb8-726a3b4541a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:20.539878 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ef0e0-deb2-4dcc-8bb8-726a3b4541a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:20.540260 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ef0e0-deb2-4dcc-8bb8-726a3b4541a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:20.540759 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ef0e0-deb2-4dcc-8bb8-726a3b4541a7 admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:20.541731 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436ef0e0-deb2-4dcc-8bb8-726a3b4541a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:20.543706 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436ef0e0-deb2-4dcc-8bb8-726a3b4541a7 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:20.547009 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 794/1583] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:24:20 2022] POST /identity/v3/users => generated 287 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:24:20.547818 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad25d11-d688-4924-9507-ccc72413e2ed admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:20.557480 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad25d11-d688-4924-9507-ccc72413e2ed admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:20.562921 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b200cf-b945-4c27-b34e-d450f28d1d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:20.563509 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b200cf-b945-4c27-b34e-d450f28d1d44 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:20.563792 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b200cf-b945-4c27-b34e-d450f28d1d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:20.564065 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b200cf-b945-4c27-b34e-d450f28d1d44 admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:20.564687 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b200cf-b945-4c27-b34e-d450f28d1d44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:20.566339 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 790/1584] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:24:20 2022] POST /identity/v3/users => generated 293 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:24:20.566583 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b200cf-b945-4c27-b34e-d450f28d1d44 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:20.567185 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436ef0e0-deb2-4dcc-8bb8-726a3b4541a7 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:20.578630 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436ef0e0-deb2-4dcc-8bb8-726a3b4541a7 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:20.584062 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13094121-3b8c-4bb5-b937-0f8af71d0965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:20.584631 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13094121-3b8c-4bb5-b937-0f8af71d0965 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:20.584906 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13094121-3b8c-4bb5-b937-0f8af71d0965 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:20.585168 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13094121-3b8c-4bb5-b937-0f8af71d0965 admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:20.585778 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13094121-3b8c-4bb5-b937-0f8af71d0965 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:20.587708 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13094121-3b8c-4bb5-b937-0f8af71d0965 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:20.588605 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 795/1585] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:24:20 2022] POST /identity/v3/users => generated 289 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:24:20.589390 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b200cf-b945-4c27-b34e-d450f28d1d44 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:20.599306 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b200cf-b945-4c27-b34e-d450f28d1d44 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:20.604866 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab287b9b-483c-420c-8a5e-d22f2462d706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:20.605502 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab287b9b-483c-420c-8a5e-d22f2462d706 admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:20.605778 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab287b9b-483c-420c-8a5e-d22f2462d706 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:20.606048 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab287b9b-483c-420c-8a5e-d22f2462d706 admin admin] PATH_INFO: `/v3/projects/f0f9839b0e4d45058682c06b06a9e128/users/696045dfc2bb4dcebd18f22e69ac14b3/roles/9371e5bbc55848949eb951a815f817f2` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:20.613536 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 791/1586] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:24:20 2022] POST /identity/v3/users => generated 295 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:24:20.614386 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13094121-3b8c-4bb5-b937-0f8af71d0965 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:20.621062 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab287b9b-483c-420c-8a5e-d22f2462d706 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0f9839b0e4d45058682c06b06a9e128, user_id=696045dfc2bb4dcebd18f22e69ac14b3, role_id=9371e5bbc55848949eb951a815f817f2)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:20.623799 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab287b9b-483c-420c-8a5e-d22f2462d706 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:20.626127 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13094121-3b8c-4bb5-b937-0f8af71d0965 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:20.631764 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e69e3-a00d-4922-a1d5-1e2c47d57637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:20.632472 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e69e3-a00d-4922-a1d5-1e2c47d57637 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:20.632774 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e69e3-a00d-4922-a1d5-1e2c47d57637 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:20.633051 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e69e3-a00d-4922-a1d5-1e2c47d57637 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:20.633743 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7e69e3-a00d-4922-a1d5-1e2c47d57637 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:20.635589 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7e69e3-a00d-4922-a1d5-1e2c47d57637 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:20.638930 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 796/1587] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:24:20 2022] PUT /identity/v3/projects/f0f9839b0e4d45058682c06b06a9e128/users/696045dfc2bb4dcebd18f22e69ac14b3/roles/9371e5bbc55848949eb951a815f817f2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:24:20.639720 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab287b9b-483c-420c-8a5e-d22f2462d706 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:20.648497 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 792/1588] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:24:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:24:20.648497 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e69e3-a00d-4922-a1d5-1e2c47d57637 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:20.656408 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e69e3-a00d-4922-a1d5-1e2c47d57637 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:20.709116 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab287b9b-483c-420c-8a5e-d22f2462d706 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:20.712656 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a0181a-e55c-42f9-8cb3-2901783e5de8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:20.712998 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27792fa-6ad8-4f8b-84d5-f4b3faf8df3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:20.713263 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a0181a-e55c-42f9-8cb3-2901783e5de8 service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:20.713543 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a0181a-e55c-42f9-8cb3-2901783e5de8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:20.713654 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27792fa-6ad8-4f8b-84d5-f4b3faf8df3d admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:20.713821 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a0181a-e55c-42f9-8cb3-2901783e5de8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:20.713951 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27792fa-6ad8-4f8b-84d5-f4b3faf8df3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:20.714227 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27792fa-6ad8-4f8b-84d5-f4b3faf8df3d admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:20.714889 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27792fa-6ad8-4f8b-84d5-f4b3faf8df3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:20.716530 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27792fa-6ad8-4f8b-84d5-f4b3faf8df3d admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:20.723519 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a0181a-e55c-42f9-8cb3-2901783e5de8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:20.724934 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a0181a-e55c-42f9-8cb3-2901783e5de8 service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:20.727494 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 793/1589] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:24:20 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:24:20.728280 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27792fa-6ad8-4f8b-84d5-f4b3faf8df3d admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:20.737205 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 797/1590] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:24:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:24:20.738074 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a0181a-e55c-42f9-8cb3-2901783e5de8 service neutron] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:20.740316 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27792fa-6ad8-4f8b-84d5-f4b3faf8df3d admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:20.745141 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe18e00-77ab-455d-bcd9-367e9b3e82d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:20.745734 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe18e00-77ab-455d-bcd9-367e9b3e82d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:20.746015 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe18e00-77ab-455d-bcd9-367e9b3e82d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:20.746286 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe18e00-77ab-455d-bcd9-367e9b3e82d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:20.746955 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe18e00-77ab-455d-bcd9-367e9b3e82d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:20.747217 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a0181a-e55c-42f9-8cb3-2901783e5de8 service neutron] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:20.748550 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe18e00-77ab-455d-bcd9-367e9b3e82d9 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:20.753475 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4683a10-9ed3-4bee-bf45-b4e4afbb1fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:20.754067 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4683a10-9ed3-4bee-bf45-b4e4afbb1fb3 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:20.754347 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4683a10-9ed3-4bee-bf45-b4e4afbb1fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:20.754622 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4683a10-9ed3-4bee-bf45-b4e4afbb1fb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:20.755291 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4683a10-9ed3-4bee-bf45-b4e4afbb1fb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:20.757795 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4683a10-9ed3-4bee-bf45-b4e4afbb1fb3 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:20.759836 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 794/1591] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:24:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:24:20.760497 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe18e00-77ab-455d-bcd9-367e9b3e82d9 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:20.773970 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 798/1592] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:24:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:24:20.774308 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe18e00-77ab-455d-bcd9-367e9b3e82d9 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:20.775783 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4683a10-9ed3-4bee-bf45-b4e4afbb1fb3 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:20.779016 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731411f7-7249-4954-a3a0-321180daaa78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:20.779693 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731411f7-7249-4954-a3a0-321180daaa78 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:20.780039 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731411f7-7249-4954-a3a0-321180daaa78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:20.780378 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731411f7-7249-4954-a3a0-321180daaa78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:20.781151 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731411f7-7249-4954-a3a0-321180daaa78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:20.783013 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731411f7-7249-4954-a3a0-321180daaa78 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:20.787121 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4683a10-9ed3-4bee-bf45-b4e4afbb1fb3 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:20.792724 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e1fc16-8970-4442-a312-a9d985813c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:20.793253 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e1fc16-8970-4442-a312-a9d985813c01 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:20.797165 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 795/1593] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:24:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:24:20.797332 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e1fc16-8970-4442-a312-a9d985813c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:20.797332 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e1fc16-8970-4442-a312-a9d985813c01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:20.797545 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731411f7-7249-4954-a3a0-321180daaa78 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:20.797648 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e1fc16-8970-4442-a312-a9d985813c01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:20.797648 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e1fc16-8970-4442-a312-a9d985813c01 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:20.808699 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731411f7-7249-4954-a3a0-321180daaa78 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:20.814953 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 799/1594] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:24:20 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:24:20.814953 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64713896-7662-4bc8-85fb-b40fead20386 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:20.814953 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64713896-7662-4bc8-85fb-b40fead20386 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:20.814953 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64713896-7662-4bc8-85fb-b40fead20386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:20.815961 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f3dde0-c9f4-4036-ad51-8d16f5ab97a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:20.815961 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f3dde0-c9f4-4036-ad51-8d16f5ab97a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:20.815961 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f3dde0-c9f4-4036-ad51-8d16f5ab97a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:20.816214 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f3dde0-c9f4-4036-ad51-8d16f5ab97a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:20.816953 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f3dde0-c9f4-4036-ad51-8d16f5ab97a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:20.818710 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f3dde0-c9f4-4036-ad51-8d16f5ab97a8 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:20.836056 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 796/1595] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:24:20 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:24:20.836056 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f3dde0-c9f4-4036-ad51-8d16f5ab97a8 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:20.846844 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f3dde0-c9f4-4036-ad51-8d16f5ab97a8 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:20.851485 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710d1521-cbdb-42ca-b3f3-c46574f54d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:20.852142 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d1521-cbdb-42ca-b3f3-c46574f54d72 admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:20.852279 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-64713896-7662-4bc8-85fb-b40fead20386 None None] MFA Rules not processed for user `696045dfc2bb4dcebd18f22e69ac14b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:24:20.852434 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d1521-cbdb-42ca-b3f3-c46574f54d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:20.852683 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d1521-cbdb-42ca-b3f3-c46574f54d72 admin admin] PATH_INFO: `/v3/projects/353be637e4bc48858ac4b476c00e6801/users/983e501359234b31879e5cdfb34ea31a/roles/9371e5bbc55848949eb951a815f817f2` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:20.853474 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-64713896-7662-4bc8-85fb-b40fead20386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:20.868119 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710d1521-cbdb-42ca-b3f3-c46574f54d72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=353be637e4bc48858ac4b476c00e6801, user_id=983e501359234b31879e5cdfb34ea31a, role_id=9371e5bbc55848949eb951a815f817f2)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:20.869176 dv-cinder-850836-7-smb devstack@keystone.service[81375]: WARNING py.warnings [None req-710d1521-cbdb-42ca-b3f3-c46574f54d72 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 12:24:20.869176 dv-cinder-850836-7-smb devstack@keystone.service[81375]: warnings.warn(msg) Sep 15 12:24:20.869176 dv-cinder-850836-7-smb devstack@keystone.service[81375]: Sep 15 12:24:20.871373 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710d1521-cbdb-42ca-b3f3-c46574f54d72 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:20.891219 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 797/1596] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:24:20 2022] PUT /identity/v3/projects/353be637e4bc48858ac4b476c00e6801/users/983e501359234b31879e5cdfb34ea31a/roles/9371e5bbc55848949eb951a815f817f2 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:24:20.892020 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710d1521-cbdb-42ca-b3f3-c46574f54d72 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:20.902000 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:24:20.942465 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 800/1597] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:24:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:24:20.943715 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64713896-7662-4bc8-85fb-b40fead20386 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:20.968255 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64713896-7662-4bc8-85fb-b40fead20386 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:20.982336 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:24:20.991858 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710d1521-cbdb-42ca-b3f3-c46574f54d72 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:21.001054 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec6e1e0-5051-4946-a532-3cd8aaa2aed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:21.002592 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6e1e0-5051-4946-a532-3cd8aaa2aed0 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:21.002977 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6e1e0-5051-4946-a532-3cd8aaa2aed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:21.003251 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6e1e0-5051-4946-a532-3cd8aaa2aed0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:21.004300 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec6e1e0-5051-4946-a532-3cd8aaa2aed0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:21.006250 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec6e1e0-5051-4946-a532-3cd8aaa2aed0 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:21.021486 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 798/1598] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:24:20 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:24:21.021486 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec6e1e0-5051-4946-a532-3cd8aaa2aed0 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:21.030162 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec6e1e0-5051-4946-a532-3cd8aaa2aed0 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:21.035532 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a7e62f-4296-4fe2-a361-8b30fdb60235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:21.036131 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a7e62f-4296-4fe2-a361-8b30fdb60235 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:21.036737 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a7e62f-4296-4fe2-a361-8b30fdb60235 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:21.036906 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a7e62f-4296-4fe2-a361-8b30fdb60235 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:21.037625 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a7e62f-4296-4fe2-a361-8b30fdb60235 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:21.039553 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a7e62f-4296-4fe2-a361-8b30fdb60235 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:21.048266 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2926f1a6-2287-455e-95b5-e6a3a0a76ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:21.049323 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2926f1a6-2287-455e-95b5-e6a3a0a76ea8 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:21.049323 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2926f1a6-2287-455e-95b5-e6a3a0a76ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:21.050019 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2926f1a6-2287-455e-95b5-e6a3a0a76ea8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:21.050332 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2926f1a6-2287-455e-95b5-e6a3a0a76ea8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:21.052049 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2926f1a6-2287-455e-95b5-e6a3a0a76ea8 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:21.056017 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 799/1599] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:24:21 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:24:21.059809 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a7e62f-4296-4fe2-a361-8b30fdb60235 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:21.065673 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 801/1600] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:24:20 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:24:21.071298 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2926f1a6-2287-455e-95b5-e6a3a0a76ea8 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:21.077277 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a7e62f-4296-4fe2-a361-8b30fdb60235 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:21.083063 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2926f1a6-2287-455e-95b5-e6a3a0a76ea8 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:21.088673 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa55ab2d-631c-49c3-a96d-4de27964b1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:21.089182 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c0a577-99b5-4e99-8ae5-ecab2ea927a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:21.089342 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa55ab2d-631c-49c3-a96d-4de27964b1dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:21.089730 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa55ab2d-631c-49c3-a96d-4de27964b1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:21.089841 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c0a577-99b5-4e99-8ae5-ecab2ea927a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:21.090011 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa55ab2d-631c-49c3-a96d-4de27964b1dd admin admin] PATH_INFO: `/v3/projects/4f7f4219a89c43c8ac6a5325158e9cbe/users/3316d4923d474fbb8da1ea1577050745/roles/9371e5bbc55848949eb951a815f817f2` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:21.090178 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c0a577-99b5-4e99-8ae5-ecab2ea927a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:21.090332 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c0a577-99b5-4e99-8ae5-ecab2ea927a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:21.091031 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c0a577-99b5-4e99-8ae5-ecab2ea927a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:21.092718 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c0a577-99b5-4e99-8ae5-ecab2ea927a3 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:21.104740 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 800/1601] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:24:21 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:24:21.106369 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a439eb4-8074-439b-ae22-0f10f543d7ae None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:21.106742 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a439eb4-8074-439b-ae22-0f10f543d7ae None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:21.107358 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a439eb4-8074-439b-ae22-0f10f543d7ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:21.110052 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa55ab2d-631c-49c3-a96d-4de27964b1dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f7f4219a89c43c8ac6a5325158e9cbe, user_id=3316d4923d474fbb8da1ea1577050745, role_id=9371e5bbc55848949eb951a815f817f2)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:21.113438 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa55ab2d-631c-49c3-a96d-4de27964b1dd admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:21.132227 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-0a439eb4-8074-439b-ae22-0f10f543d7ae None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:24:21.133592 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-0a439eb4-8074-439b-ae22-0f10f543d7ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:21.144936 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 802/1602] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:24:21 2022] PUT /identity/v3/projects/4f7f4219a89c43c8ac6a5325158e9cbe/users/3316d4923d474fbb8da1ea1577050745/roles/9371e5bbc55848949eb951a815f817f2 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:24:21.144936 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7dfa8c-c224-48a6-8bd5-2c8f1018e7ed None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:21.144936 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7dfa8c-c224-48a6-8bd5-2c8f1018e7ed None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:21.144936 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7dfa8c-c224-48a6-8bd5-2c8f1018e7ed None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:21.144936 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 803/1603] 10.222.0.16 () {54 vars in 962 bytes} [Thu Sep 15 12:24:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:24:21.144936 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7dfa8c-c224-48a6-8bd5-2c8f1018e7ed None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:21.215962 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 801/1604] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:24:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:24:21.216960 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a439eb4-8074-439b-ae22-0f10f543d7ae None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:21.227974 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a439eb4-8074-439b-ae22-0f10f543d7ae None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:21.233071 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c49c02-74d8-42d7-877e-7f3359f48d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:21.233815 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c49c02-74d8-42d7-877e-7f3359f48d4b admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:21.234628 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c49c02-74d8-42d7-877e-7f3359f48d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:21.234935 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c49c02-74d8-42d7-877e-7f3359f48d4b admin admin] PATH_INFO: `/v3/projects/633c28b3d08c430b91c8921ec4bbe617/users/218bb1de31574611b85b60851252bc8a/roles/9371e5bbc55848949eb951a815f817f2` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:21.241372 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7dfa8c-c224-48a6-8bd5-2c8f1018e7ed None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:21.245940 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc5dccb-3a34-46d0-b7e4-eea5a6a1a901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:21.246595 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc5dccb-3a34-46d0-b7e4-eea5a6a1a901 admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:21.247191 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc5dccb-3a34-46d0-b7e4-eea5a6a1a901 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:21.247191 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc5dccb-3a34-46d0-b7e4-eea5a6a1a901 admin admin] PATH_INFO: `/v3/projects/8f4fd80042fc40239c3d122a8251bf57/users/74811d83f5924dfbaa0866a2a48ca281/roles/9371e5bbc55848949eb951a815f817f2` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:21.252650 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c49c02-74d8-42d7-877e-7f3359f48d4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=633c28b3d08c430b91c8921ec4bbe617, user_id=218bb1de31574611b85b60851252bc8a, role_id=9371e5bbc55848949eb951a815f817f2)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:21.255512 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c49c02-74d8-42d7-877e-7f3359f48d4b admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:21.266315 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc5dccb-3a34-46d0-b7e4-eea5a6a1a901 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f4fd80042fc40239c3d122a8251bf57, user_id=74811d83f5924dfbaa0866a2a48ca281, role_id=9371e5bbc55848949eb951a815f817f2)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:21.268989 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc5dccb-3a34-46d0-b7e4-eea5a6a1a901 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:21.272254 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 802/1605] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:24:21 2022] PUT /identity/v3/projects/633c28b3d08c430b91c8921ec4bbe617/users/218bb1de31574611b85b60851252bc8a/roles/9371e5bbc55848949eb951a815f817f2 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:24:21.273148 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c49c02-74d8-42d7-877e-7f3359f48d4b admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:21.286474 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 804/1606] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:24:21 2022] PUT /identity/v3/projects/8f4fd80042fc40239c3d122a8251bf57/users/74811d83f5924dfbaa0866a2a48ca281/roles/9371e5bbc55848949eb951a815f817f2 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:24:21.287605 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc5dccb-3a34-46d0-b7e4-eea5a6a1a901 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:21.335270 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:24:21.356232 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c49c02-74d8-42d7-877e-7f3359f48d4b admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:21.361627 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03dc8ad-17ca-46fe-9839-12d9b98218dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:21.362381 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03dc8ad-17ca-46fe-9839-12d9b98218dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:21.362577 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03dc8ad-17ca-46fe-9839-12d9b98218dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:21.362886 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03dc8ad-17ca-46fe-9839-12d9b98218dd admin admin] PATH_INFO: `/v3/projects/bed2e6937b8248f08dc4438f6b0f5f48/users/c4838e194e77413cb03c4a622cf51e0c/roles/9371e5bbc55848949eb951a815f817f2` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:21.363001 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc5dccb-3a34-46d0-b7e4-eea5a6a1a901 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:21.369113 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a37c109-0f1a-483d-95a5-a7c85c38445c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:21.370121 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37c109-0f1a-483d-95a5-a7c85c38445c admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:21.370513 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37c109-0f1a-483d-95a5-a7c85c38445c admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:21.370929 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37c109-0f1a-483d-95a5-a7c85c38445c admin admin] PATH_INFO: `/v3/projects/d012e88554bf4c479f55c6a082e5749b/users/2c5895375da54d2e9b51d59de4f98fe7/roles/9371e5bbc55848949eb951a815f817f2` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:21.378114 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03dc8ad-17ca-46fe-9839-12d9b98218dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=bed2e6937b8248f08dc4438f6b0f5f48, user_id=c4838e194e77413cb03c4a622cf51e0c, role_id=9371e5bbc55848949eb951a815f817f2)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:21.381037 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03dc8ad-17ca-46fe-9839-12d9b98218dd admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:21.390797 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a37c109-0f1a-483d-95a5-a7c85c38445c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d012e88554bf4c479f55c6a082e5749b, user_id=2c5895375da54d2e9b51d59de4f98fe7, role_id=9371e5bbc55848949eb951a815f817f2)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:21.395998 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a37c109-0f1a-483d-95a5-a7c85c38445c admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:21.397939 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 803/1607] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:24:21 2022] PUT /identity/v3/projects/bed2e6937b8248f08dc4438f6b0f5f48/users/c4838e194e77413cb03c4a622cf51e0c/roles/9371e5bbc55848949eb951a815f817f2 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:24:21.399681 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbbc17b-beee-42a0-9a75-ec4678c90965 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:21.400190 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbbc17b-beee-42a0-9a75-ec4678c90965 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:21.400590 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbbc17b-beee-42a0-9a75-ec4678c90965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:21.421174 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 805/1608] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:24:21 2022] PUT /identity/v3/projects/d012e88554bf4c479f55c6a082e5749b/users/2c5895375da54d2e9b51d59de4f98fe7/roles/9371e5bbc55848949eb951a815f817f2 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:24:21.423023 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2d3728-7021-4620-97b6-4fddbf187796 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:21.423302 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2d3728-7021-4620-97b6-4fddbf187796 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:21.423571 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2d3728-7021-4620-97b6-4fddbf187796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:21.448096 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-6cbbc17b-beee-42a0-9a75-ec4678c90965 None None] MFA Rules not processed for user `3316d4923d474fbb8da1ea1577050745`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:24:21.449485 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-6cbbc17b-beee-42a0-9a75-ec4678c90965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:21.480314 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:24:21.487235 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-af2d3728-7021-4620-97b6-4fddbf187796 None None] MFA Rules not processed for user `9d05c52570474820b4ba0e2cdad5c13f`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:24:21.488658 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-af2d3728-7021-4620-97b6-4fddbf187796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:21.564144 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 804/1609] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:24:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:24:21.565672 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbbc17b-beee-42a0-9a75-ec4678c90965 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:21.594536 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 806/1610] 10.222.0.16 () {58 vars in 1059 bytes} [Thu Sep 15 12:24:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:24:21.596861 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d65726-37c0-4081-b7d9-9c6e49a3d891 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:21.599664 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d65726-37c0-4081-b7d9-9c6e49a3d891 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:21.600510 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d65726-37c0-4081-b7d9-9c6e49a3d891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:21.631236 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-64d65726-37c0-4081-b7d9-9c6e49a3d891 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:24:21.632626 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-64d65726-37c0-4081-b7d9-9c6e49a3d891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:21.638748 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbbc17b-beee-42a0-9a75-ec4678c90965 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:21.643317 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2fbdee-5466-4e39-8aea-7c14d3916b74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:21.643979 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2fbdee-5466-4e39-8aea-7c14d3916b74 service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:21.644310 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2fbdee-5466-4e39-8aea-7c14d3916b74 service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:21.644581 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2fbdee-5466-4e39-8aea-7c14d3916b74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:21.723590 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 807/1611] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:24:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:24:21.725023 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24235f74-d97d-4ad9-9a3f-41bb323a3d73 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:21.725412 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24235f74-d97d-4ad9-9a3f-41bb323a3d73 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:21.726325 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24235f74-d97d-4ad9-9a3f-41bb323a3d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:21.735054 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2fbdee-5466-4e39-8aea-7c14d3916b74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:21.736905 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2fbdee-5466-4e39-8aea-7c14d3916b74 service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:21.747981 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 805/1612] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:24:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:24:21.749489 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2573cb09-0dc3-4bcd-b3d4-5e46cb3124a3 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:21.750084 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2573cb09-0dc3-4bcd-b3d4-5e46cb3124a3 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:21.750538 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2573cb09-0dc3-4bcd-b3d4-5e46cb3124a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:21.752429 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-24235f74-d97d-4ad9-9a3f-41bb323a3d73 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:24:21.753675 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-24235f74-d97d-4ad9-9a3f-41bb323a3d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:21.771819 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 808/1613] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:24:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:24:21.773290 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b8884-1487-4457-932e-0903027d5574 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:21.773574 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b8884-1487-4457-932e-0903027d5574 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:21.773851 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b8884-1487-4457-932e-0903027d5574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:21.802047 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-ac6b8884-1487-4457-932e-0903027d5574 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:24:21.803417 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-ac6b8884-1487-4457-932e-0903027d5574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:21.812957 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-2573cb09-0dc3-4bcd-b3d4-5e46cb3124a3 None None] MFA Rules not processed for user `c4838e194e77413cb03c4a622cf51e0c`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:24:21.813795 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 809/1614] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:24:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:24:21.814617 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6b8884-1487-4457-932e-0903027d5574 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:21.819239 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-2573cb09-0dc3-4bcd-b3d4-5e46cb3124a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:21.831441 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6b8884-1487-4457-932e-0903027d5574 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:21.837469 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ead5f0-1628-4b9f-bc0d-01ec6ed8e912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:21.838078 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ead5f0-1628-4b9f-bc0d-01ec6ed8e912 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:21.838355 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ead5f0-1628-4b9f-bc0d-01ec6ed8e912 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:21.838725 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ead5f0-1628-4b9f-bc0d-01ec6ed8e912 admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:21.839289 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ead5f0-1628-4b9f-bc0d-01ec6ed8e912 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:21.841187 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ead5f0-1628-4b9f-bc0d-01ec6ed8e912 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:21.877126 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 810/1615] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:24:21 2022] POST /identity/v3/projects => generated 371 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:24:21.878104 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ead5f0-1628-4b9f-bc0d-01ec6ed8e912 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:21.888707 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:24:21.895730 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:24:21.907425 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 806/1616] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:24:21 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:24:21.908577 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2573cb09-0dc3-4bcd-b3d4-5e46cb3124a3 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:21.910207 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-2573cb09-0dc3-4bcd-b3d4-5e46cb3124a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:21.929346 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2573cb09-0dc3-4bcd-b3d4-5e46cb3124a3 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:22.008060 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82da8990-56ec-4856-8195-3876f66b11bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:22.009009 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da8990-56ec-4856-8195-3876f66b11bf service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:22.009009 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da8990-56ec-4856-8195-3876f66b11bf service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:22.009660 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da8990-56ec-4856-8195-3876f66b11bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:22.027528 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ead5f0-1628-4b9f-bc0d-01ec6ed8e912 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:22.036867 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ade2ed-2939-48f5-9c48-63409b9ffcab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d05c52570474820b4ba0e2cdad5c13f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:22.038356 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ade2ed-2939-48f5-9c48-63409b9ffcab service nova] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:22.038911 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ade2ed-2939-48f5-9c48-63409b9ffcab service nova] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:22.039283 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ade2ed-2939-48f5-9c48-63409b9ffcab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:22.104527 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82da8990-56ec-4856-8195-3876f66b11bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:22.106719 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82da8990-56ec-4856-8195-3876f66b11bf service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:22.121911 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 807/1617] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:24:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:24:22.123225 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82da8990-56ec-4856-8195-3876f66b11bf service neutron] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:22.134083 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82da8990-56ec-4856-8195-3876f66b11bf service neutron] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:22.138628 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ade2ed-2939-48f5-9c48-63409b9ffcab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:22.139170 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eb8c2c-165d-48d7-8e92-b5bab854c4b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:22.140112 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb8c2c-165d-48d7-8e92-b5bab854c4b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:22.140895 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb8c2c-165d-48d7-8e92-b5bab854c4b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:22.141174 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb8c2c-165d-48d7-8e92-b5bab854c4b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:22.141416 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ade2ed-2939-48f5-9c48-63409b9ffcab service nova] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:22.154558 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 811/1618] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:24:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:24:22.156145 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ade2ed-2939-48f5-9c48-63409b9ffcab service nova] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:22.173209 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ade2ed-2939-48f5-9c48-63409b9ffcab service nova] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:22.176603 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eb8c2c-165d-48d7-8e92-b5bab854c4b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:22.179309 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eb8c2c-165d-48d7-8e92-b5bab854c4b3 service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:22.182167 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b30f55-84a5-49c8-aa78-ea1bb047b0b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:22.183075 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b30f55-84a5-49c8-aa78-ea1bb047b0b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:22.183565 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b30f55-84a5-49c8-aa78-ea1bb047b0b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:22.184400 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b30f55-84a5-49c8-aa78-ea1bb047b0b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:22.195701 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 808/1619] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:24:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:24:22.197478 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eb8c2c-165d-48d7-8e92-b5bab854c4b3 service neutron] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:22.214894 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eb8c2c-165d-48d7-8e92-b5bab854c4b3 service neutron] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:22.218744 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b30f55-84a5-49c8-aa78-ea1bb047b0b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:22.220418 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d534a911-5d37-4289-b2ce-65fd9617506a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:22.220749 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b30f55-84a5-49c8-aa78-ea1bb047b0b4 service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:22.221255 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d534a911-5d37-4289-b2ce-65fd9617506a admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:22.221556 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d534a911-5d37-4289-b2ce-65fd9617506a admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:22.221834 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d534a911-5d37-4289-b2ce-65fd9617506a admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:22.222605 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d534a911-5d37-4289-b2ce-65fd9617506a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:22.225548 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d534a911-5d37-4289-b2ce-65fd9617506a admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:22.233322 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 812/1620] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:24:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:24:22.236368 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b0943-fb0b-4611-aa76-d28e18b175b9 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:22.237000 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b0943-fb0b-4611-aa76-d28e18b175b9 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:22.237338 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b0943-fb0b-4611-aa76-d28e18b175b9 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:22.240224 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 813/1621] 10.222.0.16 () {54 vars in 962 bytes} [Thu Sep 15 12:24:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:24:22.249204 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4145c9f0-8703-4727-876a-a598729ddad4 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:22.251334 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4145c9f0-8703-4727-876a-a598729ddad4 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:22.251976 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4145c9f0-8703-4727-876a-a598729ddad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:22.265891 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 809/1622] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:24:22 2022] POST /identity/v3/users => generated 292 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:24:22.267635 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d534a911-5d37-4289-b2ce-65fd9617506a admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:22.290958 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-4145c9f0-8703-4727-876a-a598729ddad4 None None] MFA Rules not processed for user `9d05c52570474820b4ba0e2cdad5c13f`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:24:22.291871 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d534a911-5d37-4289-b2ce-65fd9617506a admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:22.293391 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-4145c9f0-8703-4727-876a-a598729ddad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:22.306045 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3b7b85-18fd-4a32-a8e8-e38fb52686f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:22.306636 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b7b85-18fd-4a32-a8e8-e38fb52686f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:22.306946 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 814/1623] 10.222.0.16 () {58 vars in 1059 bytes} [Thu Sep 15 12:24:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:24:22.307122 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b7b85-18fd-4a32-a8e8-e38fb52686f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:22.307394 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b7b85-18fd-4a32-a8e8-e38fb52686f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:22.308639 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3b7b85-18fd-4a32-a8e8-e38fb52686f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:22.309927 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3b7b85-18fd-4a32-a8e8-e38fb52686f5 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:22.317088 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4145c9f0-8703-4727-876a-a598729ddad4 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:22.338420 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 810/1624] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:24:22 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:24:22.340178 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4145c9f0-8703-4727-876a-a598729ddad4 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:22.340421 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3b7b85-18fd-4a32-a8e8-e38fb52686f5 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:22.352057 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5985e1-b4c7-437b-ae90-69a8d17fd694 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d05c52570474820b4ba0e2cdad5c13f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:22.352683 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5985e1-b4c7-437b-ae90-69a8d17fd694 service nova] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:22.352959 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5985e1-b4c7-437b-ae90-69a8d17fd694 service nova] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:22.353463 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5985e1-b4c7-437b-ae90-69a8d17fd694 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:22.366784 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3b7b85-18fd-4a32-a8e8-e38fb52686f5 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:22.383090 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932b627c-2484-44c1-ab38-af273632e776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:22.385024 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932b627c-2484-44c1-ab38-af273632e776 admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:22.385316 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932b627c-2484-44c1-ab38-af273632e776 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:22.386782 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932b627c-2484-44c1-ab38-af273632e776 admin admin] PATH_INFO: `/v3/projects/14abb57f63b848a38f67a902714045d4/users/2915404a7e014075878d53cd6f9037b0/roles/7f53f1c823b746529ba5057bf21b2477` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:22.425551 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932b627c-2484-44c1-ab38-af273632e776 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14abb57f63b848a38f67a902714045d4, user_id=2915404a7e014075878d53cd6f9037b0, role_id=7f53f1c823b746529ba5057bf21b2477)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:22.432501 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932b627c-2484-44c1-ab38-af273632e776 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:22.436758 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5985e1-b4c7-437b-ae90-69a8d17fd694 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:22.438467 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5985e1-b4c7-437b-ae90-69a8d17fd694 service nova] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:22.471959 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 811/1625] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:24:22 2022] PUT /identity/v3/projects/14abb57f63b848a38f67a902714045d4/users/2915404a7e014075878d53cd6f9037b0/roles/7f53f1c823b746529ba5057bf21b2477 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:24:22.473050 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 815/1626] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:24:22 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 12:24:22.475836 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932b627c-2484-44c1-ab38-af273632e776 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:22.554539 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:24:22.587865 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932b627c-2484-44c1-ab38-af273632e776 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:22.611495 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1ba6eb-2d7d-4a5e-b056-01afb4eab5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:22.612136 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ba6eb-2d7d-4a5e-b056-01afb4eab5f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:22.616023 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ba6eb-2d7d-4a5e-b056-01afb4eab5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:22.616551 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ba6eb-2d7d-4a5e-b056-01afb4eab5f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:22.620082 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1ba6eb-2d7d-4a5e-b056-01afb4eab5f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:22.623306 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1ba6eb-2d7d-4a5e-b056-01afb4eab5f8 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:22.647686 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 812/1627] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:24:22 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 12:24:22.655295 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5985e1-b4c7-437b-ae90-69a8d17fd694 service nova] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:22.674840 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5985e1-b4c7-437b-ae90-69a8d17fd694 service nova] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:22.683875 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4732c1fe-4093-4881-9ae7-573960e82b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:22.683875 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732c1fe-4093-4881-9ae7-573960e82b93 admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:22.683875 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732c1fe-4093-4881-9ae7-573960e82b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:22.683875 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732c1fe-4093-4881-9ae7-573960e82b93 admin admin] PATH_INFO: `/v3/projects/14abb57f63b848a38f67a902714045d4/users/2915404a7e014075878d53cd6f9037b0/roles/7f53f1c823b746529ba5057bf21b2477` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:22.685494 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4732c1fe-4093-4881-9ae7-573960e82b93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14abb57f63b848a38f67a902714045d4, user_id=2915404a7e014075878d53cd6f9037b0, role_id=7f53f1c823b746529ba5057bf21b2477)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:22.697673 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4732c1fe-4093-4881-9ae7-573960e82b93 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:22.724167 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 816/1628] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:24:22 2022] PUT /identity/v3/projects/14abb57f63b848a38f67a902714045d4/users/2915404a7e014075878d53cd6f9037b0/roles/7f53f1c823b746529ba5057bf21b2477 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:24:22.733895 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7bb1c3-29cf-4f53-8e12-84ef23d1a3a8 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:22.734247 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7bb1c3-29cf-4f53-8e12-84ef23d1a3a8 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:22.734523 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7bb1c3-29cf-4f53-8e12-84ef23d1a3a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:22.791669 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-8e7bb1c3-29cf-4f53-8e12-84ef23d1a3a8 None None] MFA Rules not processed for user `2915404a7e014075878d53cd6f9037b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:24:22.793559 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-8e7bb1c3-29cf-4f53-8e12-84ef23d1a3a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:22.818719 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3cf24-0402-4374-9330-6f8ac3312e06 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:22.819030 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3cf24-0402-4374-9330-6f8ac3312e06 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:22.819303 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3cf24-0402-4374-9330-6f8ac3312e06 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:22.821172 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 817/1629] 10.222.0.16 () {54 vars in 912 bytes} [Thu Sep 15 12:24:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:24:22.828896 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4eb1e3-da77-498e-be99-7cd859010175 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:22.829102 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4eb1e3-da77-498e-be99-7cd859010175 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:22.829494 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4eb1e3-da77-498e-be99-7cd859010175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:22.951750 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:24:22.951750 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-bc4eb1e3-da77-498e-be99-7cd859010175 None None] MFA Rules not processed for user `9d05c52570474820b4ba0e2cdad5c13f`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:24:22.951750 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-bc4eb1e3-da77-498e-be99-7cd859010175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:23.074562 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 813/1630] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:24:22 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:24:23.091370 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7bb1c3-29cf-4f53-8e12-84ef23d1a3a8 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:23.136585 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 818/1631] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Sep 15 12:24:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:24:23.137925 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882e34b1-34e7-4bf0-8672-459395c5c17d None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:23.138206 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882e34b1-34e7-4bf0-8672-459395c5c17d None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:23.138474 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882e34b1-34e7-4bf0-8672-459395c5c17d None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:23.141478 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 819/1632] 10.222.0.16 () {54 vars in 912 bytes} [Thu Sep 15 12:24:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:24:23.148838 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e4795a-8f0c-4d19-937a-70566190d157 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:23.149124 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e4795a-8f0c-4d19-937a-70566190d157 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:23.149542 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e4795a-8f0c-4d19-937a-70566190d157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:23.174781 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-12e4795a-8f0c-4d19-937a-70566190d157 None None] MFA Rules not processed for user `9d05c52570474820b4ba0e2cdad5c13f`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:24:23.176148 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-12e4795a-8f0c-4d19-937a-70566190d157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:23.187536 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 820/1633] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Sep 15 12:24:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:24:23.188797 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e4795a-8f0c-4d19-937a-70566190d157 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:23.202535 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7bb1c3-29cf-4f53-8e12-84ef23d1a3a8 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:23.211867 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98991272-a912-45eb-92f3-12768653fb66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceafc5e4283841528053f01931f10293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:23.212495 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98991272-a912-45eb-92f3-12768653fb66 service cinder] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:23.212775 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98991272-a912-45eb-92f3-12768653fb66 service cinder] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:23.214847 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98991272-a912-45eb-92f3-12768653fb66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:23.231448 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98991272-a912-45eb-92f3-12768653fb66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:23.235424 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98991272-a912-45eb-92f3-12768653fb66 service cinder] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:23.262153 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 814/1634] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:24:23 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:24:23.269811 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e4795a-8f0c-4d19-937a-70566190d157 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:23.274070 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff60e80-535b-465b-ac88-98176d4ed834 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceafc5e4283841528053f01931f10293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:23.274798 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff60e80-535b-465b-ac88-98176d4ed834 service cinder] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:23.275155 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff60e80-535b-465b-ac88-98176d4ed834 service cinder] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:23.275499 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff60e80-535b-465b-ac88-98176d4ed834 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:23.288051 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff60e80-535b-465b-ac88-98176d4ed834 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:23.289580 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff60e80-535b-465b-ac88-98176d4ed834 service cinder] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:23.302740 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 821/1635] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:24:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:24:23.336301 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98991272-a912-45eb-92f3-12768653fb66 service cinder] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:23.358398 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98991272-a912-45eb-92f3-12768653fb66 service cinder] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:23.376933 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4459f78-d59a-41ec-9451-72590388e608 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceafc5e4283841528053f01931f10293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:23.377567 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4459f78-d59a-41ec-9451-72590388e608 service cinder] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:23.378287 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4459f78-d59a-41ec-9451-72590388e608 service cinder] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:23.380007 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4459f78-d59a-41ec-9451-72590388e608 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:23.422487 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4459f78-d59a-41ec-9451-72590388e608 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:23.429198 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4459f78-d59a-41ec-9451-72590388e608 service cinder] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:23.456074 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 815/1636] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:24:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:24:23.761677 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff60e80-535b-465b-ac88-98176d4ed834 service cinder] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:23.939271 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff60e80-535b-465b-ac88-98176d4ed834 service cinder] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:23.952156 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a773caa-969b-488a-a40d-ec5509016228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:23.960293 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a773caa-969b-488a-a40d-ec5509016228 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:23.960894 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a773caa-969b-488a-a40d-ec5509016228 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:23.961144 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a773caa-969b-488a-a40d-ec5509016228 admin admin] PATH_INFO: `/v3/users/696045dfc2bb4dcebd18f22e69ac14b3` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:23.962640 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a773caa-969b-488a-a40d-ec5509016228 admin admin] RBAC: Authorizing `identity:delete_user(user_id=696045dfc2bb4dcebd18f22e69ac14b3)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:23.965472 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a773caa-969b-488a-a40d-ec5509016228 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:24.051992 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:24:24.076435 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-1a773caa-969b-488a-a40d-ec5509016228 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '696045dfc2bb4dcebd18f22e69ac14b3'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:24.101340 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-1a773caa-969b-488a-a40d-ec5509016228 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '696045dfc2bb4dcebd18f22e69ac14b3'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:24.107375 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-1a773caa-969b-488a-a40d-ec5509016228 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '696045dfc2bb4dcebd18f22e69ac14b3'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:24.109832 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-1a773caa-969b-488a-a40d-ec5509016228 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '696045dfc2bb4dcebd18f22e69ac14b3'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:24.123967 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-1a773caa-969b-488a-a40d-ec5509016228 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '696045dfc2bb4dcebd18f22e69ac14b3'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:24.161530 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 822/1637] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:24:23 2022] DELETE /identity/v3/users/696045dfc2bb4dcebd18f22e69ac14b3 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:24:24.167620 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd899141-ddc2-405b-a3bd-eecfd6cd5e6e None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:24.167620 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd899141-ddc2-405b-a3bd-eecfd6cd5e6e None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:24.167620 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd899141-ddc2-405b-a3bd-eecfd6cd5e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:24.214231 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-dd899141-ddc2-405b-a3bd-eecfd6cd5e6e None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:24:24.215864 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-dd899141-ddc2-405b-a3bd-eecfd6cd5e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:24.304854 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:24:24.318944 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 816/1638] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:24:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:24:24.361421 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a773caa-969b-488a-a40d-ec5509016228 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:24.363317 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-1a773caa-969b-488a-a40d-ec5509016228 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:24.391095 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a773caa-969b-488a-a40d-ec5509016228 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:24.403479 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5505ece-014c-4778-95e9-b4a310527733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:24.404429 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5505ece-014c-4778-95e9-b4a310527733 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:24.406609 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5505ece-014c-4778-95e9-b4a310527733 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:24.407366 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd899141-ddc2-405b-a3bd-eecfd6cd5e6e None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:24.407664 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5505ece-014c-4778-95e9-b4a310527733 admin admin] PATH_INFO: `/v3/users/3316d4923d474fbb8da1ea1577050745` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:24.409983 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-dd899141-ddc2-405b-a3bd-eecfd6cd5e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:24.411513 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5505ece-014c-4778-95e9-b4a310527733 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3316d4923d474fbb8da1ea1577050745)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:24.414421 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5505ece-014c-4778-95e9-b4a310527733 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:24.541876 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-c5505ece-014c-4778-95e9-b4a310527733 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3316d4923d474fbb8da1ea1577050745'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:24.563103 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-c5505ece-014c-4778-95e9-b4a310527733 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3316d4923d474fbb8da1ea1577050745'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:24.563858 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-c5505ece-014c-4778-95e9-b4a310527733 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3316d4923d474fbb8da1ea1577050745'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:24.567016 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-c5505ece-014c-4778-95e9-b4a310527733 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3316d4923d474fbb8da1ea1577050745'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:24.571377 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd899141-ddc2-405b-a3bd-eecfd6cd5e6e None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:24.611764 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdffe62-4177-4937-b8ee-71cae93be5a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:24.611764 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdffe62-4177-4937-b8ee-71cae93be5a3 service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:24.611764 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdffe62-4177-4937-b8ee-71cae93be5a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:24.611764 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdffe62-4177-4937-b8ee-71cae93be5a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:24.623686 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-bbdffe62-4177-4937-b8ee-71cae93be5a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:24.624506 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-c5505ece-014c-4778-95e9-b4a310527733 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3316d4923d474fbb8da1ea1577050745'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:24.629709 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdffe62-4177-4937-b8ee-71cae93be5a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:24.631222 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdffe62-4177-4937-b8ee-71cae93be5a3 service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:24.651324 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 823/1639] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:24:24 2022] DELETE /identity/v3/users/3316d4923d474fbb8da1ea1577050745 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:24:24.653568 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c474895d-2553-41cd-b018-d7db1d99d495 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:24.653568 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c474895d-2553-41cd-b018-d7db1d99d495 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:24.653568 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c474895d-2553-41cd-b018-d7db1d99d495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:24.661466 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 817/1640] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:24:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:24:24.683016 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-c474895d-2553-41cd-b018-d7db1d99d495 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:24:24.684260 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-c474895d-2553-41cd-b018-d7db1d99d495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:24.852394 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 824/1641] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:24:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:24:24.940780 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdffe62-4177-4937-b8ee-71cae93be5a3 service neutron] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:24.942275 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-bbdffe62-4177-4937-b8ee-71cae93be5a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:24.969161 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdffe62-4177-4937-b8ee-71cae93be5a3 service neutron] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:25.105298 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fade4ab-d458-40bd-bc79-044fa2443459 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:25.106425 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fade4ab-d458-40bd-bc79-044fa2443459 service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:25.106788 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fade4ab-d458-40bd-bc79-044fa2443459 service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:25.107248 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fade4ab-d458-40bd-bc79-044fa2443459 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:25.128396 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fade4ab-d458-40bd-bc79-044fa2443459 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:25.130925 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fade4ab-d458-40bd-bc79-044fa2443459 service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:25.144949 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 818/1642] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:24:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:24:26.389652 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c474895d-2553-41cd-b018-d7db1d99d495 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:26.391203 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-c474895d-2553-41cd-b018-d7db1d99d495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:26.408964 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c474895d-2553-41cd-b018-d7db1d99d495 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:26.424852 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09fef7c-7b36-4791-9ed6-a7c83ad327bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:26.425510 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09fef7c-7b36-4791-9ed6-a7c83ad327bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:26.426434 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09fef7c-7b36-4791-9ed6-a7c83ad327bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:26.426434 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09fef7c-7b36-4791-9ed6-a7c83ad327bc admin admin] PATH_INFO: `/v3/projects/f0f9839b0e4d45058682c06b06a9e128` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:26.435235 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09fef7c-7b36-4791-9ed6-a7c83ad327bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0f9839b0e4d45058682c06b06a9e128)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:26.437592 dv-cinder-850836-7-smb devstack@keystone.service[81374]: WARNING py.warnings [None req-e09fef7c-7b36-4791-9ed6-a7c83ad327bc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 12:24:26.437592 dv-cinder-850836-7-smb devstack@keystone.service[81374]: warnings.warn(msg) Sep 15 12:24:26.437592 dv-cinder-850836-7-smb devstack@keystone.service[81374]: Sep 15 12:24:26.438951 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09fef7c-7b36-4791-9ed6-a7c83ad327bc admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:26.483252 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:24:26.530190 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-e09fef7c-7b36-4791-9ed6-a7c83ad327bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0f9839b0e4d45058682c06b06a9e128', 'request_id': 'req-e09fef7c-7b36-4791-9ed6-a7c83ad327bc'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:26.547008 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-e09fef7c-7b36-4791-9ed6-a7c83ad327bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0f9839b0e4d45058682c06b06a9e128', 'request_id': 'req-e09fef7c-7b36-4791-9ed6-a7c83ad327bc'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:26.554195 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-e09fef7c-7b36-4791-9ed6-a7c83ad327bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0f9839b0e4d45058682c06b06a9e128', 'request_id': 'req-e09fef7c-7b36-4791-9ed6-a7c83ad327bc'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:26.583868 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-e09fef7c-7b36-4791-9ed6-a7c83ad327bc admin admin] The token cache is being invalidate because project f0f9839b0e4d45058682c06b06a9e128 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:24:26.584161 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-e09fef7c-7b36-4791-9ed6-a7c83ad327bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:26.587018 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-e09fef7c-7b36-4791-9ed6-a7c83ad327bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:26.591474 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 825/1643] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:24:26 2022] DELETE /identity/v3/projects/f0f9839b0e4d45058682c06b06a9e128 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:24:26.596731 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e95e56-be5a-4774-97ac-f53f030cffdc None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:26.597195 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e95e56-be5a-4774-97ac-f53f030cffdc None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:26.597262 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e95e56-be5a-4774-97ac-f53f030cffdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:26.632802 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-b7e95e56-be5a-4774-97ac-f53f030cffdc None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:24:26.637211 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-b7e95e56-be5a-4774-97ac-f53f030cffdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:26.733358 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 819/1644] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:24:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:24:26.741697 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1705886d-05bd-45c2-954b-39cd1498839c None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:26.741994 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1705886d-05bd-45c2-954b-39cd1498839c None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:26.742275 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1705886d-05bd-45c2-954b-39cd1498839c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:26.787323 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-1705886d-05bd-45c2-954b-39cd1498839c None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:24:26.788558 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-1705886d-05bd-45c2-954b-39cd1498839c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:26.813790 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 826/1645] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:24:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:24:26.815813 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e95e56-be5a-4774-97ac-f53f030cffdc None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:26.860468 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e95e56-be5a-4774-97ac-f53f030cffdc None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:26.875118 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b2e194-e6e8-47f0-a9ba-7e082ebec2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:26.877157 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b2e194-e6e8-47f0-a9ba-7e082ebec2a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:26.879804 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b2e194-e6e8-47f0-a9ba-7e082ebec2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:26.879804 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b2e194-e6e8-47f0-a9ba-7e082ebec2a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:26.881207 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b2e194-e6e8-47f0-a9ba-7e082ebec2a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:24:26.882458 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b2e194-e6e8-47f0-a9ba-7e082ebec2a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:26.889081 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b2e194-e6e8-47f0-a9ba-7e082ebec2a4 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:26.923542 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 820/1646] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 15 12:24:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:24:26.924742 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1705886d-05bd-45c2-954b-39cd1498839c None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:26.942754 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1705886d-05bd-45c2-954b-39cd1498839c None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:26.951160 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a331cd-8caa-4c4f-bff4-336e1970e286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:26.951806 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a331cd-8caa-4c4f-bff4-336e1970e286 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:26.952088 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a331cd-8caa-4c4f-bff4-336e1970e286 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:26.952892 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a331cd-8caa-4c4f-bff4-336e1970e286 admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:26.953556 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a331cd-8caa-4c4f-bff4-336e1970e286 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:26.956046 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a331cd-8caa-4c4f-bff4-336e1970e286 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:27.013918 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 827/1647] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:24:26 2022] POST /identity/v3/projects => generated 385 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:24:27.018668 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b2e194-e6e8-47f0-a9ba-7e082ebec2a4 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:27.039172 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b2e194-e6e8-47f0-a9ba-7e082ebec2a4 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:27.094346 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:24:27.133062 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a331cd-8caa-4c4f-bff4-336e1970e286 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:27.135606 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-42a331cd-8caa-4c4f-bff4-336e1970e286 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:27.204666 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb896fc-cfaf-4e93-a960-095c14a2f859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:27.206004 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb896fc-cfaf-4e93-a960-095c14a2f859 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:27.207203 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb896fc-cfaf-4e93-a960-095c14a2f859 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:27.208208 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb896fc-cfaf-4e93-a960-095c14a2f859 admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:27.210516 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb896fc-cfaf-4e93-a960-095c14a2f859 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:27.215558 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb896fc-cfaf-4e93-a960-095c14a2f859 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:27.264121 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 821/1648] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:24:27 2022] POST /identity/v3/users => generated 293 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:24:27.268586 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb896fc-cfaf-4e93-a960-095c14a2f859 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:27.270830 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a331cd-8caa-4c4f-bff4-336e1970e286 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:27.277825 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34df7a4d-9556-49bb-b5de-b88651325a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:27.279367 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df7a4d-9556-49bb-b5de-b88651325a51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:27.279781 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df7a4d-9556-49bb-b5de-b88651325a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:27.280624 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df7a4d-9556-49bb-b5de-b88651325a51 admin admin] PATH_INFO: `/v3/projects/4f7f4219a89c43c8ac6a5325158e9cbe` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:27.282215 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34df7a4d-9556-49bb-b5de-b88651325a51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f7f4219a89c43c8ac6a5325158e9cbe)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:27.282626 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb896fc-cfaf-4e93-a960-095c14a2f859 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:27.285363 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34df7a4d-9556-49bb-b5de-b88651325a51 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:27.287862 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eb8fbd-4465-40aa-ae89-a725f08d0fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:27.288542 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb8fbd-4465-40aa-ae89-a725f08d0fc9 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:27.288788 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb8fbd-4465-40aa-ae89-a725f08d0fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:27.289101 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb8fbd-4465-40aa-ae89-a725f08d0fc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:27.289914 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eb8fbd-4465-40aa-ae89-a725f08d0fc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:27.291756 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eb8fbd-4465-40aa-ae89-a725f08d0fc9 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:27.318788 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 822/1649] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:24:27 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:24:27.323264 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eb8fbd-4465-40aa-ae89-a725f08d0fc9 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:27.336773 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eb8fbd-4465-40aa-ae89-a725f08d0fc9 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:27.344243 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91770d26-f1aa-4ac6-b617-487448552e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:27.345053 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91770d26-f1aa-4ac6-b617-487448552e72 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:27.345288 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91770d26-f1aa-4ac6-b617-487448552e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:27.345692 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91770d26-f1aa-4ac6-b617-487448552e72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:27.347727 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91770d26-f1aa-4ac6-b617-487448552e72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:27.349749 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91770d26-f1aa-4ac6-b617-487448552e72 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:27.364873 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 823/1650] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:24:27 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:24:27.366030 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91770d26-f1aa-4ac6-b617-487448552e72 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:27.375594 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-34df7a4d-9556-49bb-b5de-b88651325a51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f7f4219a89c43c8ac6a5325158e9cbe', 'request_id': 'req-34df7a4d-9556-49bb-b5de-b88651325a51'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:27.384201 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91770d26-f1aa-4ac6-b617-487448552e72 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:27.390736 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-34df7a4d-9556-49bb-b5de-b88651325a51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f7f4219a89c43c8ac6a5325158e9cbe', 'request_id': 'req-34df7a4d-9556-49bb-b5de-b88651325a51'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:27.413413 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-34df7a4d-9556-49bb-b5de-b88651325a51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f7f4219a89c43c8ac6a5325158e9cbe', 'request_id': 'req-34df7a4d-9556-49bb-b5de-b88651325a51'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:27.443989 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-34df7a4d-9556-49bb-b5de-b88651325a51 admin admin] The token cache is being invalidate because project 4f7f4219a89c43c8ac6a5325158e9cbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:24:27.444546 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-34df7a4d-9556-49bb-b5de-b88651325a51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:27.445384 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-34df7a4d-9556-49bb-b5de-b88651325a51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:27.448618 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 828/1651] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:24:27 2022] DELETE /identity/v3/projects/4f7f4219a89c43c8ac6a5325158e9cbe => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:24:27.452883 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34df7a4d-9556-49bb-b5de-b88651325a51 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:27.457637 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-34df7a4d-9556-49bb-b5de-b88651325a51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:27.493476 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:24:27.498050 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0891f30b-8a36-4eb7-a6a6-61ac145a3957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:27.499308 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0891f30b-8a36-4eb7-a6a6-61ac145a3957 admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:27.500360 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0891f30b-8a36-4eb7-a6a6-61ac145a3957 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:27.504640 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0891f30b-8a36-4eb7-a6a6-61ac145a3957 admin admin] PATH_INFO: `/v3/projects/3db369724ffd45b9b05f3e4cbdc9e38a/users/c9f0af46defd459595be39826956a167/roles/9371e5bbc55848949eb951a815f817f2` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:27.535717 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0891f30b-8a36-4eb7-a6a6-61ac145a3957 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3db369724ffd45b9b05f3e4cbdc9e38a, user_id=c9f0af46defd459595be39826956a167, role_id=9371e5bbc55848949eb951a815f817f2)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:27.539252 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0891f30b-8a36-4eb7-a6a6-61ac145a3957 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:27.583438 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 824/1652] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:24:27 2022] PUT /identity/v3/projects/3db369724ffd45b9b05f3e4cbdc9e38a/users/c9f0af46defd459595be39826956a167/roles/9371e5bbc55848949eb951a815f817f2 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:24:27.591508 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d597d0c8-623b-44e2-b9f7-cdb18a76d73a None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:27.594635 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d597d0c8-623b-44e2-b9f7-cdb18a76d73a None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:27.596683 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d597d0c8-623b-44e2-b9f7-cdb18a76d73a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:27.633173 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34df7a4d-9556-49bb-b5de-b88651325a51 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:27.656908 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-d597d0c8-623b-44e2-b9f7-cdb18a76d73a None None] MFA Rules not processed for user `c9f0af46defd459595be39826956a167`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:24:27.659354 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-d597d0c8-623b-44e2-b9f7-cdb18a76d73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:27.836710 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403b2187-e15e-480f-ae68-534a95e513b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:27.837336 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b2187-e15e-480f-ae68-534a95e513b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:27.837664 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b2187-e15e-480f-ae68-534a95e513b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:27.837966 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b2187-e15e-480f-ae68-534a95e513b2 admin admin] PATH_INFO: `/v3/users/2915404a7e014075878d53cd6f9037b0` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:27.840422 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403b2187-e15e-480f-ae68-534a95e513b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2915404a7e014075878d53cd6f9037b0)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:27.843529 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403b2187-e15e-480f-ae68-534a95e513b2 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:27.845744 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 825/1653] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:24:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:24:27.846871 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d597d0c8-623b-44e2-b9f7-cdb18a76d73a None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:27.848788 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-d597d0c8-623b-44e2-b9f7-cdb18a76d73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:27.878205 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d597d0c8-623b-44e2-b9f7-cdb18a76d73a None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:27.888815 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543e4a2b-c308-4a5d-9aeb-b3cfac41958e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:27.889452 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e4a2b-c308-4a5d-9aeb-b3cfac41958e admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:27.889725 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e4a2b-c308-4a5d-9aeb-b3cfac41958e admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:27.890022 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e4a2b-c308-4a5d-9aeb-b3cfac41958e admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:27.890667 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543e4a2b-c308-4a5d-9aeb-b3cfac41958e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:27.892655 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543e4a2b-c308-4a5d-9aeb-b3cfac41958e admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:27.919254 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:24:27.960776 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 826/1654] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:24:27 2022] POST /identity/v3/projects => generated 385 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:24:27.976845 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-403b2187-e15e-480f-ae68-534a95e513b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2915404a7e014075878d53cd6f9037b0'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:27.977010 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543e4a2b-c308-4a5d-9aeb-b3cfac41958e admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:28.001899 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-403b2187-e15e-480f-ae68-534a95e513b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2915404a7e014075878d53cd6f9037b0'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:28.003455 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-403b2187-e15e-480f-ae68-534a95e513b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2915404a7e014075878d53cd6f9037b0'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:28.006492 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-403b2187-e15e-480f-ae68-534a95e513b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2915404a7e014075878d53cd6f9037b0'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:28.028981 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-403b2187-e15e-480f-ae68-534a95e513b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2915404a7e014075878d53cd6f9037b0'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:28.067210 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 829/1655] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:24:27 2022] DELETE /identity/v3/users/2915404a7e014075878d53cd6f9037b0 => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:24:28.085236 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543e4a2b-c308-4a5d-9aeb-b3cfac41958e admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:28.156722 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fddf51-4dc7-48d6-a222-25ebd53b44e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:28.157629 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fddf51-4dc7-48d6-a222-25ebd53b44e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:28.158109 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fddf51-4dc7-48d6-a222-25ebd53b44e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:28.158950 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fddf51-4dc7-48d6-a222-25ebd53b44e7 admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:28.159845 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fddf51-4dc7-48d6-a222-25ebd53b44e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:28.162365 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fddf51-4dc7-48d6-a222-25ebd53b44e7 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:28.194545 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 827/1656] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:24:27 2022] POST /identity/v3/users => generated 299 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:24:28.195043 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403b2187-e15e-480f-ae68-534a95e513b2 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:28.196952 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-403b2187-e15e-480f-ae68-534a95e513b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:28.230099 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403b2187-e15e-480f-ae68-534a95e513b2 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:28.241656 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb26b907-d7b3-427a-bd74-eb97d0f3188f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:28.242860 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb26b907-d7b3-427a-bd74-eb97d0f3188f admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:28.242860 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb26b907-d7b3-427a-bd74-eb97d0f3188f admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:28.243671 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb26b907-d7b3-427a-bd74-eb97d0f3188f admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:28.244867 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb26b907-d7b3-427a-bd74-eb97d0f3188f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:28.248106 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb26b907-d7b3-427a-bd74-eb97d0f3188f admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:28.269311 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 830/1657] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:24:28 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 12:24:28.275863 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fddf51-4dc7-48d6-a222-25ebd53b44e7 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:28.310181 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fddf51-4dc7-48d6-a222-25ebd53b44e7 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:28.323456 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cd50fd-72e0-47fd-b537-b82f700c3802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:28.326372 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd50fd-72e0-47fd-b537-b82f700c3802 admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:28.328026 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd50fd-72e0-47fd-b537-b82f700c3802 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:28.328543 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd50fd-72e0-47fd-b537-b82f700c3802 admin admin] PATH_INFO: `/v3/projects/9bb9367e40984f859665ab43d67be52c/users/6534e8efeab64f86b1a258cbc90bb922/roles/7f53f1c823b746529ba5057bf21b2477` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:28.409015 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cd50fd-72e0-47fd-b537-b82f700c3802 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bb9367e40984f859665ab43d67be52c, user_id=6534e8efeab64f86b1a258cbc90bb922, role_id=7f53f1c823b746529ba5057bf21b2477)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:28.414531 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cd50fd-72e0-47fd-b537-b82f700c3802 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:28.443466 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 828/1658] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:24:28 2022] PUT /identity/v3/projects/9bb9367e40984f859665ab43d67be52c/users/6534e8efeab64f86b1a258cbc90bb922/roles/7f53f1c823b746529ba5057bf21b2477 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:24:28.447199 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb26b907-d7b3-427a-bd74-eb97d0f3188f admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:28.463266 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb26b907-d7b3-427a-bd74-eb97d0f3188f admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:28.516010 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:24:28.650111 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643913d6-3a21-40bd-a6eb-b2d6df373407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:28.651112 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643913d6-3a21-40bd-a6eb-b2d6df373407 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:28.651112 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643913d6-3a21-40bd-a6eb-b2d6df373407 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:28.651287 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643913d6-3a21-40bd-a6eb-b2d6df373407 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:28.651906 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643913d6-3a21-40bd-a6eb-b2d6df373407 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:28.653524 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643913d6-3a21-40bd-a6eb-b2d6df373407 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:28.681587 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cd50fd-72e0-47fd-b537-b82f700c3802 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:28.691758 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 831/1659] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:24:28 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:24:28.700356 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cd50fd-72e0-47fd-b537-b82f700c3802 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:28.719209 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2c0094-bbca-4b67-93f9-9d106cfd0de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:28.730167 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c0094-bbca-4b67-93f9-9d106cfd0de4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:28.730512 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c0094-bbca-4b67-93f9-9d106cfd0de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:28.730830 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c0094-bbca-4b67-93f9-9d106cfd0de4 admin admin] PATH_INFO: `/v3/projects/9bb9367e40984f859665ab43d67be52c/users/6534e8efeab64f86b1a258cbc90bb922/roles/7f53f1c823b746529ba5057bf21b2477` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:28.738019 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2c0094-bbca-4b67-93f9-9d106cfd0de4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bb9367e40984f859665ab43d67be52c, user_id=6534e8efeab64f86b1a258cbc90bb922, role_id=7f53f1c823b746529ba5057bf21b2477)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:28.744746 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2c0094-bbca-4b67-93f9-9d106cfd0de4 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:28.785172 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 829/1660] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:24:28 2022] PUT /identity/v3/projects/9bb9367e40984f859665ab43d67be52c/users/6534e8efeab64f86b1a258cbc90bb922/roles/7f53f1c823b746529ba5057bf21b2477 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:24:28.787431 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eeb85b-aa65-49df-8756-02fd8d0256ea None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:28.788420 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eeb85b-aa65-49df-8756-02fd8d0256ea None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:28.790889 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eeb85b-aa65-49df-8756-02fd8d0256ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:28.873647 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-58eeb85b-aa65-49df-8756-02fd8d0256ea None None] MFA Rules not processed for user `6534e8efeab64f86b1a258cbc90bb922`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:24:28.880789 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-58eeb85b-aa65-49df-8756-02fd8d0256ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:29.111426 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 832/1661] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:24:28 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:24:29.138546 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2c0094-bbca-4b67-93f9-9d106cfd0de4 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:29.141572 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-ba2c0094-bbca-4b67-93f9-9d106cfd0de4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:29.293226 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:24:29.303845 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2c0094-bbca-4b67-93f9-9d106cfd0de4 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:29.314826 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ae7d42-070f-4d19-9b05-e5a08b12dc32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceafc5e4283841528053f01931f10293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:29.315707 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae7d42-070f-4d19-9b05-e5a08b12dc32 service cinder] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:29.316325 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae7d42-070f-4d19-9b05-e5a08b12dc32 service cinder] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:29.316681 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae7d42-070f-4d19-9b05-e5a08b12dc32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:29.344852 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ae7d42-070f-4d19-9b05-e5a08b12dc32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:29.346772 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ae7d42-070f-4d19-9b05-e5a08b12dc32 service cinder] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:29.383342 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 830/1662] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:24:29 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:24:29.424495 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eeb85b-aa65-49df-8756-02fd8d0256ea None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:29.556361 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eeb85b-aa65-49df-8756-02fd8d0256ea None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:29.572141 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63e58e5-3f72-49cb-be11-57a313749ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:29.573535 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e58e5-3f72-49cb-be11-57a313749ad5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:29.573949 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e58e5-3f72-49cb-be11-57a313749ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:29.574338 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e58e5-3f72-49cb-be11-57a313749ad5 admin admin] PATH_INFO: `/v3/users/c9f0af46defd459595be39826956a167` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:29.578273 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63e58e5-3f72-49cb-be11-57a313749ad5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9f0af46defd459595be39826956a167)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:29.580372 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63e58e5-3f72-49cb-be11-57a313749ad5 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:29.688077 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-a63e58e5-3f72-49cb-be11-57a313749ad5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9f0af46defd459595be39826956a167'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:29.693858 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:24:29.709020 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-a63e58e5-3f72-49cb-be11-57a313749ad5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9f0af46defd459595be39826956a167'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:29.710047 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-a63e58e5-3f72-49cb-be11-57a313749ad5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9f0af46defd459595be39826956a167'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:29.711084 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-a63e58e5-3f72-49cb-be11-57a313749ad5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9f0af46defd459595be39826956a167'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:29.724721 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-a63e58e5-3f72-49cb-be11-57a313749ad5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9f0af46defd459595be39826956a167'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:29.771077 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 833/1663] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:24:29 2022] DELETE /identity/v3/users/c9f0af46defd459595be39826956a167 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:24:29.775723 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373df5ff-8233-41b8-ad16-7c4ac81d0741 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:29.776718 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373df5ff-8233-41b8-ad16-7c4ac81d0741 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:29.777198 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373df5ff-8233-41b8-ad16-7c4ac81d0741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:29.824039 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-373df5ff-8233-41b8-ad16-7c4ac81d0741 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:24:29.825624 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-373df5ff-8233-41b8-ad16-7c4ac81d0741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:29.952886 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 831/1664] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:24:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:24:30.049141 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63e58e5-3f72-49cb-be11-57a313749ad5 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:30.051966 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-a63e58e5-3f72-49cb-be11-57a313749ad5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:30.262466 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63e58e5-3f72-49cb-be11-57a313749ad5 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:30.279257 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9f65e4-308a-45ab-babf-cd9aa7f91135 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:30.279907 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f65e4-308a-45ab-babf-cd9aa7f91135 service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:30.280190 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f65e4-308a-45ab-babf-cd9aa7f91135 service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:30.280981 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f65e4-308a-45ab-babf-cd9aa7f91135 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:30.326865 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9f65e4-308a-45ab-babf-cd9aa7f91135 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:30.328378 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9f65e4-308a-45ab-babf-cd9aa7f91135 service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:30.363244 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 834/1665] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:24:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:24:31.045013 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373df5ff-8233-41b8-ad16-7c4ac81d0741 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:31.047748 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-373df5ff-8233-41b8-ad16-7c4ac81d0741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:31.065189 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373df5ff-8233-41b8-ad16-7c4ac81d0741 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:31.081242 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63322837-b4a6-49fd-8d60-0f6ab6bfb2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:31.081924 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63322837-b4a6-49fd-8d60-0f6ab6bfb2b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:31.082206 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63322837-b4a6-49fd-8d60-0f6ab6bfb2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:31.082483 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63322837-b4a6-49fd-8d60-0f6ab6bfb2b3 admin admin] PATH_INFO: `/v3/users/c4838e194e77413cb03c4a622cf51e0c` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:31.085754 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63322837-b4a6-49fd-8d60-0f6ab6bfb2b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4838e194e77413cb03c4a622cf51e0c)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:31.091792 dv-cinder-850836-7-smb devstack@keystone.service[81375]: WARNING py.warnings [None req-63322837-b4a6-49fd-8d60-0f6ab6bfb2b3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 12:24:31.091792 dv-cinder-850836-7-smb devstack@keystone.service[81375]: warnings.warn(msg) Sep 15 12:24:31.091792 dv-cinder-850836-7-smb devstack@keystone.service[81375]: Sep 15 12:24:31.095420 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63322837-b4a6-49fd-8d60-0f6ab6bfb2b3 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:31.262112 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-63322837-b4a6-49fd-8d60-0f6ab6bfb2b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4838e194e77413cb03c4a622cf51e0c'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:31.281357 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-63322837-b4a6-49fd-8d60-0f6ab6bfb2b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4838e194e77413cb03c4a622cf51e0c'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:31.282155 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-63322837-b4a6-49fd-8d60-0f6ab6bfb2b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4838e194e77413cb03c4a622cf51e0c'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:31.282921 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-63322837-b4a6-49fd-8d60-0f6ab6bfb2b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4838e194e77413cb03c4a622cf51e0c'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:31.308384 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-63322837-b4a6-49fd-8d60-0f6ab6bfb2b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4838e194e77413cb03c4a622cf51e0c'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:31.372763 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 832/1666] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:24:31 2022] DELETE /identity/v3/users/c4838e194e77413cb03c4a622cf51e0c => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:24:31.374911 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a7cad-3757-4e26-8e4e-33c3bf1e9637 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:31.375390 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a7cad-3757-4e26-8e4e-33c3bf1e9637 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:31.375458 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875a7cad-3757-4e26-8e4e-33c3bf1e9637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:31.406126 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-875a7cad-3757-4e26-8e4e-33c3bf1e9637 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:24:31.407712 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-875a7cad-3757-4e26-8e4e-33c3bf1e9637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:31.445249 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63322837-b4a6-49fd-8d60-0f6ab6bfb2b3 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:31.446880 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-63322837-b4a6-49fd-8d60-0f6ab6bfb2b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:31.577273 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 835/1667] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:24:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:24:31.626223 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63322837-b4a6-49fd-8d60-0f6ab6bfb2b3 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:31.636034 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bcf651-6a2d-489a-8b6e-869755fa15a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:31.636827 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bcf651-6a2d-489a-8b6e-869755fa15a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:31.637110 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bcf651-6a2d-489a-8b6e-869755fa15a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:31.637387 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bcf651-6a2d-489a-8b6e-869755fa15a7 admin admin] PATH_INFO: `/v3/projects/14abb57f63b848a38f67a902714045d4` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:31.644172 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bcf651-6a2d-489a-8b6e-869755fa15a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14abb57f63b848a38f67a902714045d4)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:31.645028 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875a7cad-3757-4e26-8e4e-33c3bf1e9637 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:31.646179 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bcf651-6a2d-489a-8b6e-869755fa15a7 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:31.650749 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-875a7cad-3757-4e26-8e4e-33c3bf1e9637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:31.654462 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:24:31.758960 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-72bcf651-6a2d-489a-8b6e-869755fa15a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14abb57f63b848a38f67a902714045d4', 'request_id': 'req-72bcf651-6a2d-489a-8b6e-869755fa15a7'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:31.767795 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-72bcf651-6a2d-489a-8b6e-869755fa15a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14abb57f63b848a38f67a902714045d4', 'request_id': 'req-72bcf651-6a2d-489a-8b6e-869755fa15a7'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:31.787131 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-72bcf651-6a2d-489a-8b6e-869755fa15a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14abb57f63b848a38f67a902714045d4', 'request_id': 'req-72bcf651-6a2d-489a-8b6e-869755fa15a7'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:31.803302 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-72bcf651-6a2d-489a-8b6e-869755fa15a7 admin admin] The token cache is being invalidate because project 14abb57f63b848a38f67a902714045d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:24:31.803754 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-72bcf651-6a2d-489a-8b6e-869755fa15a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:31.804994 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-72bcf651-6a2d-489a-8b6e-869755fa15a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:31.811841 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 833/1668] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:24:31 2022] DELETE /identity/v3/projects/14abb57f63b848a38f67a902714045d4 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:24:31.816217 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875a7cad-3757-4e26-8e4e-33c3bf1e9637 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:31.820429 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad0987-975f-4437-b049-92c7e593dc0d None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:31.820980 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad0987-975f-4437-b049-92c7e593dc0d None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:31.823596 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad0987-975f-4437-b049-92c7e593dc0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:31.849860 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-48ad0987-975f-4437-b049-92c7e593dc0d None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:24:31.851404 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-48ad0987-975f-4437-b049-92c7e593dc0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:31.882268 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:24:31.964045 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 834/1669] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:24:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:24:31.964754 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261efcfc-4cca-44ef-bcef-4e1e65d5bd5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:31.965472 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261efcfc-4cca-44ef-bcef-4e1e65d5bd5a service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:31.965801 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261efcfc-4cca-44ef-bcef-4e1e65d5bd5a service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:31.965887 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff23729-249b-40e1-970b-b98519011283 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:31.966047 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261efcfc-4cca-44ef-bcef-4e1e65d5bd5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:31.966132 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff23729-249b-40e1-970b-b98519011283 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:31.966316 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff23729-249b-40e1-970b-b98519011283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:31.972262 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-261efcfc-4cca-44ef-bcef-4e1e65d5bd5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:32.001140 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261efcfc-4cca-44ef-bcef-4e1e65d5bd5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:32.007450 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261efcfc-4cca-44ef-bcef-4e1e65d5bd5a service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:32.009188 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-aff23729-249b-40e1-970b-b98519011283 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:24:32.010630 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-aff23729-249b-40e1-970b-b98519011283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:32.023536 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 836/1670] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:24:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:24:32.024847 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 835/1671] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:24:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:24:32.025560 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261efcfc-4cca-44ef-bcef-4e1e65d5bd5a service neutron] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:32.038795 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261efcfc-4cca-44ef-bcef-4e1e65d5bd5a service neutron] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:32.045967 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea54ce01-dd6d-4b0e-bbab-912e67183196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:32.047080 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54ce01-dd6d-4b0e-bbab-912e67183196 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:32.048361 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54ce01-dd6d-4b0e-bbab-912e67183196 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:32.049835 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54ce01-dd6d-4b0e-bbab-912e67183196 admin admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:32.050777 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea54ce01-dd6d-4b0e-bbab-912e67183196 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:24:32.051200 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea54ce01-dd6d-4b0e-bbab-912e67183196 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:32.058490 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea54ce01-dd6d-4b0e-bbab-912e67183196 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:32.079295 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 837/1672] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 15 12:24:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:24:32.081290 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff23729-249b-40e1-970b-b98519011283 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:32.095024 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff23729-249b-40e1-970b-b98519011283 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:32.108586 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402a5a13-7e0d-445f-b97f-7886a6c3d30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:32.109845 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402a5a13-7e0d-445f-b97f-7886a6c3d30b admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:32.110326 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402a5a13-7e0d-445f-b97f-7886a6c3d30b admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:32.111012 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402a5a13-7e0d-445f-b97f-7886a6c3d30b admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:32.112045 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402a5a13-7e0d-445f-b97f-7886a6c3d30b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:32.114489 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402a5a13-7e0d-445f-b97f-7886a6c3d30b admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:32.188802 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 836/1673] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:24:32 2022] POST /identity/v3/projects => generated 389 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:24:32.189875 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea54ce01-dd6d-4b0e-bbab-912e67183196 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:32.201996 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea54ce01-dd6d-4b0e-bbab-912e67183196 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:32.301839 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc22a0-df1b-4a9a-b58b-4d988bbb35c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:32.303594 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc22a0-df1b-4a9a-b58b-4d988bbb35c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:32.304226 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc22a0-df1b-4a9a-b58b-4d988bbb35c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:32.304866 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc22a0-df1b-4a9a-b58b-4d988bbb35c0 admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:32.305725 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddc22a0-df1b-4a9a-b58b-4d988bbb35c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:32.308205 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddc22a0-df1b-4a9a-b58b-4d988bbb35c0 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:32.344133 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402a5a13-7e0d-445f-b97f-7886a6c3d30b admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:32.345584 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 838/1674] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:24:32 2022] POST /identity/v3/users => generated 295 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:24:32.362172 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402a5a13-7e0d-445f-b97f-7886a6c3d30b admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:32.369942 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5306ce6e-31a6-4238-98f9-d26d38ea862b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:32.371078 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5306ce6e-31a6-4238-98f9-d26d38ea862b admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:32.372091 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5306ce6e-31a6-4238-98f9-d26d38ea862b admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:32.372885 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5306ce6e-31a6-4238-98f9-d26d38ea862b admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:32.373942 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5306ce6e-31a6-4238-98f9-d26d38ea862b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:32.377339 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5306ce6e-31a6-4238-98f9-d26d38ea862b admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:32.405046 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc22a0-df1b-4a9a-b58b-4d988bbb35c0 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:32.418247 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 837/1675] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:24:32 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:24:32.429441 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc22a0-df1b-4a9a-b58b-4d988bbb35c0 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:32.439920 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8cec78-6778-4d9c-8e42-f3a5d9a17970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:32.440711 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8cec78-6778-4d9c-8e42-f3a5d9a17970 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:32.441075 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8cec78-6778-4d9c-8e42-f3a5d9a17970 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:32.441698 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8cec78-6778-4d9c-8e42-f3a5d9a17970 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:32.443173 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8cec78-6778-4d9c-8e42-f3a5d9a17970 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:32.445457 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8cec78-6778-4d9c-8e42-f3a5d9a17970 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:32.474612 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 839/1676] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:24:32 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:24:32.481741 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5306ce6e-31a6-4238-98f9-d26d38ea862b admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:32.500542 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5306ce6e-31a6-4238-98f9-d26d38ea862b admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:32.509531 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c4e03a-c741-4d2b-aacb-1326ca2d7b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:32.510828 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4e03a-c741-4d2b-aacb-1326ca2d7b46 admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:32.512856 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4e03a-c741-4d2b-aacb-1326ca2d7b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:32.513904 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4e03a-c741-4d2b-aacb-1326ca2d7b46 admin admin] PATH_INFO: `/v3/projects/fb07037e0de54bffa9d4f2595f17793f/users/88212dd303a0466f9c0d8be22ccd14f5/roles/9371e5bbc55848949eb951a815f817f2` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:32.580591 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c4e03a-c741-4d2b-aacb-1326ca2d7b46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb07037e0de54bffa9d4f2595f17793f, user_id=88212dd303a0466f9c0d8be22ccd14f5, role_id=9371e5bbc55848949eb951a815f817f2)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:32.584767 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c4e03a-c741-4d2b-aacb-1326ca2d7b46 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:32.628252 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 838/1677] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:24:32 2022] PUT /identity/v3/projects/fb07037e0de54bffa9d4f2595f17793f/users/88212dd303a0466f9c0d8be22ccd14f5/roles/9371e5bbc55848949eb951a815f817f2 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:24:32.642799 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2868b7-b392-4661-ba83-d710ad4ca7ab None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:32.644001 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2868b7-b392-4661-ba83-d710ad4ca7ab None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:32.644461 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2868b7-b392-4661-ba83-d710ad4ca7ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:32.753367 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-0f2868b7-b392-4661-ba83-d710ad4ca7ab None None] MFA Rules not processed for user `88212dd303a0466f9c0d8be22ccd14f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:24:32.757208 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-0f2868b7-b392-4661-ba83-d710ad4ca7ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:33.079996 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c4e03a-c741-4d2b-aacb-1326ca2d7b46 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:33.080634 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 840/1678] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:24:32 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 442 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:24:33.160309 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:24:33.250154 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c4e03a-c741-4d2b-aacb-1326ca2d7b46 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:33.256148 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08619296-a6ac-48b1-b1c7-510ffc083d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:33.256828 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08619296-a6ac-48b1-b1c7-510ffc083d22 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:33.257152 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08619296-a6ac-48b1-b1c7-510ffc083d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:33.257425 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08619296-a6ac-48b1-b1c7-510ffc083d22 admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:33.258074 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08619296-a6ac-48b1-b1c7-510ffc083d22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:33.260677 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08619296-a6ac-48b1-b1c7-510ffc083d22 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:33.311499 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 839/1679] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:24:33 2022] POST /identity/v3/projects => generated 389 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 12:24:33.316037 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2868b7-b392-4661-ba83-d710ad4ca7ab None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:33.333576 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2868b7-b392-4661-ba83-d710ad4ca7ab None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:33.387844 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:24:33.473924 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf39d07d-7042-40b8-9d95-6c52789f0042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:33.474744 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf39d07d-7042-40b8-9d95-6c52789f0042 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:33.475025 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf39d07d-7042-40b8-9d95-6c52789f0042 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:33.475639 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf39d07d-7042-40b8-9d95-6c52789f0042 admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:33.476836 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf39d07d-7042-40b8-9d95-6c52789f0042 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:33.479488 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf39d07d-7042-40b8-9d95-6c52789f0042 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:33.526235 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 841/1680] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:24:33 2022] POST /identity/v3/users => generated 301 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:24:33.526963 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08619296-a6ac-48b1-b1c7-510ffc083d22 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:33.541882 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08619296-a6ac-48b1-b1c7-510ffc083d22 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:33.550466 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf39d07d-7042-40b8-9d95-6c52789f0042 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:33.552960 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-bf39d07d-7042-40b8-9d95-6c52789f0042 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:33.556419 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99e9538-e713-4ad3-bfd8-d3f4748847b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:33.557052 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e9538-e713-4ad3-bfd8-d3f4748847b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:33.557331 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e9538-e713-4ad3-bfd8-d3f4748847b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:33.557598 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e9538-e713-4ad3-bfd8-d3f4748847b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:33.558245 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99e9538-e713-4ad3-bfd8-d3f4748847b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:33.567415 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99e9538-e713-4ad3-bfd8-d3f4748847b1 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:33.597492 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf39d07d-7042-40b8-9d95-6c52789f0042 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:33.601057 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 840/1681] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:24:33 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:24:33.605389 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99e9538-e713-4ad3-bfd8-d3f4748847b1 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:33.611810 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba417d02-7daf-4646-9a75-ebee24cc4128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:33.612473 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba417d02-7daf-4646-9a75-ebee24cc4128 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:33.612755 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba417d02-7daf-4646-9a75-ebee24cc4128 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:33.613030 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba417d02-7daf-4646-9a75-ebee24cc4128 admin admin] PATH_INFO: `/v3/projects/3db369724ffd45b9b05f3e4cbdc9e38a` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:33.614551 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba417d02-7daf-4646-9a75-ebee24cc4128 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3db369724ffd45b9b05f3e4cbdc9e38a)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:33.618015 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba417d02-7daf-4646-9a75-ebee24cc4128 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:33.618980 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99e9538-e713-4ad3-bfd8-d3f4748847b1 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:33.634583 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41b3ab4-ffc1-4035-a8aa-24d6f11838c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:33.635255 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b3ab4-ffc1-4035-a8aa-24d6f11838c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:33.635533 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b3ab4-ffc1-4035-a8aa-24d6f11838c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:33.635804 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b3ab4-ffc1-4035-a8aa-24d6f11838c5 admin admin] PATH_INFO: `/v3/projects/0f173d1e2a8d4db8a8b5aa633943d5f3/users/b621513e5af24061bdf6d4c4bdad1ac3/roles/7f53f1c823b746529ba5057bf21b2477` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:33.674102 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41b3ab4-ffc1-4035-a8aa-24d6f11838c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f173d1e2a8d4db8a8b5aa633943d5f3, user_id=b621513e5af24061bdf6d4c4bdad1ac3, role_id=7f53f1c823b746529ba5057bf21b2477)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:33.676831 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41b3ab4-ffc1-4035-a8aa-24d6f11838c5 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:33.710184 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 841/1682] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:24:33 2022] PUT /identity/v3/projects/0f173d1e2a8d4db8a8b5aa633943d5f3/users/b621513e5af24061bdf6d4c4bdad1ac3/roles/7f53f1c823b746529ba5057bf21b2477 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:24:33.711363 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41b3ab4-ffc1-4035-a8aa-24d6f11838c5 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:33.718361 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-ba417d02-7daf-4646-9a75-ebee24cc4128 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3db369724ffd45b9b05f3e4cbdc9e38a', 'request_id': 'req-ba417d02-7daf-4646-9a75-ebee24cc4128'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:33.742114 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-ba417d02-7daf-4646-9a75-ebee24cc4128 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3db369724ffd45b9b05f3e4cbdc9e38a', 'request_id': 'req-ba417d02-7daf-4646-9a75-ebee24cc4128'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:33.762672 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-ba417d02-7daf-4646-9a75-ebee24cc4128 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3db369724ffd45b9b05f3e4cbdc9e38a', 'request_id': 'req-ba417d02-7daf-4646-9a75-ebee24cc4128'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:33.793376 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-ba417d02-7daf-4646-9a75-ebee24cc4128 admin admin] The token cache is being invalidate because project 3db369724ffd45b9b05f3e4cbdc9e38a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:24:33.794022 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-ba417d02-7daf-4646-9a75-ebee24cc4128 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:33.794969 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-ba417d02-7daf-4646-9a75-ebee24cc4128 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:33.797210 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 842/1683] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:24:33 2022] DELETE /identity/v3/projects/3db369724ffd45b9b05f3e4cbdc9e38a => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:24:33.800772 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba417d02-7daf-4646-9a75-ebee24cc4128 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:33.812419 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-ba417d02-7daf-4646-9a75-ebee24cc4128 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:33.875648 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41b3ab4-ffc1-4035-a8aa-24d6f11838c5 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:33.894119 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd56b479-77ad-46f1-a65b-2fdf126664a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:33.894727 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd56b479-77ad-46f1-a65b-2fdf126664a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:33.894990 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd56b479-77ad-46f1-a65b-2fdf126664a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:33.895308 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd56b479-77ad-46f1-a65b-2fdf126664a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:33.896531 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd56b479-77ad-46f1-a65b-2fdf126664a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:33.898421 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd56b479-77ad-46f1-a65b-2fdf126664a3 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:33.927954 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 842/1684] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:24:33 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 12:24:33.927954 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd56b479-77ad-46f1-a65b-2fdf126664a3 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:33.929706 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-dd56b479-77ad-46f1-a65b-2fdf126664a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:33.946851 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba417d02-7daf-4646-9a75-ebee24cc4128 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:33.956291 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd56b479-77ad-46f1-a65b-2fdf126664a3 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:33.963954 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b83222-1326-47b0-b175-897f00c1afed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:33.964868 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b83222-1326-47b0-b175-897f00c1afed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:33.965284 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b83222-1326-47b0-b175-897f00c1afed admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:33.965690 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b83222-1326-47b0-b175-897f00c1afed admin admin] PATH_INFO: `/v3/users/6534e8efeab64f86b1a258cbc90bb922` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:33.969380 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b83222-1326-47b0-b175-897f00c1afed admin admin] RBAC: Authorizing `identity:delete_user(user_id=6534e8efeab64f86b1a258cbc90bb922)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:33.971190 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0cb591-25ae-4c7b-b52c-194e1b1c50be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:33.971875 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0cb591-25ae-4c7b-b52c-194e1b1c50be admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:33.972154 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0cb591-25ae-4c7b-b52c-194e1b1c50be admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:33.972424 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0cb591-25ae-4c7b-b52c-194e1b1c50be admin admin] PATH_INFO: `/v3/projects/0f173d1e2a8d4db8a8b5aa633943d5f3/users/b621513e5af24061bdf6d4c4bdad1ac3/roles/7f53f1c823b746529ba5057bf21b2477` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:33.972988 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b83222-1326-47b0-b175-897f00c1afed admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:33.978731 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0cb591-25ae-4c7b-b52c-194e1b1c50be admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f173d1e2a8d4db8a8b5aa633943d5f3, user_id=b621513e5af24061bdf6d4c4bdad1ac3, role_id=7f53f1c823b746529ba5057bf21b2477)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:33.981413 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0cb591-25ae-4c7b-b52c-194e1b1c50be admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:34.010272 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 843/1685] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:24:33 2022] PUT /identity/v3/projects/0f173d1e2a8d4db8a8b5aa633943d5f3/users/b621513e5af24061bdf6d4c4bdad1ac3/roles/7f53f1c823b746529ba5057bf21b2477 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:24:34.021476 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cd7665-3e29-4498-902a-db759212d66a None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:34.021775 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cd7665-3e29-4498-902a-db759212d66a None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:34.022094 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cd7665-3e29-4498-902a-db759212d66a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:34.090027 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-e5cd7665-3e29-4498-902a-db759212d66a None None] MFA Rules not processed for user `b621513e5af24061bdf6d4c4bdad1ac3`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:24:34.092743 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-e5cd7665-3e29-4498-902a-db759212d66a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:34.112951 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=84,keystone:INSERT=4,keystone:DELETE=12 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:24:34.132505 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-59b83222-1326-47b0-b175-897f00c1afed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6534e8efeab64f86b1a258cbc90bb922'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:34.161193 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-59b83222-1326-47b0-b175-897f00c1afed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6534e8efeab64f86b1a258cbc90bb922'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:34.161861 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-59b83222-1326-47b0-b175-897f00c1afed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6534e8efeab64f86b1a258cbc90bb922'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:34.162992 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-59b83222-1326-47b0-b175-897f00c1afed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6534e8efeab64f86b1a258cbc90bb922'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:34.186267 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-59b83222-1326-47b0-b175-897f00c1afed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6534e8efeab64f86b1a258cbc90bb922'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:34.194236 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:24:34.253691 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 843/1686] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:24:33 2022] DELETE /identity/v3/users/6534e8efeab64f86b1a258cbc90bb922 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:24:34.269357 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 844/1687] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:24:34 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:24:34.275219 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b83222-1326-47b0-b175-897f00c1afed admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:34.278040 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-59b83222-1326-47b0-b175-897f00c1afed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:34.388820 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b83222-1326-47b0-b175-897f00c1afed admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:34.413358 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e426ed-0412-40e0-8cec-6161ce71a340 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceafc5e4283841528053f01931f10293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:34.414186 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e426ed-0412-40e0-8cec-6161ce71a340 service cinder] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:34.414942 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e426ed-0412-40e0-8cec-6161ce71a340 service cinder] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:34.415331 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e426ed-0412-40e0-8cec-6161ce71a340 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:34.442809 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cd7665-3e29-4498-902a-db759212d66a None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:34.448486 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-e5cd7665-3e29-4498-902a-db759212d66a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:34.638588 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cd7665-3e29-4498-902a-db759212d66a None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:34.689992 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e426ed-0412-40e0-8cec-6161ce71a340 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:34.692689 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e426ed-0412-40e0-8cec-6161ce71a340 service cinder] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:34.716443 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 844/1688] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:24:34 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 12:24:34.851458 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b158be8e-5e44-4abb-a275-481c0462f3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:34.852122 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b158be8e-5e44-4abb-a275-481c0462f3a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:34.852504 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b158be8e-5e44-4abb-a275-481c0462f3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:34.852782 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b158be8e-5e44-4abb-a275-481c0462f3a8 admin admin] PATH_INFO: `/v3/projects/bed2e6937b8248f08dc4438f6b0f5f48` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:34.855433 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b158be8e-5e44-4abb-a275-481c0462f3a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bed2e6937b8248f08dc4438f6b0f5f48)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:34.857384 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b158be8e-5e44-4abb-a275-481c0462f3a8 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:34.909103 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eef58d-31a0-4488-8877-3c052f4fac10 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:34.910098 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eef58d-31a0-4488-8877-3c052f4fac10 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:34.910495 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eef58d-31a0-4488-8877-3c052f4fac10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:34.964491 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-d6eef58d-31a0-4488-8877-3c052f4fac10 None None] MFA Rules not processed for user `fc120edcf30a4775a502c8e31811da4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:24:34.965972 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-d6eef58d-31a0-4488-8877-3c052f4fac10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:35.022787 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-b158be8e-5e44-4abb-a275-481c0462f3a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bed2e6937b8248f08dc4438f6b0f5f48', 'request_id': 'req-b158be8e-5e44-4abb-a275-481c0462f3a8'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:35.033836 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-b158be8e-5e44-4abb-a275-481c0462f3a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bed2e6937b8248f08dc4438f6b0f5f48', 'request_id': 'req-b158be8e-5e44-4abb-a275-481c0462f3a8'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:35.047723 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-b158be8e-5e44-4abb-a275-481c0462f3a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bed2e6937b8248f08dc4438f6b0f5f48', 'request_id': 'req-b158be8e-5e44-4abb-a275-481c0462f3a8'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:35.078314 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-b158be8e-5e44-4abb-a275-481c0462f3a8 admin admin] The token cache is being invalidate because project bed2e6937b8248f08dc4438f6b0f5f48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:24:35.078896 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-b158be8e-5e44-4abb-a275-481c0462f3a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:35.079722 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-b158be8e-5e44-4abb-a275-481c0462f3a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:35.085770 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 845/1689] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:24:34 2022] DELETE /identity/v3/projects/bed2e6937b8248f08dc4438f6b0f5f48 => generated 0 bytes in 639 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:24:35.087697 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b158be8e-5e44-4abb-a275-481c0462f3a8 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:35.089563 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-b158be8e-5e44-4abb-a275-481c0462f3a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:35.102316 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:24:35.129835 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 845/1690] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:24:34 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:24:35.131279 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39925c38-6fec-4384-9476-5c0d6ce11179 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:35.131570 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39925c38-6fec-4384-9476-5c0d6ce11179 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:35.131848 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39925c38-6fec-4384-9476-5c0d6ce11179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:35.152344 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:24:35.171564 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-39925c38-6fec-4384-9476-5c0d6ce11179 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:24:35.174559 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-39925c38-6fec-4384-9476-5c0d6ce11179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:35.231784 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b158be8e-5e44-4abb-a275-481c0462f3a8 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:35.240579 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a820d3e4-c928-4954-8afd-184adb67439c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:35.242498 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a820d3e4-c928-4954-8afd-184adb67439c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:35.243013 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a820d3e4-c928-4954-8afd-184adb67439c admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:35.243639 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a820d3e4-c928-4954-8afd-184adb67439c admin admin] PATH_INFO: `/v3/users/88212dd303a0466f9c0d8be22ccd14f5` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:35.245612 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a820d3e4-c928-4954-8afd-184adb67439c admin admin] RBAC: Authorizing `identity:delete_user(user_id=88212dd303a0466f9c0d8be22ccd14f5)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:35.248615 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a820d3e4-c928-4954-8afd-184adb67439c admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:35.388542 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 846/1691] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:24:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:24:35.396625 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f1d2d-c0c4-41ba-b967-471808422868 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:35.396917 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f1d2d-c0c4-41ba-b967-471808422868 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:35.397196 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f1d2d-c0c4-41ba-b967-471808422868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:35.414617 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-a820d3e4-c928-4954-8afd-184adb67439c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88212dd303a0466f9c0d8be22ccd14f5'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:35.429909 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-bd2f1d2d-c0c4-41ba-b967-471808422868 None None] MFA Rules not processed for user `fc120edcf30a4775a502c8e31811da4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:24:35.431344 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-bd2f1d2d-c0c4-41ba-b967-471808422868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:35.446050 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-a820d3e4-c928-4954-8afd-184adb67439c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88212dd303a0466f9c0d8be22ccd14f5'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:35.446978 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-a820d3e4-c928-4954-8afd-184adb67439c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88212dd303a0466f9c0d8be22ccd14f5'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:35.447717 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-a820d3e4-c928-4954-8afd-184adb67439c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88212dd303a0466f9c0d8be22ccd14f5'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:35.469805 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-a820d3e4-c928-4954-8afd-184adb67439c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88212dd303a0466f9c0d8be22ccd14f5'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:35.526125 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 846/1692] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:24:35 2022] DELETE /identity/v3/users/88212dd303a0466f9c0d8be22ccd14f5 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:24:35.527942 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f043cd2-1022-40db-b328-2ff7bf64d5cc None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:35.531730 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f043cd2-1022-40db-b328-2ff7bf64d5cc None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:35.532336 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f043cd2-1022-40db-b328-2ff7bf64d5cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:35.556943 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-3f043cd2-1022-40db-b328-2ff7bf64d5cc None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:24:35.558540 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-3f043cd2-1022-40db-b328-2ff7bf64d5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:35.593907 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 847/1693] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:24:35 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:24:35.595421 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d307b3cc-058e-4cfd-b100-32ba448feb18 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:35.595761 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d307b3cc-058e-4cfd-b100-32ba448feb18 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:35.596040 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d307b3cc-058e-4cfd-b100-32ba448feb18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:35.626176 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-d307b3cc-058e-4cfd-b100-32ba448feb18 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:24:35.629719 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-d307b3cc-058e-4cfd-b100-32ba448feb18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:35.698754 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 847/1694] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:24:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:24:35.699857 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f043cd2-1022-40db-b328-2ff7bf64d5cc None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:35.701432 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-3f043cd2-1022-40db-b328-2ff7bf64d5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:35.767756 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 848/1695] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:24:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:24:35.776782 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d307b3cc-058e-4cfd-b100-32ba448feb18 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:35.802636 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d307b3cc-058e-4cfd-b100-32ba448feb18 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:35.820598 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d3f7eb-a531-4585-9724-85ce13694141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:35.821252 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d3f7eb-a531-4585-9724-85ce13694141 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:35.821536 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d3f7eb-a531-4585-9724-85ce13694141 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:35.821816 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d3f7eb-a531-4585-9724-85ce13694141 admin admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:35.822593 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d3f7eb-a531-4585-9724-85ce13694141 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:24:35.822894 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d3f7eb-a531-4585-9724-85ce13694141 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:35.829307 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d3f7eb-a531-4585-9724-85ce13694141 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:35.837239 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:24:35.863564 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 849/1696] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 15 12:24:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:24:35.870341 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d223f7-7dcb-479e-913b-656465e4ab7f None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:35.870629 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d223f7-7dcb-479e-913b-656465e4ab7f None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:35.870934 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d223f7-7dcb-479e-913b-656465e4ab7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:35.917119 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f043cd2-1022-40db-b328-2ff7bf64d5cc None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:35.932727 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b518c2cd-9e60-4ff8-9c23-55055172b4f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d05c52570474820b4ba0e2cdad5c13f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:35.934558 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b518c2cd-9e60-4ff8-9c23-55055172b4f4 service nova] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:35.935976 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b518c2cd-9e60-4ff8-9c23-55055172b4f4 service nova] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:35.937884 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b518c2cd-9e60-4ff8-9c23-55055172b4f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:35.940488 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-69d223f7-7dcb-479e-913b-656465e4ab7f None None] MFA Rules not processed for user `983e501359234b31879e5cdfb34ea31a`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:24:35.941713 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-69d223f7-7dcb-479e-913b-656465e4ab7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:35.943538 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-b518c2cd-9e60-4ff8-9c23-55055172b4f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:35.988926 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:24:36.098029 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b518c2cd-9e60-4ff8-9c23-55055172b4f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:36.100392 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b518c2cd-9e60-4ff8-9c23-55055172b4f4 service nova] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:36.109592 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 850/1697] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:24:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:24:36.110349 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d223f7-7dcb-479e-913b-656465e4ab7f None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:36.115864 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-69d223f7-7dcb-479e-913b-656465e4ab7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:36.147862 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 848/1698] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:24:35 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:24:36.148836 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b518c2cd-9e60-4ff8-9c23-55055172b4f4 service nova] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:36.189455 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b518c2cd-9e60-4ff8-9c23-55055172b4f4 service nova] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:36.203298 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba52944-0624-4fbe-91cb-b6da3575a88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:36.204926 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba52944-0624-4fbe-91cb-b6da3575a88a admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:36.205235 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba52944-0624-4fbe-91cb-b6da3575a88a admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:36.205695 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba52944-0624-4fbe-91cb-b6da3575a88a admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:36.206364 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba52944-0624-4fbe-91cb-b6da3575a88a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:36.211790 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba52944-0624-4fbe-91cb-b6da3575a88a admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:36.239846 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d223f7-7dcb-479e-913b-656465e4ab7f None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:36.243816 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0865ed6b-2c94-4fe2-b360-1321e09968b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:36.244438 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0865ed6b-2c94-4fe2-b360-1321e09968b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:36.244714 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0865ed6b-2c94-4fe2-b360-1321e09968b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:36.244981 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0865ed6b-2c94-4fe2-b360-1321e09968b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:36.270132 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0865ed6b-2c94-4fe2-b360-1321e09968b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:36.271608 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0865ed6b-2c94-4fe2-b360-1321e09968b8 service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:36.295580 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 851/1699] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:24:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:24:36.297061 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0865ed6b-2c94-4fe2-b360-1321e09968b8 service neutron] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:36.303908 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-0865ed6b-2c94-4fe2-b360-1321e09968b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:36.312786 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 849/1700] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:24:36 2022] POST /identity/v3/projects => generated 373 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:24:36.313778 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba52944-0624-4fbe-91cb-b6da3575a88a admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:36.330958 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-aba52944-0624-4fbe-91cb-b6da3575a88a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:36.341065 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0865ed6b-2c94-4fe2-b360-1321e09968b8 service neutron] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:36.505814 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31ba00f-0555-4738-b374-16873b9be24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:36.506735 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ba00f-0555-4738-b374-16873b9be24c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:36.507230 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ba00f-0555-4738-b374-16873b9be24c admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:36.507694 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ba00f-0555-4738-b374-16873b9be24c admin admin] PATH_INFO: `/v3/projects/9bb9367e40984f859665ab43d67be52c` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:36.523394 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31ba00f-0555-4738-b374-16873b9be24c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bb9367e40984f859665ab43d67be52c)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:36.528721 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31ba00f-0555-4738-b374-16873b9be24c admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:36.587486 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba52944-0624-4fbe-91cb-b6da3575a88a admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:36.615158 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c21e507-a75d-463e-a874-c54d77a5c44b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d05c52570474820b4ba0e2cdad5c13f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:36.615880 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21e507-a75d-463e-a874-c54d77a5c44b service nova] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:36.616863 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21e507-a75d-463e-a874-c54d77a5c44b service nova] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:36.617164 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21e507-a75d-463e-a874-c54d77a5c44b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:36.655338 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-f31ba00f-0555-4738-b374-16873b9be24c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bb9367e40984f859665ab43d67be52c', 'request_id': 'req-f31ba00f-0555-4738-b374-16873b9be24c'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:36.675424 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-f31ba00f-0555-4738-b374-16873b9be24c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bb9367e40984f859665ab43d67be52c', 'request_id': 'req-f31ba00f-0555-4738-b374-16873b9be24c'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:36.710550 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-f31ba00f-0555-4738-b374-16873b9be24c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bb9367e40984f859665ab43d67be52c', 'request_id': 'req-f31ba00f-0555-4738-b374-16873b9be24c'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:36.712861 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:24:36.753656 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-f31ba00f-0555-4738-b374-16873b9be24c admin admin] The token cache is being invalidate because project 9bb9367e40984f859665ab43d67be52c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:24:36.754100 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-f31ba00f-0555-4738-b374-16873b9be24c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:36.755058 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-f31ba00f-0555-4738-b374-16873b9be24c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:36.766737 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 852/1701] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:24:36 2022] DELETE /identity/v3/projects/9bb9367e40984f859665ab43d67be52c => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:24:36.766737 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31ba00f-0555-4738-b374-16873b9be24c admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:36.770143 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-f31ba00f-0555-4738-b374-16873b9be24c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:36.816446 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:24:36.825969 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c21e507-a75d-463e-a874-c54d77a5c44b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:36.836960 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c21e507-a75d-463e-a874-c54d77a5c44b service nova] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:36.897867 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 850/1702] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:24:36 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 585 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:24:36.906136 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f1f2dc-808e-4864-9925-e41b50d2576e None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:36.906441 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f1f2dc-808e-4864-9925-e41b50d2576e None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:36.911091 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f1f2dc-808e-4864-9925-e41b50d2576e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:36.982674 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-18f1f2dc-808e-4864-9925-e41b50d2576e None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:24:36.987496 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-18f1f2dc-808e-4864-9925-e41b50d2576e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:37.044670 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31ba00f-0555-4738-b374-16873b9be24c admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:37.063473 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d117b3-b8ab-4961-81e5-0b4303b8a650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:37.064119 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d117b3-b8ab-4961-81e5-0b4303b8a650 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:37.064403 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d117b3-b8ab-4961-81e5-0b4303b8a650 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:37.064676 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d117b3-b8ab-4961-81e5-0b4303b8a650 admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:37.065320 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d117b3-b8ab-4961-81e5-0b4303b8a650 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:37.067296 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d117b3-b8ab-4961-81e5-0b4303b8a650 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:37.124982 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 853/1703] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:24:36 2022] POST /identity/v3/users => generated 287 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:24:37.129226 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d117b3-b8ab-4961-81e5-0b4303b8a650 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:37.150530 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d117b3-b8ab-4961-81e5-0b4303b8a650 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:37.169784 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363d5d55-11fc-453e-ab5d-5fa862363a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:37.170356 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d5d55-11fc-453e-ab5d-5fa862363a84 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:37.170629 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d5d55-11fc-453e-ab5d-5fa862363a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:37.171570 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d5d55-11fc-453e-ab5d-5fa862363a84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:37.172215 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363d5d55-11fc-453e-ab5d-5fa862363a84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:37.174404 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363d5d55-11fc-453e-ab5d-5fa862363a84 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:37.183230 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 851/1704] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:24:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:24:37.188015 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef82fd-df84-49f9-8167-66a62de896e1 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:37.188372 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef82fd-df84-49f9-8167-66a62de896e1 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:37.188652 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef82fd-df84-49f9-8167-66a62de896e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:37.202738 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 854/1705] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:24:37 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:24:37.206939 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363d5d55-11fc-453e-ab5d-5fa862363a84 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:37.239139 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363d5d55-11fc-453e-ab5d-5fa862363a84 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:37.242784 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-d2ef82fd-df84-49f9-8167-66a62de896e1 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:24:37.247725 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-d2ef82fd-df84-49f9-8167-66a62de896e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:37.257000 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b79ef73-f23f-4bbb-b0fe-7fe57b1e2c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:37.257613 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b79ef73-f23f-4bbb-b0fe-7fe57b1e2c47 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:37.257890 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b79ef73-f23f-4bbb-b0fe-7fe57b1e2c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:37.258156 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b79ef73-f23f-4bbb-b0fe-7fe57b1e2c47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:37.258976 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b79ef73-f23f-4bbb-b0fe-7fe57b1e2c47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:37.260464 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b79ef73-f23f-4bbb-b0fe-7fe57b1e2c47 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:37.283086 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 852/1706] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:24:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:24:37.287205 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ef82fd-df84-49f9-8167-66a62de896e1 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:37.307608 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 855/1707] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:24:37 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 12:24:37.308721 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b79ef73-f23f-4bbb-b0fe-7fe57b1e2c47 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:37.312589 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ef82fd-df84-49f9-8167-66a62de896e1 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:37.320189 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1209ff-93df-4020-a21f-2d9bb295d19c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:37.320878 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1209ff-93df-4020-a21f-2d9bb295d19c admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:37.321207 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1209ff-93df-4020-a21f-2d9bb295d19c admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:37.321480 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1209ff-93df-4020-a21f-2d9bb295d19c admin admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:37.322188 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1209ff-93df-4020-a21f-2d9bb295d19c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:24:37.322492 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1209ff-93df-4020-a21f-2d9bb295d19c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:37.324236 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1209ff-93df-4020-a21f-2d9bb295d19c admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:37.348216 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b79ef73-f23f-4bbb-b0fe-7fe57b1e2c47 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:37.363415 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 853/1708] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 15 12:24:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:24:37.364387 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1209ff-93df-4020-a21f-2d9bb295d19c admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:37.365614 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b07d68-c0d6-4f84-8628-3e6ea678b9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:37.366300 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b07d68-c0d6-4f84-8628-3e6ea678b9b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:37.366580 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b07d68-c0d6-4f84-8628-3e6ea678b9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:37.366878 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b07d68-c0d6-4f84-8628-3e6ea678b9b6 admin admin] PATH_INFO: `/v3/projects/bfe9374e562f48319e49c1b8692be447/users/e47ea7a2f72447b0be317bbf3358d110/roles/9371e5bbc55848949eb951a815f817f2` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:37.380482 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1209ff-93df-4020-a21f-2d9bb295d19c admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:37.396003 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf5cefa-8dde-4b30-93c0-5a6229d52a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:37.396641 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf5cefa-8dde-4b30-93c0-5a6229d52a0b admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:37.396940 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf5cefa-8dde-4b30-93c0-5a6229d52a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:37.397184 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf5cefa-8dde-4b30-93c0-5a6229d52a0b admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:37.397830 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf5cefa-8dde-4b30-93c0-5a6229d52a0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:37.399979 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf5cefa-8dde-4b30-93c0-5a6229d52a0b admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:37.411671 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b07d68-c0d6-4f84-8628-3e6ea678b9b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfe9374e562f48319e49c1b8692be447, user_id=e47ea7a2f72447b0be317bbf3358d110, role_id=9371e5bbc55848949eb951a815f817f2)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:37.414388 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b07d68-c0d6-4f84-8628-3e6ea678b9b6 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:37.445357 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 856/1709] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:24:37 2022] PUT /identity/v3/projects/bfe9374e562f48319e49c1b8692be447/users/e47ea7a2f72447b0be317bbf3358d110/roles/9371e5bbc55848949eb951a815f817f2 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:24:37.457303 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9650fb5-4552-4d56-a1af-34e6e7341f27 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:37.457939 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9650fb5-4552-4d56-a1af-34e6e7341f27 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:37.458405 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9650fb5-4552-4d56-a1af-34e6e7341f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:37.485922 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 854/1710] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:24:37 2022] POST /identity/v3/projects => generated 387 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:24:37.487094 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf5cefa-8dde-4b30-93c0-5a6229d52a0b admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:37.533419 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-a9650fb5-4552-4d56-a1af-34e6e7341f27 None None] MFA Rules not processed for user `e47ea7a2f72447b0be317bbf3358d110`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:24:37.537766 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-a9650fb5-4552-4d56-a1af-34e6e7341f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:37.663755 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf5cefa-8dde-4b30-93c0-5a6229d52a0b admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:37.677157 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eba4d31-24f1-42e4-a355-b737d44d2ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:37.677965 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eba4d31-24f1-42e4-a355-b737d44d2ad7 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:37.678254 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eba4d31-24f1-42e4-a355-b737d44d2ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:37.678526 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eba4d31-24f1-42e4-a355-b737d44d2ad7 admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:37.680418 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eba4d31-24f1-42e4-a355-b737d44d2ad7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:37.685265 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eba4d31-24f1-42e4-a355-b737d44d2ad7 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:37.721820 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 857/1711] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:24:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:24:37.723295 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a7b18-37c7-4d4a-be55-2bccaa6f2862 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:37.724032 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a7b18-37c7-4d4a-be55-2bccaa6f2862 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:37.724032 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a7b18-37c7-4d4a-be55-2bccaa6f2862 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:37.725568 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 858/1712] 10.222.0.16 () {54 vars in 912 bytes} [Thu Sep 15 12:24:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:24:37.736670 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a7b18-37c7-4d4a-be55-2bccaa6f2862 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:37.750431 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 855/1713] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:24:37 2022] POST /identity/v3/users => generated 294 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:24:37.752356 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd8f13-7789-4a56-9347-7c80c662745f None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:37.754842 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd8f13-7789-4a56-9347-7c80c662745f None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:37.756924 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd8f13-7789-4a56-9347-7c80c662745f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:37.787252 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a7b18-37c7-4d4a-be55-2bccaa6f2862 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:37.801578 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6c68f8-d04f-4f71-b1fe-7324cce9ca1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:37.802511 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c68f8-d04f-4f71-b1fe-7324cce9ca1b admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:37.802908 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c68f8-d04f-4f71-b1fe-7324cce9ca1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:37.804541 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c68f8-d04f-4f71-b1fe-7324cce9ca1b admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:37.810395 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6c68f8-d04f-4f71-b1fe-7324cce9ca1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:37.815392 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6c68f8-d04f-4f71-b1fe-7324cce9ca1b admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:37.868190 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-11dd8f13-7789-4a56-9347-7c80c662745f None None] MFA Rules not processed for user `4003dbcee8104aa4a7ce90251bab88a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:24:37.878168 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-11dd8f13-7789-4a56-9347-7c80c662745f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:37.895528 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 859/1714] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:24:37 2022] POST /identity/v3/projects => generated 373 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 12:24:37.897219 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6c68f8-d04f-4f71-b1fe-7324cce9ca1b admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:37.910922 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:INSERT=6,keystone:DELETE=1,keystone:SELECT=93 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:24:37.946841 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:24:38.007127 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 856/1715] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Sep 15 12:24:37 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:24:38.018256 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dd8f13-7789-4a56-9347-7c80c662745f None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:38.046008 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dd8f13-7789-4a56-9347-7c80c662745f None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:38.106198 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6c68f8-d04f-4f71-b1fe-7324cce9ca1b admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:38.123161 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69e9d46-0bf2-45dc-972f-3d8a7a5cb887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:38.124142 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69e9d46-0bf2-45dc-972f-3d8a7a5cb887 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:38.124642 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69e9d46-0bf2-45dc-972f-3d8a7a5cb887 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:38.125102 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69e9d46-0bf2-45dc-972f-3d8a7a5cb887 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:38.126054 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69e9d46-0bf2-45dc-972f-3d8a7a5cb887 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:38.128156 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69e9d46-0bf2-45dc-972f-3d8a7a5cb887 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:38.161456 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 860/1716] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:24:37 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:24:38.162561 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69e9d46-0bf2-45dc-972f-3d8a7a5cb887 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:38.166020 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea4aade-8263-4f59-9329-3c68f5fb1e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:38.166754 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea4aade-8263-4f59-9329-3c68f5fb1e37 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:38.167042 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea4aade-8263-4f59-9329-3c68f5fb1e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:38.167354 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea4aade-8263-4f59-9329-3c68f5fb1e37 admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:38.168222 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-e69e9d46-0bf2-45dc-972f-3d8a7a5cb887 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:38.168395 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea4aade-8263-4f59-9329-3c68f5fb1e37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:38.172363 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea4aade-8263-4f59-9329-3c68f5fb1e37 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:38.228954 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 857/1717] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:24:38 2022] POST /identity/v3/users => generated 293 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:24:38.231249 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea4aade-8263-4f59-9329-3c68f5fb1e37 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:38.256415 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea4aade-8263-4f59-9329-3c68f5fb1e37 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:38.273736 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ffe629-9025-493a-be39-4bbee25511d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:38.276105 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ffe629-9025-493a-be39-4bbee25511d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:38.276105 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ffe629-9025-493a-be39-4bbee25511d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:38.276452 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ffe629-9025-493a-be39-4bbee25511d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:38.277595 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ffe629-9025-493a-be39-4bbee25511d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:38.282279 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ffe629-9025-493a-be39-4bbee25511d1 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:38.299830 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69e9d46-0bf2-45dc-972f-3d8a7a5cb887 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:38.310583 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e6452-cbcd-4848-ab28-b1b2787371d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:38.312026 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e6452-cbcd-4848-ab28-b1b2787371d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:38.312395 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e6452-cbcd-4848-ab28-b1b2787371d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:38.312949 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e6452-cbcd-4848-ab28-b1b2787371d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:38.317283 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 858/1718] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:24:38 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:24:38.318283 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ffe629-9025-493a-be39-4bbee25511d1 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:38.340821 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1e6452-cbcd-4848-ab28-b1b2787371d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:38.342228 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ffe629-9025-493a-be39-4bbee25511d1 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:38.342851 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1e6452-cbcd-4848-ab28-b1b2787371d3 service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:38.362342 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9e75ad-a335-4e23-9ea2-71c5a396f0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:38.363022 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e75ad-a335-4e23-9ea2-71c5a396f0f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:38.363290 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e75ad-a335-4e23-9ea2-71c5a396f0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:38.363562 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e75ad-a335-4e23-9ea2-71c5a396f0f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:38.363880 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 861/1719] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:24:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:24:38.364221 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9e75ad-a335-4e23-9ea2-71c5a396f0f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:38.365400 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e6452-cbcd-4848-ab28-b1b2787371d3 service neutron] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:38.369185 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9e75ad-a335-4e23-9ea2-71c5a396f0f1 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:38.401963 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e6452-cbcd-4848-ab28-b1b2787371d3 service neutron] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:38.403359 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 859/1720] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:24:38 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:24:38.404661 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9e75ad-a335-4e23-9ea2-71c5a396f0f1 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:38.413242 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f81162-8935-4f85-8b14-2f653121acd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:38.414114 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f81162-8935-4f85-8b14-2f653121acd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:38.414500 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f81162-8935-4f85-8b14-2f653121acd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:38.414918 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f81162-8935-4f85-8b14-2f653121acd2 admin admin] PATH_INFO: `/v3/projects/910624dc07cf40c0888a29d8119e00bd/users/b7fec6ec9ac94257a1da8c35a1b422c3/roles/9371e5bbc55848949eb951a815f817f2` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:38.431450 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9e75ad-a335-4e23-9ea2-71c5a396f0f1 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:38.446734 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6897e44f-382d-4bce-9171-bf5476a8e33e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:38.447769 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897e44f-382d-4bce-9171-bf5476a8e33e admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:38.448082 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897e44f-382d-4bce-9171-bf5476a8e33e admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:38.448341 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897e44f-382d-4bce-9171-bf5476a8e33e admin admin] PATH_INFO: `/v3/projects/d38de732d9894c22936d6cfaf9c4d779/users/aba1025e340140f79da7c8b479d1ecd3/roles/7f53f1c823b746529ba5057bf21b2477` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:38.455752 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f81162-8935-4f85-8b14-2f653121acd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=910624dc07cf40c0888a29d8119e00bd, user_id=b7fec6ec9ac94257a1da8c35a1b422c3, role_id=9371e5bbc55848949eb951a815f817f2)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:38.458517 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f81162-8935-4f85-8b14-2f653121acd2 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:38.487040 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 862/1721] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:24:38 2022] PUT /identity/v3/projects/910624dc07cf40c0888a29d8119e00bd/users/b7fec6ec9ac94257a1da8c35a1b422c3/roles/9371e5bbc55848949eb951a815f817f2 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:24:38.498550 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d4d6db-a754-4b1a-aec8-c6332c98d68a None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:38.499723 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d4d6db-a754-4b1a-aec8-c6332c98d68a None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:38.500194 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d4d6db-a754-4b1a-aec8-c6332c98d68a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:38.500992 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6897e44f-382d-4bce-9171-bf5476a8e33e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d38de732d9894c22936d6cfaf9c4d779, user_id=aba1025e340140f79da7c8b479d1ecd3, role_id=7f53f1c823b746529ba5057bf21b2477)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:38.503988 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6897e44f-382d-4bce-9171-bf5476a8e33e admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:38.529870 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 860/1722] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:24:38 2022] PUT /identity/v3/projects/d38de732d9894c22936d6cfaf9c4d779/users/aba1025e340140f79da7c8b479d1ecd3/roles/7f53f1c823b746529ba5057bf21b2477 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:24:38.531300 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6897e44f-382d-4bce-9171-bf5476a8e33e admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:38.571849 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-24d4d6db-a754-4b1a-aec8-c6332c98d68a None None] MFA Rules not processed for user `b7fec6ec9ac94257a1da8c35a1b422c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:24:38.573225 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-24d4d6db-a754-4b1a-aec8-c6332c98d68a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:38.671233 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6897e44f-382d-4bce-9171-bf5476a8e33e admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:38.677352 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a49b4b-144b-45dd-973b-7eed8eacc05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:38.678218 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a49b4b-144b-45dd-973b-7eed8eacc05d admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:38.678643 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a49b4b-144b-45dd-973b-7eed8eacc05d admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:38.679370 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a49b4b-144b-45dd-973b-7eed8eacc05d admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:38.680165 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a49b4b-144b-45dd-973b-7eed8eacc05d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:38.682121 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a49b4b-144b-45dd-973b-7eed8eacc05d admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:38.701774 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 861/1723] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:24:38 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:24:38.703100 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a49b4b-144b-45dd-973b-7eed8eacc05d admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:38.716676 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a49b4b-144b-45dd-973b-7eed8eacc05d admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:38.723853 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aafd0cf-1364-46ce-9d0a-6d01588cf7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:38.724956 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aafd0cf-1364-46ce-9d0a-6d01588cf7c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:38.725679 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aafd0cf-1364-46ce-9d0a-6d01588cf7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:38.726477 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aafd0cf-1364-46ce-9d0a-6d01588cf7c5 admin admin] PATH_INFO: `/v3/projects/d38de732d9894c22936d6cfaf9c4d779/users/aba1025e340140f79da7c8b479d1ecd3/roles/7f53f1c823b746529ba5057bf21b2477` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:38.731180 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aafd0cf-1364-46ce-9d0a-6d01588cf7c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d38de732d9894c22936d6cfaf9c4d779, user_id=aba1025e340140f79da7c8b479d1ecd3, role_id=7f53f1c823b746529ba5057bf21b2477)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:38.736960 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aafd0cf-1364-46ce-9d0a-6d01588cf7c5 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:38.746092 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 863/1724] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:24:38 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:24:38.747303 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d4d6db-a754-4b1a-aec8-c6332c98d68a None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:38.770983 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d4d6db-a754-4b1a-aec8-c6332c98d68a None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:38.775218 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 862/1725] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:24:38 2022] PUT /identity/v3/projects/d38de732d9894c22936d6cfaf9c4d779/users/aba1025e340140f79da7c8b479d1ecd3/roles/7f53f1c823b746529ba5057bf21b2477 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:24:38.778060 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba86607-beec-4cf2-b9c9-db495553d70a None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:38.778324 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba86607-beec-4cf2-b9c9-db495553d70a None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:38.779523 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba86607-beec-4cf2-b9c9-db495553d70a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:38.781355 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:24:38.820059 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:24:38.856199 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-dba86607-beec-4cf2-b9c9-db495553d70a None None] MFA Rules not processed for user `aba1025e340140f79da7c8b479d1ecd3`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:24:38.862255 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-dba86607-beec-4cf2-b9c9-db495553d70a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:38.908815 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67605c0-d013-467e-9a57-33a250af8e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:38.909610 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67605c0-d013-467e-9a57-33a250af8e44 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:38.910013 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67605c0-d013-467e-9a57-33a250af8e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:38.910387 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67605c0-d013-467e-9a57-33a250af8e44 admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:38.911190 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67605c0-d013-467e-9a57-33a250af8e44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:38.913249 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67605c0-d013-467e-9a57-33a250af8e44 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:38.975718 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 864/1726] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:24:38 2022] POST /identity/v3/projects => generated 385 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:24:38.977053 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67605c0-d013-467e-9a57-33a250af8e44 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:39.043565 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 863/1727] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:24:38 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:24:39.058938 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba86607-beec-4cf2-b9c9-db495553d70a None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:39.061513 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-dba86607-beec-4cf2-b9c9-db495553d70a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:39.144595 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67605c0-d013-467e-9a57-33a250af8e44 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:39.160455 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df5852d-e290-4224-86ce-8beeb35cdd0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:39.161261 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df5852d-e290-4224-86ce-8beeb35cdd0a admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:39.161911 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df5852d-e290-4224-86ce-8beeb35cdd0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:39.161911 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df5852d-e290-4224-86ce-8beeb35cdd0a admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:39.162800 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df5852d-e290-4224-86ce-8beeb35cdd0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:39.165645 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df5852d-e290-4224-86ce-8beeb35cdd0a admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:39.192275 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba86607-beec-4cf2-b9c9-db495553d70a None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:39.228852 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 865/1728] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:24:38 2022] POST /identity/v3/users => generated 299 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:24:39.231354 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df5852d-e290-4224-86ce-8beeb35cdd0a admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:39.267243 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df5852d-e290-4224-86ce-8beeb35cdd0a admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:39.281165 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b795d8e7-e043-4027-8e27-8e2ab0295306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:39.281801 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b795d8e7-e043-4027-8e27-8e2ab0295306 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:39.285154 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b795d8e7-e043-4027-8e27-8e2ab0295306 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:39.285556 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b795d8e7-e043-4027-8e27-8e2ab0295306 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:39.287291 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b795d8e7-e043-4027-8e27-8e2ab0295306 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:39.293262 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b795d8e7-e043-4027-8e27-8e2ab0295306 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:39.317626 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 866/1729] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:24:39 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:24:39.322637 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b795d8e7-e043-4027-8e27-8e2ab0295306 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:39.340342 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b795d8e7-e043-4027-8e27-8e2ab0295306 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:39.351138 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6d9380-0917-4124-9b0f-0e5a5eba299b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:39.352069 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d9380-0917-4124-9b0f-0e5a5eba299b admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:39.354168 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d9380-0917-4124-9b0f-0e5a5eba299b admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:39.354617 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d9380-0917-4124-9b0f-0e5a5eba299b admin admin] PATH_INFO: `/v3/projects/5e87df36289a44ecb3a40a57ef9e6ce9/users/d9f0f872e7814a46824a0731d498c7f1/roles/7f53f1c823b746529ba5057bf21b2477` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:39.392483 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6d9380-0917-4124-9b0f-0e5a5eba299b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e87df36289a44ecb3a40a57ef9e6ce9, user_id=d9f0f872e7814a46824a0731d498c7f1, role_id=7f53f1c823b746529ba5057bf21b2477)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:39.395966 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6d9380-0917-4124-9b0f-0e5a5eba299b admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:39.398304 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989211f5-d652-40b6-809c-fb9dd680796b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceafc5e4283841528053f01931f10293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:39.398993 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989211f5-d652-40b6-809c-fb9dd680796b service cinder] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:39.399277 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989211f5-d652-40b6-809c-fb9dd680796b service cinder] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:39.399546 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989211f5-d652-40b6-809c-fb9dd680796b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:39.431726 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 867/1730] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:24:39 2022] PUT /identity/v3/projects/5e87df36289a44ecb3a40a57ef9e6ce9/users/d9f0f872e7814a46824a0731d498c7f1/roles/7f53f1c823b746529ba5057bf21b2477 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:24:39.435721 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6d9380-0917-4124-9b0f-0e5a5eba299b admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:39.547876 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:24:39.568787 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6d9380-0917-4124-9b0f-0e5a5eba299b admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:39.575933 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98b9b4e-70d4-4304-beac-9d123e3dd0ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:39.577578 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b9b4e-70d4-4304-beac-9d123e3dd0ba admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:39.578027 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b9b4e-70d4-4304-beac-9d123e3dd0ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:39.578464 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b9b4e-70d4-4304-beac-9d123e3dd0ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:39.579281 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98b9b4e-70d4-4304-beac-9d123e3dd0ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:39.581229 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98b9b4e-70d4-4304-beac-9d123e3dd0ba admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:39.603661 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 868/1731] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:24:39 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 12:24:39.603661 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98b9b4e-70d4-4304-beac-9d123e3dd0ba admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:39.605502 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-c98b9b4e-70d4-4304-beac-9d123e3dd0ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:39.628003 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98b9b4e-70d4-4304-beac-9d123e3dd0ba admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:39.633261 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219e7f95-da25-455a-bfdf-1545c5577381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:39.633977 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e7f95-da25-455a-bfdf-1545c5577381 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:39.634338 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e7f95-da25-455a-bfdf-1545c5577381 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:39.634767 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e7f95-da25-455a-bfdf-1545c5577381 admin admin] PATH_INFO: `/v3/projects/fb07037e0de54bffa9d4f2595f17793f` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:39.636244 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219e7f95-da25-455a-bfdf-1545c5577381 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb07037e0de54bffa9d4f2595f17793f)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:39.638480 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219e7f95-da25-455a-bfdf-1545c5577381 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:39.660994 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989211f5-d652-40b6-809c-fb9dd680796b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:39.668345 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989211f5-d652-40b6-809c-fb9dd680796b service cinder] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:39.683218 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:24:39.731400 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 864/1732] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:24:39 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 673 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:24:39.733762 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989211f5-d652-40b6-809c-fb9dd680796b service cinder] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:39.758042 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-219e7f95-da25-455a-bfdf-1545c5577381 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb07037e0de54bffa9d4f2595f17793f', 'request_id': 'req-219e7f95-da25-455a-bfdf-1545c5577381'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:39.773040 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-219e7f95-da25-455a-bfdf-1545c5577381 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb07037e0de54bffa9d4f2595f17793f', 'request_id': 'req-219e7f95-da25-455a-bfdf-1545c5577381'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:39.774915 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989211f5-d652-40b6-809c-fb9dd680796b service cinder] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:39.782796 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-219e7f95-da25-455a-bfdf-1545c5577381 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb07037e0de54bffa9d4f2595f17793f', 'request_id': 'req-219e7f95-da25-455a-bfdf-1545c5577381'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:39.805157 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-219e7f95-da25-455a-bfdf-1545c5577381 admin admin] The token cache is being invalidate because project fb07037e0de54bffa9d4f2595f17793f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:24:39.805543 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-219e7f95-da25-455a-bfdf-1545c5577381 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:39.808242 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-219e7f95-da25-455a-bfdf-1545c5577381 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:39.813152 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 869/1733] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:24:39 2022] DELETE /identity/v3/projects/fb07037e0de54bffa9d4f2595f17793f => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:24:39.814593 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ecda1-544c-408d-ae86-03180ca7451a None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:39.816272 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ecda1-544c-408d-ae86-03180ca7451a None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:39.816622 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ecda1-544c-408d-ae86-03180ca7451a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:39.865540 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-984ecda1-544c-408d-ae86-03180ca7451a None None] MFA Rules not processed for user `2c5895375da54d2e9b51d59de4f98fe7`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:24:39.867762 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-984ecda1-544c-408d-ae86-03180ca7451a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:39.986419 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacba343-e4d3-4a08-8f8b-20a007828263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:39.987234 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacba343-e4d3-4a08-8f8b-20a007828263 admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:39.988043 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacba343-e4d3-4a08-8f8b-20a007828263 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:39.988465 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacba343-e4d3-4a08-8f8b-20a007828263 admin admin] PATH_INFO: `/v3/projects/5e87df36289a44ecb3a40a57ef9e6ce9/users/d9f0f872e7814a46824a0731d498c7f1/roles/7f53f1c823b746529ba5057bf21b2477` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:39.993737 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacba343-e4d3-4a08-8f8b-20a007828263 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e87df36289a44ecb3a40a57ef9e6ce9, user_id=d9f0f872e7814a46824a0731d498c7f1, role_id=7f53f1c823b746529ba5057bf21b2477)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:39.997258 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacba343-e4d3-4a08-8f8b-20a007828263 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:40.027631 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 865/1734] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:24:39 2022] PUT /identity/v3/projects/5e87df36289a44ecb3a40a57ef9e6ce9/users/d9f0f872e7814a46824a0731d498c7f1/roles/7f53f1c823b746529ba5057bf21b2477 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:24:40.031071 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacba343-e4d3-4a08-8f8b-20a007828263 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:40.037323 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-aacba343-e4d3-4a08-8f8b-20a007828263 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:40.058088 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 870/1735] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:24:39 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:24:40.059535 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984ecda1-544c-408d-ae86-03180ca7451a None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:40.069817 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-984ecda1-544c-408d-ae86-03180ca7451a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:40.211152 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacba343-e4d3-4a08-8f8b-20a007828263 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:40.222963 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1325cca1-df34-4ba4-888e-f6af8897b712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:40.223688 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1325cca1-df34-4ba4-888e-f6af8897b712 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:40.223976 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1325cca1-df34-4ba4-888e-f6af8897b712 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:40.224253 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1325cca1-df34-4ba4-888e-f6af8897b712 admin admin] PATH_INFO: `/v3/users/b621513e5af24061bdf6d4c4bdad1ac3` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:40.231053 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1325cca1-df34-4ba4-888e-f6af8897b712 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b621513e5af24061bdf6d4c4bdad1ac3)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:40.237673 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1325cca1-df34-4ba4-888e-f6af8897b712 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:40.303980 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984ecda1-544c-408d-ae86-03180ca7451a None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:40.324003 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:24:40.438225 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be0bae0-d264-46f8-ad00-b9ffc9b73503 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceafc5e4283841528053f01931f10293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:40.438911 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be0bae0-d264-46f8-ad00-b9ffc9b73503 service cinder] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:40.439145 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be0bae0-d264-46f8-ad00-b9ffc9b73503 service cinder] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:40.439414 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be0bae0-d264-46f8-ad00-b9ffc9b73503 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:40.443666 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-4be0bae0-d264-46f8-ad00-b9ffc9b73503 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:40.444223 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-1325cca1-df34-4ba4-888e-f6af8897b712 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b621513e5af24061bdf6d4c4bdad1ac3'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:40.471246 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-1325cca1-df34-4ba4-888e-f6af8897b712 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b621513e5af24061bdf6d4c4bdad1ac3'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:40.472309 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-1325cca1-df34-4ba4-888e-f6af8897b712 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b621513e5af24061bdf6d4c4bdad1ac3'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:40.473189 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-1325cca1-df34-4ba4-888e-f6af8897b712 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b621513e5af24061bdf6d4c4bdad1ac3'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:40.492064 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-1325cca1-df34-4ba4-888e-f6af8897b712 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b621513e5af24061bdf6d4c4bdad1ac3'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:40.524328 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 866/1736] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:24:40 2022] DELETE /identity/v3/users/b621513e5af24061bdf6d4c4bdad1ac3 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:24:40.526125 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602ba4c-97dc-4826-93ca-946af5b72b5e None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:40.526553 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602ba4c-97dc-4826-93ca-946af5b72b5e None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:40.527092 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602ba4c-97dc-4826-93ca-946af5b72b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:40.557437 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:24:40.569718 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-2602ba4c-97dc-4826-93ca-946af5b72b5e None None] MFA Rules not processed for user `d9f0f872e7814a46824a0731d498c7f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:24:40.572611 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-2602ba4c-97dc-4826-93ca-946af5b72b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:40.610749 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be0bae0-d264-46f8-ad00-b9ffc9b73503 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:40.612218 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be0bae0-d264-46f8-ad00-b9ffc9b73503 service cinder] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:40.631716 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 871/1737] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:24:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 573 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:24:40.632584 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be0bae0-d264-46f8-ad00-b9ffc9b73503 service cinder] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:40.641740 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-4be0bae0-d264-46f8-ad00-b9ffc9b73503 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:40.685233 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 867/1738] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:24:40 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:24:40.685233 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2602ba4c-97dc-4826-93ca-946af5b72b5e None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:40.687171 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-2602ba4c-97dc-4826-93ca-946af5b72b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:40.879720 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2602ba4c-97dc-4826-93ca-946af5b72b5e None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:40.887746 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be0bae0-d264-46f8-ad00-b9ffc9b73503 service cinder] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:40.896820 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c178269-5bf1-425b-aac0-ba939e1c23e8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ff8a5ddf1e422ca97f92bd9d4e5fb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:40.897388 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c178269-5bf1-425b-aac0-ba939e1c23e8 service placement] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:40.898330 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c178269-5bf1-425b-aac0-ba939e1c23e8 service placement] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:40.898618 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c178269-5bf1-425b-aac0-ba939e1c23e8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:40.905654 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-4c178269-5bf1-425b-aac0-ba939e1c23e8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:40.948703 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c178269-5bf1-425b-aac0-ba939e1c23e8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:40.950389 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c178269-5bf1-425b-aac0-ba939e1c23e8 service placement] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:41.000735 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 868/1739] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:24:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:24:41.020032 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd80a987-2be5-4a6d-9bee-b387eea6c3cf None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:41.021873 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd80a987-2be5-4a6d-9bee-b387eea6c3cf None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:41.022427 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd80a987-2be5-4a6d-9bee-b387eea6c3cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:41.067074 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:24:41.086230 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46647e8e-7023-4ff4-bb02-24cdf22b1c2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d05c52570474820b4ba0e2cdad5c13f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:41.086818 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46647e8e-7023-4ff4-bb02-24cdf22b1c2e service nova] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:41.087100 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46647e8e-7023-4ff4-bb02-24cdf22b1c2e service nova] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:41.087374 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46647e8e-7023-4ff4-bb02-24cdf22b1c2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:41.089420 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-46647e8e-7023-4ff4-bb02-24cdf22b1c2e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:41.106770 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-fd80a987-2be5-4a6d-9bee-b387eea6c3cf None None] MFA Rules not processed for user `fc120edcf30a4775a502c8e31811da4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:24:41.114941 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-fd80a987-2be5-4a6d-9bee-b387eea6c3cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:41.251399 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46647e8e-7023-4ff4-bb02-24cdf22b1c2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:41.253288 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46647e8e-7023-4ff4-bb02-24cdf22b1c2e service nova] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:41.272880 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 872/1740] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:24:40 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 640 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:24:41.273746 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46647e8e-7023-4ff4-bb02-24cdf22b1c2e service nova] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:41.275874 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-46647e8e-7023-4ff4-bb02-24cdf22b1c2e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:41.355125 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 869/1741] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:24:41 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:24:41.426659 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46647e8e-7023-4ff4-bb02-24cdf22b1c2e service nova] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:41.441157 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb27eca-eae3-46c8-88f9-7bf1b53ade00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceafc5e4283841528053f01931f10293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:41.441810 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb27eca-eae3-46c8-88f9-7bf1b53ade00 service cinder] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:41.442093 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb27eca-eae3-46c8-88f9-7bf1b53ade00 service cinder] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:41.442360 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb27eca-eae3-46c8-88f9-7bf1b53ade00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:41.473405 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb27eca-eae3-46c8-88f9-7bf1b53ade00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:41.479290 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb27eca-eae3-46c8-88f9-7bf1b53ade00 service cinder] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:41.517640 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 873/1742] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:24:41 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:24:41.734174 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd80a987-2be5-4a6d-9bee-b387eea6c3cf None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:41.736847 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-fd80a987-2be5-4a6d-9bee-b387eea6c3cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:41.936803 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:24:42.039941 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd80a987-2be5-4a6d-9bee-b387eea6c3cf None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:42.055857 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4153ade8-4ebd-4eca-a454-51914c660870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:42.056531 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4153ade8-4ebd-4eca-a454-51914c660870 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:42.056810 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4153ade8-4ebd-4eca-a454-51914c660870 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:42.057082 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4153ade8-4ebd-4eca-a454-51914c660870 admin admin] PATH_INFO: `/v3/users/b7fec6ec9ac94257a1da8c35a1b422c3` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:42.061825 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4153ade8-4ebd-4eca-a454-51914c660870 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7fec6ec9ac94257a1da8c35a1b422c3)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:42.064790 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4153ade8-4ebd-4eca-a454-51914c660870 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:42.195695 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-4153ade8-4ebd-4eca-a454-51914c660870 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7fec6ec9ac94257a1da8c35a1b422c3'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:42.216791 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-4153ade8-4ebd-4eca-a454-51914c660870 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7fec6ec9ac94257a1da8c35a1b422c3'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:42.217914 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-4153ade8-4ebd-4eca-a454-51914c660870 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7fec6ec9ac94257a1da8c35a1b422c3'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:42.218912 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-4153ade8-4ebd-4eca-a454-51914c660870 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7fec6ec9ac94257a1da8c35a1b422c3'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:42.238839 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-4153ade8-4ebd-4eca-a454-51914c660870 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7fec6ec9ac94257a1da8c35a1b422c3'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:42.292346 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 870/1743] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:24:41 2022] DELETE /identity/v3/users/b7fec6ec9ac94257a1da8c35a1b422c3 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:24:42.296846 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a03d6c-a3d3-4d0c-b0da-ed1ed4cf28bd None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:42.297360 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a03d6c-a3d3-4d0c-b0da-ed1ed4cf28bd None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:42.297449 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a03d6c-a3d3-4d0c-b0da-ed1ed4cf28bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:42.333943 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-32a03d6c-a3d3-4d0c-b0da-ed1ed4cf28bd None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:24:42.343398 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-32a03d6c-a3d3-4d0c-b0da-ed1ed4cf28bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:42.516239 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 874/1744] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:24:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:24:42.611712 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4153ade8-4ebd-4eca-a454-51914c660870 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:42.615882 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-4153ade8-4ebd-4eca-a454-51914c660870 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:42.821651 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4153ade8-4ebd-4eca-a454-51914c660870 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:42.847778 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51214c36-979d-42ad-a77b-1236eb3e299e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:42.848712 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51214c36-979d-42ad-a77b-1236eb3e299e service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:42.849129 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51214c36-979d-42ad-a77b-1236eb3e299e service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:42.849532 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51214c36-979d-42ad-a77b-1236eb3e299e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:42.891817 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51214c36-979d-42ad-a77b-1236eb3e299e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:42.893288 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51214c36-979d-42ad-a77b-1236eb3e299e service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:42.924199 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 871/1745] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:24:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 12:24:43.340082 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a03d6c-a3d3-4d0c-b0da-ed1ed4cf28bd None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:43.341515 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-32a03d6c-a3d3-4d0c-b0da-ed1ed4cf28bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:43.367365 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a03d6c-a3d3-4d0c-b0da-ed1ed4cf28bd None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:43.388381 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4eb506-a8c7-49bc-bb50-47703debb6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:43.389050 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4eb506-a8c7-49bc-bb50-47703debb6c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:43.389967 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4eb506-a8c7-49bc-bb50-47703debb6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:43.390244 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4eb506-a8c7-49bc-bb50-47703debb6c5 admin admin] PATH_INFO: `/v3/projects/0f173d1e2a8d4db8a8b5aa633943d5f3` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:43.394084 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4eb506-a8c7-49bc-bb50-47703debb6c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f173d1e2a8d4db8a8b5aa633943d5f3)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:43.399235 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4eb506-a8c7-49bc-bb50-47703debb6c5 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:43.489184 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:24:43.515423 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-2f4eb506-a8c7-49bc-bb50-47703debb6c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f173d1e2a8d4db8a8b5aa633943d5f3', 'request_id': 'req-2f4eb506-a8c7-49bc-bb50-47703debb6c5'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:43.531544 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-2f4eb506-a8c7-49bc-bb50-47703debb6c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f173d1e2a8d4db8a8b5aa633943d5f3', 'request_id': 'req-2f4eb506-a8c7-49bc-bb50-47703debb6c5'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:43.549575 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-2f4eb506-a8c7-49bc-bb50-47703debb6c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f173d1e2a8d4db8a8b5aa633943d5f3', 'request_id': 'req-2f4eb506-a8c7-49bc-bb50-47703debb6c5'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:43.588542 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-2f4eb506-a8c7-49bc-bb50-47703debb6c5 admin admin] The token cache is being invalidate because project 0f173d1e2a8d4db8a8b5aa633943d5f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:24:43.589004 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-2f4eb506-a8c7-49bc-bb50-47703debb6c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:43.592291 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-2f4eb506-a8c7-49bc-bb50-47703debb6c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:43.595059 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 875/1746] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:24:43 2022] DELETE /identity/v3/projects/0f173d1e2a8d4db8a8b5aa633943d5f3 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:24:43.600492 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee2e55-9015-4091-91d5-c2b234ca6770 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:43.600778 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee2e55-9015-4091-91d5-c2b234ca6770 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:43.601267 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee2e55-9015-4091-91d5-c2b234ca6770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:43.649644 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-5aee2e55-9015-4091-91d5-c2b234ca6770 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:24:43.651777 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-5aee2e55-9015-4091-91d5-c2b234ca6770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:43.690050 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb600a-d1cd-430d-b09f-3ee097b86501 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:43.690338 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb600a-d1cd-430d-b09f-3ee097b86501 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:43.690622 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb600a-d1cd-430d-b09f-3ee097b86501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:43.775829 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-26bb600a-d1cd-430d-b09f-3ee097b86501 None None] MFA Rules not processed for user `218bb1de31574611b85b60851252bc8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:24:43.777102 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-26bb600a-d1cd-430d-b09f-3ee097b86501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:43.801186 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:24:43.834908 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 872/1747] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:24:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:24:43.841882 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b1f451-751b-49b9-8b1f-742aa5278530 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:43.842208 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b1f451-751b-49b9-8b1f-742aa5278530 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:43.842550 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b1f451-751b-49b9-8b1f-742aa5278530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:43.887132 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-a8b1f451-751b-49b9-8b1f-742aa5278530 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:24:43.891348 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-a8b1f451-751b-49b9-8b1f-742aa5278530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:43.928247 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 873/1748] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:24:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:24:43.932467 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b1f451-751b-49b9-8b1f-742aa5278530 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:43.952865 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b1f451-751b-49b9-8b1f-742aa5278530 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:43.970622 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e2ad3c-6cc4-4244-b98f-8d6c747ca4e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:43.971736 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e2ad3c-6cc4-4244-b98f-8d6c747ca4e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:43.972209 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e2ad3c-6cc4-4244-b98f-8d6c747ca4e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:43.972651 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e2ad3c-6cc4-4244-b98f-8d6c747ca4e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:43.973474 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e2ad3c-6cc4-4244-b98f-8d6c747ca4e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:24:43.973957 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e2ad3c-6cc4-4244-b98f-8d6c747ca4e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:43.975964 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e2ad3c-6cc4-4244-b98f-8d6c747ca4e7 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:43.997800 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 876/1749] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:24:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:24:44.001116 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 874/1750] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 15 12:24:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:24:44.013803 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bb600a-d1cd-430d-b09f-3ee097b86501 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:44.015809 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8867e3a9-9e85-4fcb-89f9-34d4511aa699 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:44.016385 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8867e3a9-9e85-4fcb-89f9-34d4511aa699 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:44.016866 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8867e3a9-9e85-4fcb-89f9-34d4511aa699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:44.030283 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bb600a-d1cd-430d-b09f-3ee097b86501 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:44.040305 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c04549-c56e-403d-8442-30333aec13fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:44.040925 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c04549-c56e-403d-8442-30333aec13fa admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:44.041369 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c04549-c56e-403d-8442-30333aec13fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:44.041781 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c04549-c56e-403d-8442-30333aec13fa admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:44.042590 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c04549-c56e-403d-8442-30333aec13fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:44.044724 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c04549-c56e-403d-8442-30333aec13fa admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:44.050121 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-8867e3a9-9e85-4fcb-89f9-34d4511aa699 None None] MFA Rules not processed for user `218bb1de31574611b85b60851252bc8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:24:44.067405 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-8867e3a9-9e85-4fcb-89f9-34d4511aa699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:44.097099 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 875/1751] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:24:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:24:44.116273 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8867e3a9-9e85-4fcb-89f9-34d4511aa699 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:44.117690 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-8867e3a9-9e85-4fcb-89f9-34d4511aa699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:44.129368 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 877/1752] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:24:44 2022] POST /identity/v3/projects => generated 379 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:24:44.138867 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c04549-c56e-403d-8442-30333aec13fa admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:44.395767 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8867e3a9-9e85-4fcb-89f9-34d4511aa699 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:44.418052 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c04549-c56e-403d-8442-30333aec13fa admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:44.430243 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe76bb9-f14c-4e58-ae85-e3c3e30eeb61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:44.432938 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe76bb9-f14c-4e58-ae85-e3c3e30eeb61 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:44.432938 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe76bb9-f14c-4e58-ae85-e3c3e30eeb61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:44.433173 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe76bb9-f14c-4e58-ae85-e3c3e30eeb61 admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:44.433795 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe76bb9-f14c-4e58-ae85-e3c3e30eeb61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:44.438355 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe76bb9-f14c-4e58-ae85-e3c3e30eeb61 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:44.513690 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 878/1753] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:24:44 2022] POST /identity/v3/users => generated 290 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:24:44.520242 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe76bb9-f14c-4e58-ae85-e3c3e30eeb61 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:44.545438 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe76bb9-f14c-4e58-ae85-e3c3e30eeb61 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:44.558433 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c91a97-36a6-42fe-9c8d-4bdaa7dc2f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:44.586840 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c91a97-36a6-42fe-9c8d-4bdaa7dc2f94 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:44.590206 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c91a97-36a6-42fe-9c8d-4bdaa7dc2f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:44.592532 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c91a97-36a6-42fe-9c8d-4bdaa7dc2f94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:44.595925 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c91a97-36a6-42fe-9c8d-4bdaa7dc2f94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:44.607364 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c91a97-36a6-42fe-9c8d-4bdaa7dc2f94 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:44.664014 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae06bf72-6577-44b3-b80a-a5749a4e755b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d05c52570474820b4ba0e2cdad5c13f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:44.666509 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06bf72-6577-44b3-b80a-a5749a4e755b service nova] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:44.668179 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06bf72-6577-44b3-b80a-a5749a4e755b service nova] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:44.668669 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06bf72-6577-44b3-b80a-a5749a4e755b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:44.669719 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 879/1754] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:24:44 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:24:44.681182 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c91a97-36a6-42fe-9c8d-4bdaa7dc2f94 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:44.721797 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c91a97-36a6-42fe-9c8d-4bdaa7dc2f94 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:44.750011 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd3bc4a-3aa4-4992-a6f4-0a6b462c95cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:44.754015 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd3bc4a-3aa4-4992-a6f4-0a6b462c95cd admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:44.754348 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd3bc4a-3aa4-4992-a6f4-0a6b462c95cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:44.754632 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd3bc4a-3aa4-4992-a6f4-0a6b462c95cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:44.755941 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd3bc4a-3aa4-4992-a6f4-0a6b462c95cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:44.760178 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd3bc4a-3aa4-4992-a6f4-0a6b462c95cd admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:44.802574 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 880/1755] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:24:44 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:24:44.806249 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd3bc4a-3aa4-4992-a6f4-0a6b462c95cd admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:44.822616 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:24:44.848196 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd3bc4a-3aa4-4992-a6f4-0a6b462c95cd admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:44.868911 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419326f4-9137-47cf-be9d-8acf27fbd33d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:44.870107 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419326f4-9137-47cf-be9d-8acf27fbd33d admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:44.874422 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419326f4-9137-47cf-be9d-8acf27fbd33d admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:44.876393 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419326f4-9137-47cf-be9d-8acf27fbd33d admin admin] PATH_INFO: `/v3/projects/185700d47c40474f968f6cebd15702c2/users/bf63ef3e8efd4ccb83c757240bb8be19/roles/9371e5bbc55848949eb951a815f817f2` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:44.908656 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae06bf72-6577-44b3-b80a-a5749a4e755b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:44.910811 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae06bf72-6577-44b3-b80a-a5749a4e755b service nova] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:44.925490 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419326f4-9137-47cf-be9d-8acf27fbd33d admin admin] RBAC: Authorizing `identity:create_grant(project_id=185700d47c40474f968f6cebd15702c2, user_id=bf63ef3e8efd4ccb83c757240bb8be19, role_id=9371e5bbc55848949eb951a815f817f2)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:44.928836 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419326f4-9137-47cf-be9d-8acf27fbd33d admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:44.931230 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 876/1756] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:24:44 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 815 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 12:24:44.955908 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 881/1757] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:24:44 2022] PUT /identity/v3/projects/185700d47c40474f968f6cebd15702c2/users/bf63ef3e8efd4ccb83c757240bb8be19/roles/9371e5bbc55848949eb951a815f817f2 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:24:44.966357 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d5630-4e11-4947-85ca-d260df44b333 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:44.966899 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d5630-4e11-4947-85ca-d260df44b333 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:44.967329 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d5630-4e11-4947-85ca-d260df44b333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:44.977652 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:24:45.040452 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-0f9d5630-4e11-4947-85ca-d260df44b333 None None] MFA Rules not processed for user `bf63ef3e8efd4ccb83c757240bb8be19`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:24:45.041885 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-0f9d5630-4e11-4947-85ca-d260df44b333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:45.161328 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 877/1758] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:24:44 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:24:45.166070 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419326f4-9137-47cf-be9d-8acf27fbd33d admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:45.281110 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419326f4-9137-47cf-be9d-8acf27fbd33d admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:45.286874 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ab9ce6-9214-4da1-8424-bf938f507f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:45.287710 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab9ce6-9214-4da1-8424-bf938f507f47 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:45.288098 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab9ce6-9214-4da1-8424-bf938f507f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:45.288605 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab9ce6-9214-4da1-8424-bf938f507f47 admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:45.289590 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ab9ce6-9214-4da1-8424-bf938f507f47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:45.291650 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ab9ce6-9214-4da1-8424-bf938f507f47 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:45.368319 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 882/1759] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:24:45 2022] POST /identity/v3/projects => generated 381 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:24:45.369344 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9d5630-4e11-4947-85ca-d260df44b333 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:45.387883 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9d5630-4e11-4947-85ca-d260df44b333 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:45.466989 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f5afe2-010f-4b9c-a7c6-40ba2a9fee0a None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:45.468388 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f5afe2-010f-4b9c-a7c6-40ba2a9fee0a None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:45.468812 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f5afe2-010f-4b9c-a7c6-40ba2a9fee0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:45.641003 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-07f5afe2-010f-4b9c-a7c6-40ba2a9fee0a None None] MFA Rules not processed for user `b4614bede59c47ea813a73fcc0840a2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:24:45.644991 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-07f5afe2-010f-4b9c-a7c6-40ba2a9fee0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:45.718237 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afea6cc-6bcb-4519-8cfd-bf7f6871ab2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:45.730490 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afea6cc-6bcb-4519-8cfd-bf7f6871ab2d admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:45.730953 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afea6cc-6bcb-4519-8cfd-bf7f6871ab2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:45.731319 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afea6cc-6bcb-4519-8cfd-bf7f6871ab2d admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:45.733816 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afea6cc-6bcb-4519-8cfd-bf7f6871ab2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:45.737870 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afea6cc-6bcb-4519-8cfd-bf7f6871ab2d admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:45.823236 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 878/1760] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:24:45 2022] POST /identity/v3/users => generated 297 bytes in 454 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:24:45.826330 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afea6cc-6bcb-4519-8cfd-bf7f6871ab2d admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:45.835680 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-4afea6cc-6bcb-4519-8cfd-bf7f6871ab2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:45.917066 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afea6cc-6bcb-4519-8cfd-bf7f6871ab2d admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:45.945518 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e32d77-e510-4e4b-b334-1a2c817d94e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:45.953183 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e32d77-e510-4e4b-b334-1a2c817d94e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:45.953804 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e32d77-e510-4e4b-b334-1a2c817d94e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:45.954274 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e32d77-e510-4e4b-b334-1a2c817d94e7 admin admin] PATH_INFO: `/v3/projects/910624dc07cf40c0888a29d8119e00bd` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:45.957267 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e32d77-e510-4e4b-b334-1a2c817d94e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=910624dc07cf40c0888a29d8119e00bd)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:45.966894 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e32d77-e510-4e4b-b334-1a2c817d94e7 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:46.011931 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 883/1761] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Sep 15 12:24:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 546 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:24:46.016282 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f5afe2-010f-4b9c-a7c6-40ba2a9fee0a None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:46.093794 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f5afe2-010f-4b9c-a7c6-40ba2a9fee0a None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:46.141528 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fec9f90-d264-4181-88ed-d8d1c4f89484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:46.143137 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec9f90-d264-4181-88ed-d8d1c4f89484 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:46.143658 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec9f90-d264-4181-88ed-d8d1c4f89484 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:46.145556 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec9f90-d264-4181-88ed-d8d1c4f89484 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:46.146996 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fec9f90-d264-4181-88ed-d8d1c4f89484 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:46.158028 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fec9f90-d264-4181-88ed-d8d1c4f89484 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:46.202344 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 884/1762] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:24:46 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:24:46.206656 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fec9f90-d264-4181-88ed-d8d1c4f89484 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:46.224963 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fec9f90-d264-4181-88ed-d8d1c4f89484 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:46.227501 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-13e32d77-e510-4e4b-b334-1a2c817d94e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '910624dc07cf40c0888a29d8119e00bd', 'request_id': 'req-13e32d77-e510-4e4b-b334-1a2c817d94e7'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:46.276963 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-13e32d77-e510-4e4b-b334-1a2c817d94e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '910624dc07cf40c0888a29d8119e00bd', 'request_id': 'req-13e32d77-e510-4e4b-b334-1a2c817d94e7'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:46.289240 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-13e32d77-e510-4e4b-b334-1a2c817d94e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '910624dc07cf40c0888a29d8119e00bd', 'request_id': 'req-13e32d77-e510-4e4b-b334-1a2c817d94e7'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:46.330247 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-13e32d77-e510-4e4b-b334-1a2c817d94e7 admin admin] The token cache is being invalidate because project 910624dc07cf40c0888a29d8119e00bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:24:46.331026 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-13e32d77-e510-4e4b-b334-1a2c817d94e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:46.332659 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:24:46.332878 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-13e32d77-e510-4e4b-b334-1a2c817d94e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:46.336538 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 879/1763] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:24:45 2022] DELETE /identity/v3/projects/910624dc07cf40c0888a29d8119e00bd => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:24:46.337199 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e32d77-e510-4e4b-b334-1a2c817d94e7 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:46.343340 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-13e32d77-e510-4e4b-b334-1a2c817d94e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:46.363764 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:24:46.429581 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c834db-281f-4861-9d68-4a05b5508599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:46.430724 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c834db-281f-4861-9d68-4a05b5508599 admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:46.431037 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c834db-281f-4861-9d68-4a05b5508599 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:46.431366 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c834db-281f-4861-9d68-4a05b5508599 admin admin] PATH_INFO: `/v3/projects/fe2298940517418bb4c25fb1db1d1ef2/users/dd86f277365046c2800521b7281ae8f7/roles/7f53f1c823b746529ba5057bf21b2477` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:46.449597 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c834db-281f-4861-9d68-4a05b5508599 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe2298940517418bb4c25fb1db1d1ef2, user_id=dd86f277365046c2800521b7281ae8f7, role_id=7f53f1c823b746529ba5057bf21b2477)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:46.453450 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c834db-281f-4861-9d68-4a05b5508599 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:46.475539 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 885/1764] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:24:46 2022] PUT /identity/v3/projects/fe2298940517418bb4c25fb1db1d1ef2/users/dd86f277365046c2800521b7281ae8f7/roles/7f53f1c823b746529ba5057bf21b2477 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:24:46.476475 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c834db-281f-4861-9d68-4a05b5508599 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:46.479705 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-d1c834db-281f-4861-9d68-4a05b5508599 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:46.579576 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c834db-281f-4861-9d68-4a05b5508599 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:46.586615 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae3a55e-208b-44de-bcf4-d39fa40b59aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:46.587259 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae3a55e-208b-44de-bcf4-d39fa40b59aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:46.587562 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae3a55e-208b-44de-bcf4-d39fa40b59aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:46.587858 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae3a55e-208b-44de-bcf4-d39fa40b59aa admin admin] PATH_INFO: `/v3/users/d9f0f872e7814a46824a0731d498c7f1` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:46.589189 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae3a55e-208b-44de-bcf4-d39fa40b59aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9f0f872e7814a46824a0731d498c7f1)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:46.591685 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae3a55e-208b-44de-bcf4-d39fa40b59aa admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:46.628188 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e32d77-e510-4e4b-b334-1a2c817d94e7 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:46.674568 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-7ae3a55e-208b-44de-bcf4-d39fa40b59aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9f0f872e7814a46824a0731d498c7f1'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:46.688478 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-7ae3a55e-208b-44de-bcf4-d39fa40b59aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9f0f872e7814a46824a0731d498c7f1'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:46.692607 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-7ae3a55e-208b-44de-bcf4-d39fa40b59aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9f0f872e7814a46824a0731d498c7f1'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:46.696545 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-7ae3a55e-208b-44de-bcf4-d39fa40b59aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9f0f872e7814a46824a0731d498c7f1'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:46.735881 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-7ae3a55e-208b-44de-bcf4-d39fa40b59aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9f0f872e7814a46824a0731d498c7f1'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:46.800754 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 886/1765] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:24:46 2022] DELETE /identity/v3/users/d9f0f872e7814a46824a0731d498c7f1 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:24:46.806253 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae3a55e-208b-44de-bcf4-d39fa40b59aa admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:46.808663 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0edc20-37f7-4c86-a8da-a9c4351a096e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee33b730d0ec428ca2cd3af4ebf723e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:46.809533 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0edc20-37f7-4c86-a8da-a9c4351a096e service swift] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:46.813067 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0edc20-37f7-4c86-a8da-a9c4351a096e service swift] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:46.813353 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0edc20-37f7-4c86-a8da-a9c4351a096e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:46.814742 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-7ae3a55e-208b-44de-bcf4-d39fa40b59aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:46.817998 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-2a0edc20-37f7-4c86-a8da-a9c4351a096e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:46.914505 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:24:46.999950 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0edc20-37f7-4c86-a8da-a9c4351a096e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:47.003182 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0edc20-37f7-4c86-a8da-a9c4351a096e service swift] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:47.013076 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae3a55e-208b-44de-bcf4-d39fa40b59aa admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:47.017477 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 880/1766] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Sep 15 12:24:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 681 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 12:24:47.033848 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04a2673-0e9d-41bc-a527-5c9cd38fe3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:47.034869 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04a2673-0e9d-41bc-a527-5c9cd38fe3b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:47.035445 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04a2673-0e9d-41bc-a527-5c9cd38fe3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:47.035868 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04a2673-0e9d-41bc-a527-5c9cd38fe3b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:47.038243 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04a2673-0e9d-41bc-a527-5c9cd38fe3b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:47.044473 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04a2673-0e9d-41bc-a527-5c9cd38fe3b8 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:47.056588 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 887/1767] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:24:46 2022] GET /identity/v3/roles => generated 1420 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:24:47.060429 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0edc20-37f7-4c86-a8da-a9c4351a096e service swift] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:47.077978 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0edc20-37f7-4c86-a8da-a9c4351a096e service swift] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:47.094641 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29addb4-a762-45bd-bb9a-9037a11f4d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:47.097240 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29addb4-a762-45bd-bb9a-9037a11f4d6f admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:47.097629 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29addb4-a762-45bd-bb9a-9037a11f4d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:47.098085 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29addb4-a762-45bd-bb9a-9037a11f4d6f admin admin] PATH_INFO: `/v3/projects/fe2298940517418bb4c25fb1db1d1ef2/users/dd86f277365046c2800521b7281ae8f7/roles/7f53f1c823b746529ba5057bf21b2477` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:47.104894 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29addb4-a762-45bd-bb9a-9037a11f4d6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe2298940517418bb4c25fb1db1d1ef2, user_id=dd86f277365046c2800521b7281ae8f7, role_id=7f53f1c823b746529ba5057bf21b2477)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:47.112559 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29addb4-a762-45bd-bb9a-9037a11f4d6f admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:47.156460 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 881/1768] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:24:47 2022] PUT /identity/v3/projects/fe2298940517418bb4c25fb1db1d1ef2/users/dd86f277365046c2800521b7281ae8f7/roles/7f53f1c823b746529ba5057bf21b2477 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:24:47.157991 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ede5a9b-b7c6-41c3-a9e1-4cb5ce96ef01 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:47.158537 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ede5a9b-b7c6-41c3-a9e1-4cb5ce96ef01 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:47.158972 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ede5a9b-b7c6-41c3-a9e1-4cb5ce96ef01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:47.273754 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-6ede5a9b-b7c6-41c3-a9e1-4cb5ce96ef01 None None] MFA Rules not processed for user `dd86f277365046c2800521b7281ae8f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:24:47.280570 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-6ede5a9b-b7c6-41c3-a9e1-4cb5ce96ef01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:47.510560 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 888/1769] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:24:47 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:24:47.515811 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e32e3d-b295-4ed3-8f0e-ec03150373b5 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:47.516335 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e32e3d-b295-4ed3-8f0e-ec03150373b5 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:47.517633 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e32e3d-b295-4ed3-8f0e-ec03150373b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:47.534003 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ede5a9b-b7c6-41c3-a9e1-4cb5ce96ef01 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:47.534003 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-6ede5a9b-b7c6-41c3-a9e1-4cb5ce96ef01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:47.653684 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-d5e32e3d-b295-4ed3-8f0e-ec03150373b5 None None] MFA Rules not processed for user `74811d83f5924dfbaa0866a2a48ca281`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:24:47.657631 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-d5e32e3d-b295-4ed3-8f0e-ec03150373b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:47.677025 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:24:47.798110 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ede5a9b-b7c6-41c3-a9e1-4cb5ce96ef01 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:47.815300 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358d3e5d-d271-4d25-9237-bb7329226cf0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceafc5e4283841528053f01931f10293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:47.821662 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d3e5d-d271-4d25-9237-bb7329226cf0 service cinder] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:47.822099 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d3e5d-d271-4d25-9237-bb7329226cf0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:47.822487 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d3e5d-d271-4d25-9237-bb7329226cf0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:47.871761 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358d3e5d-d271-4d25-9237-bb7329226cf0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:47.880841 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 882/1770] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:24:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:24:47.888174 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358d3e5d-d271-4d25-9237-bb7329226cf0 service cinder] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:47.888839 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e32e3d-b295-4ed3-8f0e-ec03150373b5 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:47.891825 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-d5e32e3d-b295-4ed3-8f0e-ec03150373b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:47.953846 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 889/1771] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:24:47 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 12:24:48.160491 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e32e3d-b295-4ed3-8f0e-ec03150373b5 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:48.181094 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47dfe6b-2615-429d-8f83-4b6f21b198fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d05c52570474820b4ba0e2cdad5c13f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:48.181791 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47dfe6b-2615-429d-8f83-4b6f21b198fa service nova] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:48.182346 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47dfe6b-2615-429d-8f83-4b6f21b198fa service nova] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:48.182953 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47dfe6b-2615-429d-8f83-4b6f21b198fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:48.203655 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47dfe6b-2615-429d-8f83-4b6f21b198fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:48.216066 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47dfe6b-2615-429d-8f83-4b6f21b198fa service nova] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:48.266125 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 883/1772] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:24:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 12:24:48.677518 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b5b799-a7e1-4e48-af4a-6a6ed66bc868 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:48.678616 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b5b799-a7e1-4e48-af4a-6a6ed66bc868 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:48.681842 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b5b799-a7e1-4e48-af4a-6a6ed66bc868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:48.723700 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-e7b5b799-a7e1-4e48-af4a-6a6ed66bc868 None None] MFA Rules not processed for user `983e501359234b31879e5cdfb34ea31a`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:24:48.724933 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-e7b5b799-a7e1-4e48-af4a-6a6ed66bc868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:48.889918 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:24:48.929510 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 890/1773] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:24:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:24:49.063542 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47dfe6b-2615-429d-8f83-4b6f21b198fa service nova] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:49.252702 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47dfe6b-2615-429d-8f83-4b6f21b198fa service nova] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:49.272551 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295baf10-5657-404c-93f0-b2ec63ff93d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:49.273256 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295baf10-5657-404c-93f0-b2ec63ff93d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:49.273540 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295baf10-5657-404c-93f0-b2ec63ff93d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:49.273811 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295baf10-5657-404c-93f0-b2ec63ff93d1 admin admin] PATH_INFO: `/v3/users/bf63ef3e8efd4ccb83c757240bb8be19` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:49.279551 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295baf10-5657-404c-93f0-b2ec63ff93d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf63ef3e8efd4ccb83c757240bb8be19)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:49.282011 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295baf10-5657-404c-93f0-b2ec63ff93d1 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:49.365801 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:24:49.386750 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-295baf10-5657-404c-93f0-b2ec63ff93d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf63ef3e8efd4ccb83c757240bb8be19'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:49.402938 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-295baf10-5657-404c-93f0-b2ec63ff93d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf63ef3e8efd4ccb83c757240bb8be19'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:49.402938 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-295baf10-5657-404c-93f0-b2ec63ff93d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf63ef3e8efd4ccb83c757240bb8be19'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:49.403568 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-295baf10-5657-404c-93f0-b2ec63ff93d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf63ef3e8efd4ccb83c757240bb8be19'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:49.416367 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-295baf10-5657-404c-93f0-b2ec63ff93d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf63ef3e8efd4ccb83c757240bb8be19'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:49.453296 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7089963-e3f4-4756-9533-2540d7f8b680 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:49.453686 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7089963-e3f4-4756-9533-2540d7f8b680 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:49.453924 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7089963-e3f4-4756-9533-2540d7f8b680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:49.469446 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 884/1774] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:24:49 2022] DELETE /identity/v3/users/bf63ef3e8efd4ccb83c757240bb8be19 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:24:49.473706 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e094e84d-9ba2-45fd-86c2-36f79af4b5bd None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:49.473994 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e094e84d-9ba2-45fd-86c2-36f79af4b5bd None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:49.474269 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e094e84d-9ba2-45fd-86c2-36f79af4b5bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:49.513843 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-b7089963-e3f4-4756-9533-2540d7f8b680 None None] MFA Rules not processed for user `2c5895375da54d2e9b51d59de4f98fe7`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:24:49.515672 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-b7089963-e3f4-4756-9533-2540d7f8b680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:49.558441 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-e094e84d-9ba2-45fd-86c2-36f79af4b5bd None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:24:49.562913 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-e094e84d-9ba2-45fd-86c2-36f79af4b5bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:49.731356 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 885/1775] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:24:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:24:49.734268 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e094e84d-9ba2-45fd-86c2-36f79af4b5bd None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:49.735824 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-e094e84d-9ba2-45fd-86c2-36f79af4b5bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:49.769103 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e094e84d-9ba2-45fd-86c2-36f79af4b5bd None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:49.776193 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 891/1776] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:24:49 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:24:49.778062 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7089963-e3f4-4756-9533-2540d7f8b680 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:49.779404 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518b0294-5477-4a1b-b68f-54f4d90d68a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:49.780734 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-b7089963-e3f4-4756-9533-2540d7f8b680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:49.781600 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b0294-5477-4a1b-b68f-54f4d90d68a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:49.781892 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b0294-5477-4a1b-b68f-54f4d90d68a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:49.782148 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b0294-5477-4a1b-b68f-54f4d90d68a2 admin admin] PATH_INFO: `/v3/projects/5e87df36289a44ecb3a40a57ef9e6ce9` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:49.786645 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518b0294-5477-4a1b-b68f-54f4d90d68a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e87df36289a44ecb3a40a57ef9e6ce9)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:49.788458 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518b0294-5477-4a1b-b68f-54f4d90d68a2 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:49.923978 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-518b0294-5477-4a1b-b68f-54f4d90d68a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e87df36289a44ecb3a40a57ef9e6ce9', 'request_id': 'req-518b0294-5477-4a1b-b68f-54f4d90d68a2'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:49.939691 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-518b0294-5477-4a1b-b68f-54f4d90d68a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e87df36289a44ecb3a40a57ef9e6ce9', 'request_id': 'req-518b0294-5477-4a1b-b68f-54f4d90d68a2'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:49.982592 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-518b0294-5477-4a1b-b68f-54f4d90d68a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e87df36289a44ecb3a40a57ef9e6ce9', 'request_id': 'req-518b0294-5477-4a1b-b68f-54f4d90d68a2'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:49.995809 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7089963-e3f4-4756-9533-2540d7f8b680 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:50.028501 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-518b0294-5477-4a1b-b68f-54f4d90d68a2 admin admin] The token cache is being invalidate because project 5e87df36289a44ecb3a40a57ef9e6ce9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:24:50.030222 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-518b0294-5477-4a1b-b68f-54f4d90d68a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:50.032310 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-518b0294-5477-4a1b-b68f-54f4d90d68a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:50.037258 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 886/1777] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:24:49 2022] DELETE /identity/v3/projects/5e87df36289a44ecb3a40a57ef9e6ce9 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:24:50.042848 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed343d-9cf9-4002-aa69-711055300b8f None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:50.043509 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed343d-9cf9-4002-aa69-711055300b8f None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:50.043509 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed343d-9cf9-4002-aa69-711055300b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:50.074842 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-74ed343d-9cf9-4002-aa69-711055300b8f None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:24:50.077526 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-74ed343d-9cf9-4002-aa69-711055300b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:50.126495 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:24:50.136587 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71824c00-29fb-41b8-a2f6-8a71a2192dcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:50.137250 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71824c00-29fb-41b8-a2f6-8a71a2192dcf service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:50.137967 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71824c00-29fb-41b8-a2f6-8a71a2192dcf service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:50.137967 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71824c00-29fb-41b8-a2f6-8a71a2192dcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:50.144539 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-71824c00-29fb-41b8-a2f6-8a71a2192dcf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:50.245910 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 887/1778] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:24:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:24:50.249273 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3557c6-b313-4cc6-af1f-613b5048699c None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:50.249570 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3557c6-b313-4cc6-af1f-613b5048699c None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:50.249850 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3557c6-b313-4cc6-af1f-613b5048699c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:50.305361 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-1b3557c6-b313-4cc6-af1f-613b5048699c None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:24:50.306653 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-1b3557c6-b313-4cc6-af1f-613b5048699c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:50.341389 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71824c00-29fb-41b8-a2f6-8a71a2192dcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:50.343291 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 888/1779] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:24:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:24:50.345460 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71824c00-29fb-41b8-a2f6-8a71a2192dcf service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:50.349381 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3557c6-b313-4cc6-af1f-613b5048699c None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:50.370801 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3557c6-b313-4cc6-af1f-613b5048699c None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:50.379711 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 892/1780] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:24:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 603 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:24:50.395182 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659701a0-73c6-45b4-a782-73942542b0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:50.395745 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659701a0-73c6-45b4-a782-73942542b0ef admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:50.397567 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659701a0-73c6-45b4-a782-73942542b0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:50.398346 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659701a0-73c6-45b4-a782-73942542b0ef admin admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:50.399070 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659701a0-73c6-45b4-a782-73942542b0ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:24:50.399428 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659701a0-73c6-45b4-a782-73942542b0ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:50.404340 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659701a0-73c6-45b4-a782-73942542b0ef admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:50.445206 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71824c00-29fb-41b8-a2f6-8a71a2192dcf service neutron] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:50.449432 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 889/1781] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 15 12:24:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:24:50.461607 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71824c00-29fb-41b8-a2f6-8a71a2192dcf service neutron] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:50.474876 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd157edf-f6c0-44de-9305-28e570347588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:50.475510 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd157edf-f6c0-44de-9305-28e570347588 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:50.475794 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd157edf-f6c0-44de-9305-28e570347588 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:50.476069 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd157edf-f6c0-44de-9305-28e570347588 admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:50.479637 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd157edf-f6c0-44de-9305-28e570347588 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:50.481692 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd157edf-f6c0-44de-9305-28e570347588 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:50.491590 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:24:50.556168 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 893/1782] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:24:50 2022] POST /identity/v3/projects => generated 381 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 12:24:50.563165 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659701a0-73c6-45b4-a782-73942542b0ef admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:50.599782 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659701a0-73c6-45b4-a782-73942542b0ef admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:50.810372 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133afd77-a2f6-4353-af5c-dfedef6543a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:50.812361 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133afd77-a2f6-4353-af5c-dfedef6543a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:50.813456 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133afd77-a2f6-4353-af5c-dfedef6543a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:50.813456 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133afd77-a2f6-4353-af5c-dfedef6543a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:50.815777 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133afd77-a2f6-4353-af5c-dfedef6543a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:50.820352 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133afd77-a2f6-4353-af5c-dfedef6543a4 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:50.897171 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 890/1783] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:24:50 2022] POST /identity/v3/users => generated 291 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:24:50.897795 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd157edf-f6c0-44de-9305-28e570347588 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:50.918410 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd157edf-f6c0-44de-9305-28e570347588 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:50.955932 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17502cc2-e22f-4c8e-9a9c-4672f07227e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:50.956569 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17502cc2-e22f-4c8e-9a9c-4672f07227e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:50.956851 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17502cc2-e22f-4c8e-9a9c-4672f07227e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:50.957124 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17502cc2-e22f-4c8e-9a9c-4672f07227e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:50.957787 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17502cc2-e22f-4c8e-9a9c-4672f07227e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:50.959452 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17502cc2-e22f-4c8e-9a9c-4672f07227e0 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:51.010633 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 894/1784] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:24:50 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:24:51.015663 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133afd77-a2f6-4353-af5c-dfedef6543a4 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:51.028838 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133afd77-a2f6-4353-af5c-dfedef6543a4 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:51.043452 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6475d4ee-fc7c-4efb-bf9e-95462041af19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:51.044452 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475d4ee-fc7c-4efb-bf9e-95462041af19 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:51.044588 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475d4ee-fc7c-4efb-bf9e-95462041af19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:51.044890 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475d4ee-fc7c-4efb-bf9e-95462041af19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:51.045645 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6475d4ee-fc7c-4efb-bf9e-95462041af19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:51.050103 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6475d4ee-fc7c-4efb-bf9e-95462041af19 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:51.076036 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 891/1785] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:24:51 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:24:51.081156 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17502cc2-e22f-4c8e-9a9c-4672f07227e0 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:51.097853 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17502cc2-e22f-4c8e-9a9c-4672f07227e0 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:51.122370 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683289b2-63a0-40ef-a91b-a8355958b1b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:51.123100 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683289b2-63a0-40ef-a91b-a8355958b1b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:51.125776 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683289b2-63a0-40ef-a91b-a8355958b1b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:51.126088 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683289b2-63a0-40ef-a91b-a8355958b1b5 admin admin] PATH_INFO: `/v3/projects/389b1127f6bf407e95282a6c9498a89a/users/b1686fbcd01a477aa0c182f9ab5a0146/roles/9371e5bbc55848949eb951a815f817f2` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:51.165093 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683289b2-63a0-40ef-a91b-a8355958b1b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=389b1127f6bf407e95282a6c9498a89a, user_id=b1686fbcd01a477aa0c182f9ab5a0146, role_id=9371e5bbc55848949eb951a815f817f2)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:51.167784 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683289b2-63a0-40ef-a91b-a8355958b1b5 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:51.197549 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 895/1786] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:24:51 2022] PUT /identity/v3/projects/389b1127f6bf407e95282a6c9498a89a/users/b1686fbcd01a477aa0c182f9ab5a0146/roles/9371e5bbc55848949eb951a815f817f2 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:24:51.209966 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856ba67-8275-4701-b5bb-0f36df13f9d9 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:51.210345 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856ba67-8275-4701-b5bb-0f36df13f9d9 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:51.210765 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856ba67-8275-4701-b5bb-0f36df13f9d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:51.221710 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79305cdd-2475-4f4d-adc7-2279e6c25a7c None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:51.222237 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79305cdd-2475-4f4d-adc7-2279e6c25a7c None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:51.222669 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79305cdd-2475-4f4d-adc7-2279e6c25a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:51.263168 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-79305cdd-2475-4f4d-adc7-2279e6c25a7c None None] MFA Rules not processed for user `4003dbcee8104aa4a7ce90251bab88a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:24:51.264949 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-79305cdd-2475-4f4d-adc7-2279e6c25a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:51.288192 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-f856ba67-8275-4701-b5bb-0f36df13f9d9 None None] MFA Rules not processed for user `b1686fbcd01a477aa0c182f9ab5a0146`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:24:51.291608 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-f856ba67-8275-4701-b5bb-0f36df13f9d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:51.396316 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 896/1787] 10.222.0.50 () {58 vars in 1015 bytes} [Thu Sep 15 12:24:51 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:24:51.461903 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79305cdd-2475-4f4d-adc7-2279e6c25a7c None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:51.463649 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-79305cdd-2475-4f4d-adc7-2279e6c25a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:51.495632 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79305cdd-2475-4f4d-adc7-2279e6c25a7c None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:51.538267 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc5b2e4-5ebf-4409-8acd-b83ba069adba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:51.549561 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc5b2e4-5ebf-4409-8acd-b83ba069adba service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:51.551057 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc5b2e4-5ebf-4409-8acd-b83ba069adba service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:51.551395 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc5b2e4-5ebf-4409-8acd-b83ba069adba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:51.563459 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 892/1788] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:24:51 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:24:51.568300 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f856ba67-8275-4701-b5bb-0f36df13f9d9 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:51.580021 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc5b2e4-5ebf-4409-8acd-b83ba069adba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:51.581694 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc5b2e4-5ebf-4409-8acd-b83ba069adba service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:51.624524 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 897/1789] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:24:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:24:51.632477 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269004e6-be51-4853-bd9f-e227ab3ac413 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:51.633361 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269004e6-be51-4853-bd9f-e227ab3ac413 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:51.633822 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269004e6-be51-4853-bd9f-e227ab3ac413 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:51.640361 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 898/1790] 10.222.0.16 () {54 vars in 912 bytes} [Thu Sep 15 12:24:51 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:24:51.652960 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a21544-88c6-49ba-b265-81c9ae6a952a None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:51.653537 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a21544-88c6-49ba-b265-81c9ae6a952a None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:51.654252 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a21544-88c6-49ba-b265-81c9ae6a952a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:51.699757 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:24:51.741827 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-84a21544-88c6-49ba-b265-81c9ae6a952a None None] MFA Rules not processed for user `4003dbcee8104aa4a7ce90251bab88a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:24:51.743144 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-84a21544-88c6-49ba-b265-81c9ae6a952a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:51.750645 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 899/1791] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Sep 15 12:24:51 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:24:51.822506 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a21544-88c6-49ba-b265-81c9ae6a952a None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:51.838119 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a21544-88c6-49ba-b265-81c9ae6a952a None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:51.848223 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4accc8-6bef-48c4-ac04-fe90f6b13121 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:51.851018 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4accc8-6bef-48c4-ac04-fe90f6b13121 service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:51.857573 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4accc8-6bef-48c4-ac04-fe90f6b13121 service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:51.858116 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4accc8-6bef-48c4-ac04-fe90f6b13121 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:51.880314 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f856ba67-8275-4701-b5bb-0f36df13f9d9 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:51.895605 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ef4ca0-b216-49f4-bc61-8cb60b77c7c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:51.896259 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef4ca0-b216-49f4-bc61-8cb60b77c7c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:51.896540 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef4ca0-b216-49f4-bc61-8cb60b77c7c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:51.896765 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4accc8-6bef-48c4-ac04-fe90f6b13121 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:51.898313 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4accc8-6bef-48c4-ac04-fe90f6b13121 service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:51.899197 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef4ca0-b216-49f4-bc61-8cb60b77c7c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:51.899916 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ef4ca0-b216-49f4-bc61-8cb60b77c7c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:51.902211 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ef4ca0-b216-49f4-bc61-8cb60b77c7c7 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:51.956139 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 900/1792] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:24:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 12:24:52.030021 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 893/1793] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:24:51 2022] POST /identity/v3/projects => generated 379 bytes in 466 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:24:52.034788 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4accc8-6bef-48c4-ac04-fe90f6b13121 service neutron] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:52.051972 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4accc8-6bef-48c4-ac04-fe90f6b13121 service neutron] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:52.239736 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8d4a02-16c8-49e7-807d-7abbe013eacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:52.240751 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d4a02-16c8-49e7-807d-7abbe013eacd admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:52.241208 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d4a02-16c8-49e7-807d-7abbe013eacd admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:52.241626 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d4a02-16c8-49e7-807d-7abbe013eacd admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:52.242428 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8d4a02-16c8-49e7-807d-7abbe013eacd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:52.244577 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8d4a02-16c8-49e7-807d-7abbe013eacd admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:52.295916 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 901/1794] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:24:52 2022] POST /identity/v3/users => generated 296 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:24:52.301445 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ef4ca0-b216-49f4-bc61-8cb60b77c7c7 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:52.355629 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ef4ca0-b216-49f4-bc61-8cb60b77c7c7 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:52.388676 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2ad2a4-1912-4654-bb82-08ea55d18404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:52.399225 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ad2a4-1912-4654-bb82-08ea55d18404 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:52.400098 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ad2a4-1912-4654-bb82-08ea55d18404 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:52.400589 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ad2a4-1912-4654-bb82-08ea55d18404 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:52.401470 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2ad2a4-1912-4654-bb82-08ea55d18404 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:52.403447 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2ad2a4-1912-4654-bb82-08ea55d18404 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:52.452441 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 894/1795] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:24:52 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:24:52.453111 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8d4a02-16c8-49e7-807d-7abbe013eacd admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:52.468681 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8d4a02-16c8-49e7-807d-7abbe013eacd admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:52.496192 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d363e4-2d4e-4927-92a7-ec1661a21c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:52.496903 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d363e4-2d4e-4927-92a7-ec1661a21c57 admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:52.497164 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d363e4-2d4e-4927-92a7-ec1661a21c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:52.497440 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d363e4-2d4e-4927-92a7-ec1661a21c57 admin admin] PATH_INFO: `/v3/projects/7843959dd02c400bbba821f14a7275f3/users/659e124b76094e3da8ad03025b896ef9/roles/7f53f1c823b746529ba5057bf21b2477` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:52.531823 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:24:52.547817 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d363e4-2d4e-4927-92a7-ec1661a21c57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7843959dd02c400bbba821f14a7275f3, user_id=659e124b76094e3da8ad03025b896ef9, role_id=7f53f1c823b746529ba5057bf21b2477)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:52.550536 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d363e4-2d4e-4927-92a7-ec1661a21c57 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:52.584828 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 902/1796] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:24:52 2022] PUT /identity/v3/projects/7843959dd02c400bbba821f14a7275f3/users/659e124b76094e3da8ad03025b896ef9/roles/7f53f1c823b746529ba5057bf21b2477 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:24:52.586391 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2ad2a4-1912-4654-bb82-08ea55d18404 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:52.604826 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2ad2a4-1912-4654-bb82-08ea55d18404 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:52.794354 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c27089-3590-45f9-9ecf-cb035c1c2fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:52.795767 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c27089-3590-45f9-9ecf-cb035c1c2fde admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:52.796911 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c27089-3590-45f9-9ecf-cb035c1c2fde admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:52.797779 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c27089-3590-45f9-9ecf-cb035c1c2fde admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:52.799083 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c27089-3590-45f9-9ecf-cb035c1c2fde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:52.804916 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c27089-3590-45f9-9ecf-cb035c1c2fde admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:52.834005 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 895/1797] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:24:52 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:24:52.837268 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d363e4-2d4e-4927-92a7-ec1661a21c57 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:52.856383 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d363e4-2d4e-4927-92a7-ec1661a21c57 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:52.882578 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5010fa-d937-4b7e-b0bf-5eeb9947148b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:52.888620 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5010fa-d937-4b7e-b0bf-5eeb9947148b admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:52.891307 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5010fa-d937-4b7e-b0bf-5eeb9947148b admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:52.891921 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5010fa-d937-4b7e-b0bf-5eeb9947148b admin admin] PATH_INFO: `/v3/projects/7843959dd02c400bbba821f14a7275f3/users/659e124b76094e3da8ad03025b896ef9/roles/7f53f1c823b746529ba5057bf21b2477` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:52.896735 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5010fa-d937-4b7e-b0bf-5eeb9947148b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7843959dd02c400bbba821f14a7275f3, user_id=659e124b76094e3da8ad03025b896ef9, role_id=7f53f1c823b746529ba5057bf21b2477)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:52.899991 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5010fa-d937-4b7e-b0bf-5eeb9947148b admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:52.945249 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 903/1798] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:24:52 2022] PUT /identity/v3/projects/7843959dd02c400bbba821f14a7275f3/users/659e124b76094e3da8ad03025b896ef9/roles/7f53f1c823b746529ba5057bf21b2477 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:24:52.956888 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e49b3c-064a-4541-bdb8-bd9b5863f9cd None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:52.957180 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e49b3c-064a-4541-bdb8-bd9b5863f9cd None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:52.957457 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e49b3c-064a-4541-bdb8-bd9b5863f9cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:53.030992 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-30e49b3c-064a-4541-bdb8-bd9b5863f9cd None None] MFA Rules not processed for user `659e124b76094e3da8ad03025b896ef9`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:24:53.036580 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-30e49b3c-064a-4541-bdb8-bd9b5863f9cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:53.307213 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 896/1799] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:24:52 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:24:53.321625 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5010fa-d937-4b7e-b0bf-5eeb9947148b admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:53.323807 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-be5010fa-d937-4b7e-b0bf-5eeb9947148b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:53.499331 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5010fa-d937-4b7e-b0bf-5eeb9947148b admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:53.505285 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb135890-fb26-4718-b96e-7226a4c9832f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceafc5e4283841528053f01931f10293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:53.506369 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb135890-fb26-4718-b96e-7226a4c9832f service cinder] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:53.506871 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb135890-fb26-4718-b96e-7226a4c9832f service cinder] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:53.507356 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb135890-fb26-4718-b96e-7226a4c9832f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:53.531580 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb135890-fb26-4718-b96e-7226a4c9832f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:53.533586 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb135890-fb26-4718-b96e-7226a4c9832f service cinder] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:53.583875 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 904/1800] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:24:53 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 12:24:53.613134 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e49b3c-064a-4541-bdb8-bd9b5863f9cd None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:53.614739 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-30e49b3c-064a-4541-bdb8-bd9b5863f9cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:53.708559 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:24:53.924451 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e49b3c-064a-4541-bdb8-bd9b5863f9cd None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:53.948373 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed880f1d-acb1-479c-8979-24e0a7025608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:53.949051 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed880f1d-acb1-479c-8979-24e0a7025608 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:53.949330 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed880f1d-acb1-479c-8979-24e0a7025608 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:53.949601 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed880f1d-acb1-479c-8979-24e0a7025608 admin admin] PATH_INFO: `/v3/projects/185700d47c40474f968f6cebd15702c2` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:53.965890 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed880f1d-acb1-479c-8979-24e0a7025608 admin admin] RBAC: Authorizing `identity:delete_project(project_id=185700d47c40474f968f6cebd15702c2)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:53.967863 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed880f1d-acb1-479c-8979-24e0a7025608 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:54.258678 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-ed880f1d-acb1-479c-8979-24e0a7025608 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '185700d47c40474f968f6cebd15702c2', 'request_id': 'req-ed880f1d-acb1-479c-8979-24e0a7025608'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:54.291278 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-ed880f1d-acb1-479c-8979-24e0a7025608 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '185700d47c40474f968f6cebd15702c2', 'request_id': 'req-ed880f1d-acb1-479c-8979-24e0a7025608'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:54.325994 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-ed880f1d-acb1-479c-8979-24e0a7025608 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '185700d47c40474f968f6cebd15702c2', 'request_id': 'req-ed880f1d-acb1-479c-8979-24e0a7025608'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:54.367095 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-ed880f1d-acb1-479c-8979-24e0a7025608 admin admin] The token cache is being invalidate because project 185700d47c40474f968f6cebd15702c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:24:54.367395 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-ed880f1d-acb1-479c-8979-24e0a7025608 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:54.369837 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-ed880f1d-acb1-479c-8979-24e0a7025608 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:54.375838 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 897/1801] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:24:53 2022] DELETE /identity/v3/projects/185700d47c40474f968f6cebd15702c2 => generated 0 bytes in 763 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:24:54.380196 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb135890-fb26-4718-b96e-7226a4c9832f service cinder] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:54.394524 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb135890-fb26-4718-b96e-7226a4c9832f service cinder] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:54.534355 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed880f1d-acb1-479c-8979-24e0a7025608 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:54.535804 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-ed880f1d-acb1-479c-8979-24e0a7025608 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:54.787165 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60af68c9-c5dd-4bc3-a770-3c64109f063c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:54.792222 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af68c9-c5dd-4bc3-a770-3c64109f063c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:54.792586 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af68c9-c5dd-4bc3-a770-3c64109f063c admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:54.796332 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af68c9-c5dd-4bc3-a770-3c64109f063c admin admin] PATH_INFO: `/v3/users/dd86f277365046c2800521b7281ae8f7` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:54.805678 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60af68c9-c5dd-4bc3-a770-3c64109f063c admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd86f277365046c2800521b7281ae8f7)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:54.809576 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed880f1d-acb1-479c-8979-24e0a7025608 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:54.819812 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60af68c9-c5dd-4bc3-a770-3c64109f063c admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:54.821970 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395b76d0-879d-46bd-9eaf-22cb13c3ea00 tempest-VolumeQuotaClassesTest-664815250 tempest-VolumeQuotaClassesTest-664815250-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '659e124b76094e3da8ad03025b896ef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7843959dd02c400bbba821f14a7275f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:54.822906 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b76d0-879d-46bd-9eaf-22cb13c3ea00 tempest-VolumeQuotaClassesTest-664815250 tempest-VolumeQuotaClassesTest-664815250-project-admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:54.823096 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b76d0-879d-46bd-9eaf-22cb13c3ea00 tempest-VolumeQuotaClassesTest-664815250 tempest-VolumeQuotaClassesTest-664815250-project-admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:54.823308 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b76d0-879d-46bd-9eaf-22cb13c3ea00 tempest-VolumeQuotaClassesTest-664815250 tempest-VolumeQuotaClassesTest-664815250-project-admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:54.823963 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395b76d0-879d-46bd-9eaf-22cb13c3ea00 tempest-VolumeQuotaClassesTest-664815250 tempest-VolumeQuotaClassesTest-664815250-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:24:54.824375 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395b76d0-879d-46bd-9eaf-22cb13c3ea00 tempest-VolumeQuotaClassesTest-664815250 tempest-VolumeQuotaClassesTest-664815250-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:54.825999 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395b76d0-879d-46bd-9eaf-22cb13c3ea00 tempest-VolumeQuotaClassesTest-664815250 tempest-VolumeQuotaClassesTest-664815250-project-admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:54.872444 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 898/1802] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 15 12:24:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:24:54.877822 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395b76d0-879d-46bd-9eaf-22cb13c3ea00 tempest-VolumeQuotaClassesTest-664815250 tempest-VolumeQuotaClassesTest-664815250-project-admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:54.926788 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395b76d0-879d-46bd-9eaf-22cb13c3ea00 tempest-VolumeQuotaClassesTest-664815250 tempest-VolumeQuotaClassesTest-664815250-project-admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:54.973880 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d652c4b-71c3-4bf7-a037-0315bc73327f tempest-VolumeQuotaClassesTest-664815250 tempest-VolumeQuotaClassesTest-664815250-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '659e124b76094e3da8ad03025b896ef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7843959dd02c400bbba821f14a7275f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:54.979650 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d652c4b-71c3-4bf7-a037-0315bc73327f tempest-VolumeQuotaClassesTest-664815250 tempest-VolumeQuotaClassesTest-664815250-project-admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:54.980253 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d652c4b-71c3-4bf7-a037-0315bc73327f tempest-VolumeQuotaClassesTest-664815250 tempest-VolumeQuotaClassesTest-664815250-project-admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:54.986320 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d652c4b-71c3-4bf7-a037-0315bc73327f tempest-VolumeQuotaClassesTest-664815250 tempest-VolumeQuotaClassesTest-664815250-project-admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:54.991667 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d652c4b-71c3-4bf7-a037-0315bc73327f tempest-VolumeQuotaClassesTest-664815250 tempest-VolumeQuotaClassesTest-664815250-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:55.009150 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d652c4b-71c3-4bf7-a037-0315bc73327f tempest-VolumeQuotaClassesTest-664815250 tempest-VolumeQuotaClassesTest-664815250-project-admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:55.039545 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-60af68c9-c5dd-4bc3-a770-3c64109f063c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd86f277365046c2800521b7281ae8f7'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:55.063926 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-60af68c9-c5dd-4bc3-a770-3c64109f063c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd86f277365046c2800521b7281ae8f7'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:55.064650 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-60af68c9-c5dd-4bc3-a770-3c64109f063c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd86f277365046c2800521b7281ae8f7'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:55.067618 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-60af68c9-c5dd-4bc3-a770-3c64109f063c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd86f277365046c2800521b7281ae8f7'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:55.093024 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-60af68c9-c5dd-4bc3-a770-3c64109f063c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd86f277365046c2800521b7281ae8f7'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:55.133848 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 899/1803] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:24:54 2022] POST /identity/v3/projects => generated 353 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:24:55.137782 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d652c4b-71c3-4bf7-a037-0315bc73327f tempest-VolumeQuotaClassesTest-664815250 tempest-VolumeQuotaClassesTest-664815250-project-admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:55.146287 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-2d652c4b-71c3-4bf7-a037-0315bc73327f tempest-VolumeQuotaClassesTest-664815250 tempest-VolumeQuotaClassesTest-664815250-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:55.150197 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:24:55.160968 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 905/1804] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:24:54 2022] DELETE /identity/v3/users/dd86f277365046c2800521b7281ae8f7 => generated 0 bytes in 781 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:24:55.206736 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:24:55.291078 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d652c4b-71c3-4bf7-a037-0315bc73327f tempest-VolumeQuotaClassesTest-664815250 tempest-VolumeQuotaClassesTest-664815250-project-admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:55.540794 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5749519-98a7-4441-a8e0-ab09f2136721 tempest-VolumeQuotaClassesTest-664815250 tempest-VolumeQuotaClassesTest-664815250-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '659e124b76094e3da8ad03025b896ef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7843959dd02c400bbba821f14a7275f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:55.544070 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5749519-98a7-4441-a8e0-ab09f2136721 tempest-VolumeQuotaClassesTest-664815250 tempest-VolumeQuotaClassesTest-664815250-project-admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:55.546516 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5749519-98a7-4441-a8e0-ab09f2136721 tempest-VolumeQuotaClassesTest-664815250 tempest-VolumeQuotaClassesTest-664815250-project-admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:55.548580 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5749519-98a7-4441-a8e0-ab09f2136721 tempest-VolumeQuotaClassesTest-664815250 tempest-VolumeQuotaClassesTest-664815250-project-admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:55.550531 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5749519-98a7-4441-a8e0-ab09f2136721 tempest-VolumeQuotaClassesTest-664815250 tempest-VolumeQuotaClassesTest-664815250-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:24:55.551671 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5749519-98a7-4441-a8e0-ab09f2136721 tempest-VolumeQuotaClassesTest-664815250 tempest-VolumeQuotaClassesTest-664815250-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:55.556123 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5749519-98a7-4441-a8e0-ab09f2136721 tempest-VolumeQuotaClassesTest-664815250 tempest-VolumeQuotaClassesTest-664815250-project-admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:55.594914 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 900/1805] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 15 12:24:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 459 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:24:55.675328 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60af68c9-c5dd-4bc3-a770-3c64109f063c admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:55.695903 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60af68c9-c5dd-4bc3-a770-3c64109f063c admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:55.711707 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bd912c-4954-4882-952c-307d6272cd7c tempest-VolumeQuotaClassesTest-664815250 tempest-VolumeQuotaClassesTest-664815250-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '659e124b76094e3da8ad03025b896ef9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7843959dd02c400bbba821f14a7275f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:55.713908 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd912c-4954-4882-952c-307d6272cd7c tempest-VolumeQuotaClassesTest-664815250 tempest-VolumeQuotaClassesTest-664815250-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:55.715144 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd912c-4954-4882-952c-307d6272cd7c tempest-VolumeQuotaClassesTest-664815250 tempest-VolumeQuotaClassesTest-664815250-project-admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:55.716402 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd912c-4954-4882-952c-307d6272cd7c tempest-VolumeQuotaClassesTest-664815250 tempest-VolumeQuotaClassesTest-664815250-project-admin] PATH_INFO: `/v3/projects/b624c5a060e44eb29f1e6277374485b4` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:55.719468 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bd912c-4954-4882-952c-307d6272cd7c tempest-VolumeQuotaClassesTest-664815250 tempest-VolumeQuotaClassesTest-664815250-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b624c5a060e44eb29f1e6277374485b4)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:55.722347 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bd912c-4954-4882-952c-307d6272cd7c tempest-VolumeQuotaClassesTest-664815250 tempest-VolumeQuotaClassesTest-664815250-project-admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:55.924283 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-f8bd912c-4954-4882-952c-307d6272cd7c tempest-VolumeQuotaClassesTest-664815250 tempest-VolumeQuotaClassesTest-664815250-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b624c5a060e44eb29f1e6277374485b4', 'request_id': 'req-f8bd912c-4954-4882-952c-307d6272cd7c'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:55.957558 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-f8bd912c-4954-4882-952c-307d6272cd7c tempest-VolumeQuotaClassesTest-664815250 tempest-VolumeQuotaClassesTest-664815250-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b624c5a060e44eb29f1e6277374485b4', 'request_id': 'req-f8bd912c-4954-4882-952c-307d6272cd7c'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:55.978945 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-f8bd912c-4954-4882-952c-307d6272cd7c tempest-VolumeQuotaClassesTest-664815250 tempest-VolumeQuotaClassesTest-664815250-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b624c5a060e44eb29f1e6277374485b4', 'request_id': 'req-f8bd912c-4954-4882-952c-307d6272cd7c'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:56.016273 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-f8bd912c-4954-4882-952c-307d6272cd7c tempest-VolumeQuotaClassesTest-664815250 tempest-VolumeQuotaClassesTest-664815250-project-admin] The token cache is being invalidate because project b624c5a060e44eb29f1e6277374485b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:24:56.017615 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-f8bd912c-4954-4882-952c-307d6272cd7c tempest-VolumeQuotaClassesTest-664815250 tempest-VolumeQuotaClassesTest-664815250-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:56.027283 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-f8bd912c-4954-4882-952c-307d6272cd7c tempest-VolumeQuotaClassesTest-664815250 tempest-VolumeQuotaClassesTest-664815250-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:56.031963 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 906/1806] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:24:55 2022] DELETE /identity/v3/projects/b624c5a060e44eb29f1e6277374485b4 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:24:56.533014 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5749519-98a7-4441-a8e0-ab09f2136721 tempest-VolumeQuotaClassesTest-664815250 tempest-VolumeQuotaClassesTest-664815250-project-admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:56.535122 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-f5749519-98a7-4441-a8e0-ab09f2136721 tempest-VolumeQuotaClassesTest-664815250 tempest-VolumeQuotaClassesTest-664815250-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:56.792136 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5749519-98a7-4441-a8e0-ab09f2136721 tempest-VolumeQuotaClassesTest-664815250 tempest-VolumeQuotaClassesTest-664815250-project-admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:56.995528 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09941041-cb41-4613-b4af-90c161929b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:56.999513 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09941041-cb41-4613-b4af-90c161929b84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:56.999513 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09941041-cb41-4613-b4af-90c161929b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:56.999705 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09941041-cb41-4613-b4af-90c161929b84 admin admin] PATH_INFO: `/v3/users/b1686fbcd01a477aa0c182f9ab5a0146` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:57.005682 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09941041-cb41-4613-b4af-90c161929b84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1686fbcd01a477aa0c182f9ab5a0146)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:57.015723 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09941041-cb41-4613-b4af-90c161929b84 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:57.068067 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:24:57.217936 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-09941041-cb41-4613-b4af-90c161929b84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1686fbcd01a477aa0c182f9ab5a0146'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:57.249109 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-09941041-cb41-4613-b4af-90c161929b84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1686fbcd01a477aa0c182f9ab5a0146'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:57.250216 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-09941041-cb41-4613-b4af-90c161929b84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1686fbcd01a477aa0c182f9ab5a0146'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:57.251062 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-09941041-cb41-4613-b4af-90c161929b84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1686fbcd01a477aa0c182f9ab5a0146'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:57.272598 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-09941041-cb41-4613-b4af-90c161929b84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1686fbcd01a477aa0c182f9ab5a0146'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:57.323410 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 901/1807] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:24:56 2022] DELETE /identity/v3/users/b1686fbcd01a477aa0c182f9ab5a0146 => generated 0 bytes in 788 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:24:57.324483 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22436fb6-d462-4540-a42d-f9afa07c5d73 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:57.325014 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22436fb6-d462-4540-a42d-f9afa07c5d73 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:57.325190 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22436fb6-d462-4540-a42d-f9afa07c5d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:57.371867 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-22436fb6-d462-4540-a42d-f9afa07c5d73 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:24:57.380864 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-22436fb6-d462-4540-a42d-f9afa07c5d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:57.614147 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 907/1808] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:24:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:24:57.771501 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09941041-cb41-4613-b4af-90c161929b84 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:57.774396 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-09941041-cb41-4613-b4af-90c161929b84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:57.930362 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09941041-cb41-4613-b4af-90c161929b84 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:57.941607 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3547e03-cffc-463d-8849-a70840bf9dd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:57.942530 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3547e03-cffc-463d-8849-a70840bf9dd3 service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:57.942893 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3547e03-cffc-463d-8849-a70840bf9dd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:57.943576 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3547e03-cffc-463d-8849-a70840bf9dd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:57.986607 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3547e03-cffc-463d-8849-a70840bf9dd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:57.992070 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3547e03-cffc-463d-8849-a70840bf9dd3 service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:58.013928 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 902/1809] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:24:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:24:58.775209 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e263ffae-4050-4f4c-80b6-4c70c72c7237 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:58.776260 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e263ffae-4050-4f4c-80b6-4c70c72c7237 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:58.776785 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e263ffae-4050-4f4c-80b6-4c70c72c7237 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:58.779203 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 908/1810] 10.222.0.16 () {54 vars in 921 bytes} [Thu Sep 15 12:24:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:24:58.902617 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cbcbb4-2379-4c9f-994b-2c4b68fd191c None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:58.903188 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cbcbb4-2379-4c9f-994b-2c4b68fd191c None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:58.903188 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cbcbb4-2379-4c9f-994b-2c4b68fd191c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:58.988867 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-35cbcbb4-2379-4c9f-994b-2c4b68fd191c None None] MFA Rules not processed for user `9d05c52570474820b4ba0e2cdad5c13f`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:24:58.997653 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-35cbcbb4-2379-4c9f-994b-2c4b68fd191c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:59.269032 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 903/1811] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Sep 15 12:24:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:24:59.322470 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e263ffae-4050-4f4c-80b6-4c70c72c7237 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:59.324408 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-e263ffae-4050-4f4c-80b6-4c70c72c7237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:59.373629 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e263ffae-4050-4f4c-80b6-4c70c72c7237 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:24:59.397562 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ab45f5-64fe-4601-ad22-b99c5307c1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:24:59.403996 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ab45f5-64fe-4601-ad22-b99c5307c1c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:59.408479 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ab45f5-64fe-4601-ad22-b99c5307c1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:59.412502 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ab45f5-64fe-4601-ad22-b99c5307c1c2 admin admin] PATH_INFO: `/v3/projects/fe2298940517418bb4c25fb1db1d1ef2` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:59.414527 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ab45f5-64fe-4601-ad22-b99c5307c1c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe2298940517418bb4c25fb1db1d1ef2)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:24:59.419613 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ab45f5-64fe-4601-ad22-b99c5307c1c2 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:24:59.617122 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-92ab45f5-64fe-4601-ad22-b99c5307c1c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe2298940517418bb4c25fb1db1d1ef2', 'request_id': 'req-92ab45f5-64fe-4601-ad22-b99c5307c1c2'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:59.632112 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-92ab45f5-64fe-4601-ad22-b99c5307c1c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe2298940517418bb4c25fb1db1d1ef2', 'request_id': 'req-92ab45f5-64fe-4601-ad22-b99c5307c1c2'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:59.652844 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-92ab45f5-64fe-4601-ad22-b99c5307c1c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe2298940517418bb4c25fb1db1d1ef2', 'request_id': 'req-92ab45f5-64fe-4601-ad22-b99c5307c1c2'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:59.693476 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-92ab45f5-64fe-4601-ad22-b99c5307c1c2 admin admin] The token cache is being invalidate because project fe2298940517418bb4c25fb1db1d1ef2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:24:59.693886 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-92ab45f5-64fe-4601-ad22-b99c5307c1c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:59.695096 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-92ab45f5-64fe-4601-ad22-b99c5307c1c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:24:59.705671 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ced4d1f-75ea-438a-bb86-146feefe3433 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:24:59.706057 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ced4d1f-75ea-438a-bb86-146feefe3433 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:24:59.706497 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ced4d1f-75ea-438a-bb86-146feefe3433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:24:59.712930 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 909/1812] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:24:59 2022] DELETE /identity/v3/projects/fe2298940517418bb4c25fb1db1d1ef2 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:24:59.752997 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-1ced4d1f-75ea-438a-bb86-146feefe3433 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:24:59.769310 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ab45f5-64fe-4601-ad22-b99c5307c1c2 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:24:59.773605 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-92ab45f5-64fe-4601-ad22-b99c5307c1c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:59.784999 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-1ced4d1f-75ea-438a-bb86-146feefe3433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:24:59.801387 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:24:59.867415 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:25:00.018740 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 904/1813] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:24:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:25:00.025857 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6091cbeb-33bf-4615-95a1-3f0c883b79a6 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:00.026250 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6091cbeb-33bf-4615-95a1-3f0c883b79a6 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:00.026352 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6091cbeb-33bf-4615-95a1-3f0c883b79a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:00.046945 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ab45f5-64fe-4601-ad22-b99c5307c1c2 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:00.055039 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ebc41c-6c9f-41c3-82ec-17343e92d309 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d05c52570474820b4ba0e2cdad5c13f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:00.055971 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ebc41c-6c9f-41c3-82ec-17343e92d309 service nova] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:00.057365 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ebc41c-6c9f-41c3-82ec-17343e92d309 service nova] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:00.057986 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ebc41c-6c9f-41c3-82ec-17343e92d309 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:00.061656 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-80ebc41c-6c9f-41c3-82ec-17343e92d309 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:00.079872 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ebc41c-6c9f-41c3-82ec-17343e92d309 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:00.081858 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ebc41c-6c9f-41c3-82ec-17343e92d309 service nova] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:00.105509 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 910/1814] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:24:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:25:00.105771 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-6091cbeb-33bf-4615-95a1-3f0c883b79a6 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:25:00.114295 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-6091cbeb-33bf-4615-95a1-3f0c883b79a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:00.145957 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ebc41c-6c9f-41c3-82ec-17343e92d309 service nova] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:00.146304 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 905/1815] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:25:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:25:00.166624 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ebc41c-6c9f-41c3-82ec-17343e92d309 service nova] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:00.183511 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a304db3a-6b41-4714-bc3f-5582877c540a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:00.185342 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a304db3a-6b41-4714-bc3f-5582877c540a admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:00.187660 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a304db3a-6b41-4714-bc3f-5582877c540a admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:00.189333 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a304db3a-6b41-4714-bc3f-5582877c540a admin admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:00.193580 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a304db3a-6b41-4714-bc3f-5582877c540a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:25:00.193987 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a304db3a-6b41-4714-bc3f-5582877c540a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:00.211142 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a304db3a-6b41-4714-bc3f-5582877c540a admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:00.260495 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6091cbeb-33bf-4615-95a1-3f0c883b79a6 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:00.262061 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 911/1816] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 15 12:25:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:25:00.296254 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6091cbeb-33bf-4615-95a1-3f0c883b79a6 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:00.312745 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2f0f28-e939-4dc5-837e-7e2169676f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:00.314014 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f0f28-e939-4dc5-837e-7e2169676f98 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:00.315683 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f0f28-e939-4dc5-837e-7e2169676f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:00.315683 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f0f28-e939-4dc5-837e-7e2169676f98 admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:00.317856 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2f0f28-e939-4dc5-837e-7e2169676f98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:00.322610 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2f0f28-e939-4dc5-837e-7e2169676f98 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:00.422785 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 906/1817] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:25:00 2022] POST /identity/v3/projects => generated 371 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:25:00.428293 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a304db3a-6b41-4714-bc3f-5582877c540a admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:00.441874 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a304db3a-6b41-4714-bc3f-5582877c540a admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:00.662514 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8a51b8-7190-48a9-b3df-8670fdda0b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:00.663183 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a51b8-7190-48a9-b3df-8670fdda0b1d admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:00.663464 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a51b8-7190-48a9-b3df-8670fdda0b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:00.663739 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a51b8-7190-48a9-b3df-8670fdda0b1d admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:00.664383 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8a51b8-7190-48a9-b3df-8670fdda0b1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:00.672537 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8a51b8-7190-48a9-b3df-8670fdda0b1d admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:00.734369 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 912/1818] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:25:00 2022] POST /identity/v3/users => generated 286 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:25:00.745665 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2f0f28-e939-4dc5-837e-7e2169676f98 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:00.795189 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2f0f28-e939-4dc5-837e-7e2169676f98 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:00.813240 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf89ad9-6537-4ba3-918e-61f3cac5cc98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:00.815556 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf89ad9-6537-4ba3-918e-61f3cac5cc98 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:00.817098 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf89ad9-6537-4ba3-918e-61f3cac5cc98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:00.817979 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf89ad9-6537-4ba3-918e-61f3cac5cc98 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:00.818872 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf89ad9-6537-4ba3-918e-61f3cac5cc98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:00.828923 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf89ad9-6537-4ba3-918e-61f3cac5cc98 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:00.862337 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 907/1819] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:25:00 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:25:00.865197 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8a51b8-7190-48a9-b3df-8670fdda0b1d admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:00.884438 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8a51b8-7190-48a9-b3df-8670fdda0b1d admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:00.898422 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dce454-f903-426c-b621-a4350741b8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:00.899382 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dce454-f903-426c-b621-a4350741b8b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:00.899728 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dce454-f903-426c-b621-a4350741b8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:00.900041 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dce454-f903-426c-b621-a4350741b8b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:00.900747 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dce454-f903-426c-b621-a4350741b8b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:00.907760 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dce454-f903-426c-b621-a4350741b8b5 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:00.943947 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 913/1820] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:25:00 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:25:00.948562 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf89ad9-6537-4ba3-918e-61f3cac5cc98 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:00.967092 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf89ad9-6537-4ba3-918e-61f3cac5cc98 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:00.992432 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2af96a7-7372-4faf-bf0c-b68b3e9ee41c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:00.994260 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af96a7-7372-4faf-bf0c-b68b3e9ee41c admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:00.994550 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af96a7-7372-4faf-bf0c-b68b3e9ee41c admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:00.999975 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af96a7-7372-4faf-bf0c-b68b3e9ee41c admin admin] PATH_INFO: `/v3/projects/0f5188a628bc454da91006e77ec15035/users/230a0cec59d94e1ab06ef6eb47391b4f/roles/9371e5bbc55848949eb951a815f817f2` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:01.040992 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2af96a7-7372-4faf-bf0c-b68b3e9ee41c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f5188a628bc454da91006e77ec15035, user_id=230a0cec59d94e1ab06ef6eb47391b4f, role_id=9371e5bbc55848949eb951a815f817f2)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:01.048689 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2af96a7-7372-4faf-bf0c-b68b3e9ee41c admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:01.095668 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 908/1821] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:25:00 2022] PUT /identity/v3/projects/0f5188a628bc454da91006e77ec15035/users/230a0cec59d94e1ab06ef6eb47391b4f/roles/9371e5bbc55848949eb951a815f817f2 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:25:01.100983 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42752fc-b0b4-47a4-a1c4-1f84bce0001e None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:01.101260 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42752fc-b0b4-47a4-a1c4-1f84bce0001e None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:01.102014 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42752fc-b0b4-47a4-a1c4-1f84bce0001e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:01.163279 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-f42752fc-b0b4-47a4-a1c4-1f84bce0001e None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:25:01.173295 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-f42752fc-b0b4-47a4-a1c4-1f84bce0001e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:01.385441 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:25:01.415678 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 914/1822] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:25:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:25:01.570192 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2af96a7-7372-4faf-bf0c-b68b3e9ee41c admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:01.572107 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-e2af96a7-7372-4faf-bf0c-b68b3e9ee41c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:01.615831 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42752fc-b0b4-47a4-a1c4-1f84bce0001e None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:01.617462 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-f42752fc-b0b4-47a4-a1c4-1f84bce0001e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:01.636172 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42752fc-b0b4-47a4-a1c4-1f84bce0001e None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:01.660900 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85620fa6-5161-4b31-a6c8-b2a5655d5b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:01.661387 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85620fa6-5161-4b31-a6c8-b2a5655d5b24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:01.661506 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85620fa6-5161-4b31-a6c8-b2a5655d5b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:01.661798 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85620fa6-5161-4b31-a6c8-b2a5655d5b24 admin admin] PATH_INFO: `/v3/projects/389b1127f6bf407e95282a6c9498a89a` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:01.664861 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85620fa6-5161-4b31-a6c8-b2a5655d5b24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=389b1127f6bf407e95282a6c9498a89a)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:01.674967 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85620fa6-5161-4b31-a6c8-b2a5655d5b24 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:01.744423 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2af96a7-7372-4faf-bf0c-b68b3e9ee41c admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:01.748211 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454c6c54-edf5-43b0-9b75-77cf3f8a78bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:01.748950 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c6c54-edf5-43b0-9b75-77cf3f8a78bb service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:01.749349 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c6c54-edf5-43b0-9b75-77cf3f8a78bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:01.749622 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c6c54-edf5-43b0-9b75-77cf3f8a78bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:01.761014 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454c6c54-edf5-43b0-9b75-77cf3f8a78bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:01.762422 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454c6c54-edf5-43b0-9b75-77cf3f8a78bb service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:01.780831 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 909/1823] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:25:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:25:01.823798 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-85620fa6-5161-4b31-a6c8-b2a5655d5b24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '389b1127f6bf407e95282a6c9498a89a', 'request_id': 'req-85620fa6-5161-4b31-a6c8-b2a5655d5b24'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:01.834667 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-85620fa6-5161-4b31-a6c8-b2a5655d5b24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '389b1127f6bf407e95282a6c9498a89a', 'request_id': 'req-85620fa6-5161-4b31-a6c8-b2a5655d5b24'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:01.842310 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-85620fa6-5161-4b31-a6c8-b2a5655d5b24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '389b1127f6bf407e95282a6c9498a89a', 'request_id': 'req-85620fa6-5161-4b31-a6c8-b2a5655d5b24'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:01.865297 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-85620fa6-5161-4b31-a6c8-b2a5655d5b24 admin admin] The token cache is being invalidate because project 389b1127f6bf407e95282a6c9498a89a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:25:01.866022 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-85620fa6-5161-4b31-a6c8-b2a5655d5b24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:01.867038 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-85620fa6-5161-4b31-a6c8-b2a5655d5b24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:01.870743 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 915/1824] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:25:01 2022] DELETE /identity/v3/projects/389b1127f6bf407e95282a6c9498a89a => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:25:01.875181 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454c6c54-edf5-43b0-9b75-77cf3f8a78bb service neutron] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:01.891327 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454c6c54-edf5-43b0-9b75-77cf3f8a78bb service neutron] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:02.031199 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0472e8f8-e19b-42b7-a691-230ff96e5473 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:02.031314 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0472e8f8-e19b-42b7-a691-230ff96e5473 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:02.031596 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0472e8f8-e19b-42b7-a691-230ff96e5473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:02.034186 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35197a06-7ca0-4261-9272-e60afda078ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:02.035486 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35197a06-7ca0-4261-9272-e60afda078ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:02.036004 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35197a06-7ca0-4261-9272-e60afda078ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:02.036504 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35197a06-7ca0-4261-9272-e60afda078ae admin admin] PATH_INFO: `/v3/users/659e124b76094e3da8ad03025b896ef9` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:02.038209 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35197a06-7ca0-4261-9272-e60afda078ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=659e124b76094e3da8ad03025b896ef9)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:02.041880 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35197a06-7ca0-4261-9272-e60afda078ae admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:02.052132 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:25:02.089430 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-0472e8f8-e19b-42b7-a691-230ff96e5473 None None] MFA Rules not processed for user `74811d83f5924dfbaa0866a2a48ca281`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:25:02.090797 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-0472e8f8-e19b-42b7-a691-230ff96e5473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:02.124628 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-35197a06-7ca0-4261-9272-e60afda078ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '659e124b76094e3da8ad03025b896ef9'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:02.145959 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-35197a06-7ca0-4261-9272-e60afda078ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '659e124b76094e3da8ad03025b896ef9'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:02.147013 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-35197a06-7ca0-4261-9272-e60afda078ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '659e124b76094e3da8ad03025b896ef9'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:02.147885 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-35197a06-7ca0-4261-9272-e60afda078ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '659e124b76094e3da8ad03025b896ef9'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:02.160567 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-35197a06-7ca0-4261-9272-e60afda078ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '659e124b76094e3da8ad03025b896ef9'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:02.188847 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 910/1825] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:25:01 2022] DELETE /identity/v3/users/659e124b76094e3da8ad03025b896ef9 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:25:02.215150 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3784cb0c-96e7-4900-bd98-6b41da4e09bd None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:02.215669 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3784cb0c-96e7-4900-bd98-6b41da4e09bd None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:02.216002 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3784cb0c-96e7-4900-bd98-6b41da4e09bd None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:02.217609 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 911/1826] 10.222.0.16 () {54 vars in 921 bytes} [Thu Sep 15 12:25:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:25:02.230016 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 916/1827] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:25:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:25:02.242191 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df725f7c-f6e3-4f97-8181-ec99c58c40bf None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:02.242673 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df725f7c-f6e3-4f97-8181-ec99c58c40bf None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:02.243136 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df725f7c-f6e3-4f97-8181-ec99c58c40bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:02.293956 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-df725f7c-f6e3-4f97-8181-ec99c58c40bf None None] MFA Rules not processed for user `9d05c52570474820b4ba0e2cdad5c13f`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:25:02.295941 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-df725f7c-f6e3-4f97-8181-ec99c58c40bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:02.406063 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 912/1828] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Sep 15 12:25:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:25:02.425453 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0472e8f8-e19b-42b7-a691-230ff96e5473 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:02.427396 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-0472e8f8-e19b-42b7-a691-230ff96e5473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:02.593257 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0472e8f8-e19b-42b7-a691-230ff96e5473 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:02.599759 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac82adca-0e1d-4e3b-b887-de732c440790 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d05c52570474820b4ba0e2cdad5c13f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:02.600435 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82adca-0e1d-4e3b-b887-de732c440790 service nova] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:02.600657 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82adca-0e1d-4e3b-b887-de732c440790 service nova] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:02.601094 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82adca-0e1d-4e3b-b887-de732c440790 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:02.613486 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac82adca-0e1d-4e3b-b887-de732c440790 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:02.615657 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac82adca-0e1d-4e3b-b887-de732c440790 service nova] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:02.631688 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 917/1829] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:25:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:25:03.114948 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df725f7c-f6e3-4f97-8181-ec99c58c40bf None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:03.117275 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-df725f7c-f6e3-4f97-8181-ec99c58c40bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:03.317270 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df725f7c-f6e3-4f97-8181-ec99c58c40bf None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:03.330288 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97126f5e-44d9-49a2-b3d6-0526300fc7ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:03.331822 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97126f5e-44d9-49a2-b3d6-0526300fc7ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:03.332103 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97126f5e-44d9-49a2-b3d6-0526300fc7ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:03.332369 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97126f5e-44d9-49a2-b3d6-0526300fc7ae admin admin] PATH_INFO: `/v3/projects/7843959dd02c400bbba821f14a7275f3` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:03.337273 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97126f5e-44d9-49a2-b3d6-0526300fc7ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=7843959dd02c400bbba821f14a7275f3)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:03.340157 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97126f5e-44d9-49a2-b3d6-0526300fc7ae admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:03.369017 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:25:03.423283 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-97126f5e-44d9-49a2-b3d6-0526300fc7ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7843959dd02c400bbba821f14a7275f3', 'request_id': 'req-97126f5e-44d9-49a2-b3d6-0526300fc7ae'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:03.436246 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-97126f5e-44d9-49a2-b3d6-0526300fc7ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7843959dd02c400bbba821f14a7275f3', 'request_id': 'req-97126f5e-44d9-49a2-b3d6-0526300fc7ae'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:03.455449 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-97126f5e-44d9-49a2-b3d6-0526300fc7ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7843959dd02c400bbba821f14a7275f3', 'request_id': 'req-97126f5e-44d9-49a2-b3d6-0526300fc7ae'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:03.481198 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-97126f5e-44d9-49a2-b3d6-0526300fc7ae admin admin] The token cache is being invalidate because project 7843959dd02c400bbba821f14a7275f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:25:03.481198 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-97126f5e-44d9-49a2-b3d6-0526300fc7ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:03.482500 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-97126f5e-44d9-49a2-b3d6-0526300fc7ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:03.488939 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 913/1830] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:25:03 2022] DELETE /identity/v3/projects/7843959dd02c400bbba821f14a7275f3 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:25:03.494033 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f848e-0b6d-4e3e-99b3-c4d8b82c2079 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:03.494560 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f848e-0b6d-4e3e-99b3-c4d8b82c2079 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:03.494560 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f848e-0b6d-4e3e-99b3-c4d8b82c2079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:03.522027 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-e74f848e-0b6d-4e3e-99b3-c4d8b82c2079 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:25:03.523538 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-e74f848e-0b6d-4e3e-99b3-c4d8b82c2079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:03.531044 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:25:03.663725 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 918/1831] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:25:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:25:03.668342 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a940a8-3caf-4073-b601-af6ce6d4baeb None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:03.669431 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a940a8-3caf-4073-b601-af6ce6d4baeb None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:03.670434 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a940a8-3caf-4073-b601-af6ce6d4baeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:03.707294 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-e6a940a8-3caf-4073-b601-af6ce6d4baeb None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:25:03.708627 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-e6a940a8-3caf-4073-b601-af6ce6d4baeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:03.728672 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 914/1832] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:25:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:25:03.735517 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74f848e-0b6d-4e3e-99b3-c4d8b82c2079 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:03.776780 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74f848e-0b6d-4e3e-99b3-c4d8b82c2079 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:03.793428 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0e2e3c-6f9b-469f-b2cb-f1963e70adb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:03.794385 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e2e3c-6f9b-469f-b2cb-f1963e70adb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:03.797716 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e2e3c-6f9b-469f-b2cb-f1963e70adb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:03.798179 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e2e3c-6f9b-469f-b2cb-f1963e70adb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:03.799080 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0e2e3c-6f9b-469f-b2cb-f1963e70adb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:25:03.801366 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0e2e3c-6f9b-469f-b2cb-f1963e70adb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:03.804923 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0e2e3c-6f9b-469f-b2cb-f1963e70adb9 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:03.855677 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 919/1833] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 15 12:25:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:25:03.861228 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a940a8-3caf-4073-b601-af6ce6d4baeb None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:03.871508 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a940a8-3caf-4073-b601-af6ce6d4baeb None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:03.877718 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61943aea-221e-4676-8043-7917b4adbdb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:03.878485 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61943aea-221e-4676-8043-7917b4adbdb3 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:03.879031 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61943aea-221e-4676-8043-7917b4adbdb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:03.879536 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61943aea-221e-4676-8043-7917b4adbdb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:03.881564 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61943aea-221e-4676-8043-7917b4adbdb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:03.882460 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61943aea-221e-4676-8043-7917b4adbdb3 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:03.931240 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 915/1834] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:25:03 2022] POST /identity/v3/projects => generated 367 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:25:03.932724 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0e2e3c-6f9b-469f-b2cb-f1963e70adb9 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:03.952481 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0e2e3c-6f9b-469f-b2cb-f1963e70adb9 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:03.972093 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0629d586-543c-4dfd-bb7b-cf0a2e6f37cd None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:03.972420 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0629d586-543c-4dfd-bb7b-cf0a2e6f37cd None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:03.972677 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0629d586-543c-4dfd-bb7b-cf0a2e6f37cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:04.040628 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-0629d586-543c-4dfd-bb7b-cf0a2e6f37cd None None] MFA Rules not processed for user `230a0cec59d94e1ab06ef6eb47391b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:25:04.042039 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-0629d586-543c-4dfd-bb7b-cf0a2e6f37cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:04.151580 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9197e07f-d999-494b-9141-426fc611a669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:04.152233 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9197e07f-d999-494b-9141-426fc611a669 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:04.152509 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9197e07f-d999-494b-9141-426fc611a669 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:04.152787 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9197e07f-d999-494b-9141-426fc611a669 admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:04.153448 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9197e07f-d999-494b-9141-426fc611a669 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:04.155982 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9197e07f-d999-494b-9141-426fc611a669 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:04.165660 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 916/1835] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:25:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:25:04.171121 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0629d586-543c-4dfd-bb7b-cf0a2e6f37cd None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:04.175290 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-0629d586-543c-4dfd-bb7b-cf0a2e6f37cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:04.203486 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 920/1836] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:25:03 2022] POST /identity/v3/users => generated 284 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 12:25:04.204647 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9197e07f-d999-494b-9141-426fc611a669 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:04.205226 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0629d586-543c-4dfd-bb7b-cf0a2e6f37cd None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:04.217613 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffe30ca-d7e8-4b9e-9455-6fbc241fae62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:04.218979 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe30ca-d7e8-4b9e-9455-6fbc241fae62 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:04.219479 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe30ca-d7e8-4b9e-9455-6fbc241fae62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:04.220894 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe30ca-d7e8-4b9e-9455-6fbc241fae62 admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:04.227378 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffe30ca-d7e8-4b9e-9455-6fbc241fae62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:04.229398 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9197e07f-d999-494b-9141-426fc611a669 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:04.232441 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffe30ca-d7e8-4b9e-9455-6fbc241fae62 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:04.235698 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532c6fda-016d-4e51-9399-afffed1336e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:04.236336 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c6fda-016d-4e51-9399-afffed1336e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:04.236618 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c6fda-016d-4e51-9399-afffed1336e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:04.236895 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c6fda-016d-4e51-9399-afffed1336e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:04.237574 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532c6fda-016d-4e51-9399-afffed1336e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:04.239239 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532c6fda-016d-4e51-9399-afffed1336e4 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:04.266883 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 921/1837] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:25:04 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 12:25:04.268400 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532c6fda-016d-4e51-9399-afffed1336e4 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:04.291380 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532c6fda-016d-4e51-9399-afffed1336e4 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:04.298950 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 917/1838] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:25:04 2022] POST /identity/v3/projects => generated 373 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:25:04.302889 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffe30ca-d7e8-4b9e-9455-6fbc241fae62 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:04.311987 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae580bb-bd86-497b-9e66-808d43beb2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:04.312617 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae580bb-bd86-497b-9e66-808d43beb2e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:04.312903 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae580bb-bd86-497b-9e66-808d43beb2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:04.313175 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae580bb-bd86-497b-9e66-808d43beb2e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:04.313834 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae580bb-bd86-497b-9e66-808d43beb2e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:04.316611 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae580bb-bd86-497b-9e66-808d43beb2e2 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:04.339096 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 922/1839] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:25:04 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:25:04.340036 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae580bb-bd86-497b-9e66-808d43beb2e2 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:04.360629 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae580bb-bd86-497b-9e66-808d43beb2e2 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:04.386121 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:25:04.417164 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffe30ca-d7e8-4b9e-9455-6fbc241fae62 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:04.423238 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df74349-8048-4d76-ae39-706b70c5944d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:04.424026 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df74349-8048-4d76-ae39-706b70c5944d admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:04.424311 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df74349-8048-4d76-ae39-706b70c5944d admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:04.424575 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df74349-8048-4d76-ae39-706b70c5944d admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:04.425205 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df74349-8048-4d76-ae39-706b70c5944d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:04.427172 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df74349-8048-4d76-ae39-706b70c5944d admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:04.464281 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 918/1840] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:25:04 2022] POST /identity/v3/users => generated 293 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:25:04.470454 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df74349-8048-4d76-ae39-706b70c5944d admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:04.497395 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df74349-8048-4d76-ae39-706b70c5944d admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:04.499960 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8135a437-bd2c-4e48-971b-d8cbfe471567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:04.501095 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8135a437-bd2c-4e48-971b-d8cbfe471567 admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:04.501371 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8135a437-bd2c-4e48-971b-d8cbfe471567 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:04.501893 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8135a437-bd2c-4e48-971b-d8cbfe471567 admin admin] PATH_INFO: `/v3/projects/b9fb5f7ac7514cddb4fe58814aa2a2ba/users/2ae2fc6a65f14859833517d4d57d0ee0/roles/9371e5bbc55848949eb951a815f817f2` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:04.509985 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b159d4b-7911-4c50-a787-c77568c415eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:04.511246 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b159d4b-7911-4c50-a787-c77568c415eb admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:04.511972 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b159d4b-7911-4c50-a787-c77568c415eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:04.512107 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b159d4b-7911-4c50-a787-c77568c415eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:04.512826 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b159d4b-7911-4c50-a787-c77568c415eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:04.519237 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b159d4b-7911-4c50-a787-c77568c415eb admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:04.532064 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:25:04.544884 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8135a437-bd2c-4e48-971b-d8cbfe471567 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9fb5f7ac7514cddb4fe58814aa2a2ba, user_id=2ae2fc6a65f14859833517d4d57d0ee0, role_id=9371e5bbc55848949eb951a815f817f2)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:04.552166 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 919/1841] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:25:04 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:25:04.553065 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b159d4b-7911-4c50-a787-c77568c415eb admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:04.555470 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8135a437-bd2c-4e48-971b-d8cbfe471567 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:04.572128 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b159d4b-7911-4c50-a787-c77568c415eb admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:04.594784 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 923/1842] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:25:04 2022] PUT /identity/v3/projects/b9fb5f7ac7514cddb4fe58814aa2a2ba/users/2ae2fc6a65f14859833517d4d57d0ee0/roles/9371e5bbc55848949eb951a815f817f2 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:25:04.601536 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3cfdcd-ce5b-4d26-a95f-393991c36602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:04.605770 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fae181-0da4-44ca-a241-f7a0345be663 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:04.606192 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fae181-0da4-44ca-a241-f7a0345be663 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:04.607328 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fae181-0da4-44ca-a241-f7a0345be663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:04.610817 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3cfdcd-ce5b-4d26-a95f-393991c36602 admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:04.612225 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3cfdcd-ce5b-4d26-a95f-393991c36602 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:04.612529 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3cfdcd-ce5b-4d26-a95f-393991c36602 admin admin] PATH_INFO: `/v3/projects/273d46dfe5f443d78cd6687d30ef1dc9/users/f38118641726493db6024f0cb4562ad4/roles/7f53f1c823b746529ba5057bf21b2477` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:04.665408 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-68fae181-0da4-44ca-a241-f7a0345be663 None None] MFA Rules not processed for user `2ae2fc6a65f14859833517d4d57d0ee0`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:25:04.668501 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-68fae181-0da4-44ca-a241-f7a0345be663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:04.688546 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3cfdcd-ce5b-4d26-a95f-393991c36602 admin admin] RBAC: Authorizing `identity:create_grant(project_id=273d46dfe5f443d78cd6687d30ef1dc9, user_id=f38118641726493db6024f0cb4562ad4, role_id=7f53f1c823b746529ba5057bf21b2477)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:04.691274 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3cfdcd-ce5b-4d26-a95f-393991c36602 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:04.732115 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 920/1843] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:25:04 2022] PUT /identity/v3/projects/273d46dfe5f443d78cd6687d30ef1dc9/users/f38118641726493db6024f0cb4562ad4/roles/7f53f1c823b746529ba5057bf21b2477 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:25:04.735828 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3cfdcd-ce5b-4d26-a95f-393991c36602 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:04.912047 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 924/1844] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:25:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:25:04.918014 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fae181-0da4-44ca-a241-f7a0345be663 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:04.919108 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3cfdcd-ce5b-4d26-a95f-393991c36602 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:04.932614 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a3e28e-afdb-4ab4-8fd3-dc0eda2fbd8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:04.933252 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3e28e-afdb-4ab4-8fd3-dc0eda2fbd8f admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:04.933534 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3e28e-afdb-4ab4-8fd3-dc0eda2fbd8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:04.933842 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3e28e-afdb-4ab4-8fd3-dc0eda2fbd8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:04.934509 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a3e28e-afdb-4ab4-8fd3-dc0eda2fbd8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:04.936799 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a3e28e-afdb-4ab4-8fd3-dc0eda2fbd8f admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:04.981776 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 921/1845] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:25:04 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 12:25:04.986634 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a3e28e-afdb-4ab4-8fd3-dc0eda2fbd8f admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:04.999985 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a3e28e-afdb-4ab4-8fd3-dc0eda2fbd8f admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:05.005797 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8051b25f-fbdc-4d15-8894-593332372d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:05.006489 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8051b25f-fbdc-4d15-8894-593332372d78 admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:05.006802 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8051b25f-fbdc-4d15-8894-593332372d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:05.007111 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8051b25f-fbdc-4d15-8894-593332372d78 admin admin] PATH_INFO: `/v3/projects/273d46dfe5f443d78cd6687d30ef1dc9/users/f38118641726493db6024f0cb4562ad4/roles/7f53f1c823b746529ba5057bf21b2477` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:05.009560 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8051b25f-fbdc-4d15-8894-593332372d78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=273d46dfe5f443d78cd6687d30ef1dc9, user_id=f38118641726493db6024f0cb4562ad4, role_id=7f53f1c823b746529ba5057bf21b2477)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:05.012916 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8051b25f-fbdc-4d15-8894-593332372d78 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:05.047211 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 922/1846] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:25:04 2022] PUT /identity/v3/projects/273d46dfe5f443d78cd6687d30ef1dc9/users/f38118641726493db6024f0cb4562ad4/roles/7f53f1c823b746529ba5057bf21b2477 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:25:05.123044 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fae181-0da4-44ca-a241-f7a0345be663 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:05.235978 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c9a0a-4389-47c7-a468-f6af171f7b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:05.237744 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c9a0a-4389-47c7-a468-f6af171f7b44 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:05.238144 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c9a0a-4389-47c7-a468-f6af171f7b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:05.238499 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c9a0a-4389-47c7-a468-f6af171f7b44 admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:05.239405 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4c9a0a-4389-47c7-a468-f6af171f7b44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:05.241828 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4c9a0a-4389-47c7-a468-f6af171f7b44 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:05.299444 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 925/1847] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:25:04 2022] POST /identity/v3/projects => generated 367 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:25:05.304634 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8051b25f-fbdc-4d15-8894-593332372d78 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:05.321899 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8051b25f-fbdc-4d15-8894-593332372d78 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:05.452019 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7ca854-04ba-4a69-bcef-8356a6a8ae96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:05.452735 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ca854-04ba-4a69-bcef-8356a6a8ae96 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:05.453027 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ca854-04ba-4a69-bcef-8356a6a8ae96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:05.453421 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ca854-04ba-4a69-bcef-8356a6a8ae96 admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:05.453955 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7ca854-04ba-4a69-bcef-8356a6a8ae96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:05.456135 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7ca854-04ba-4a69-bcef-8356a6a8ae96 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:05.498982 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 923/1848] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:25:05 2022] POST /identity/v3/users => generated 290 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:25:05.500080 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c9a0a-4389-47c7-a468-f6af171f7b44 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:05.514540 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c9a0a-4389-47c7-a468-f6af171f7b44 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:05.526968 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b22ea4-956e-4cfd-99f6-5923554755be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:05.527844 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b22ea4-956e-4cfd-99f6-5923554755be admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:05.528424 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b22ea4-956e-4cfd-99f6-5923554755be admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:05.528746 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b22ea4-956e-4cfd-99f6-5923554755be admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:05.530924 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b22ea4-956e-4cfd-99f6-5923554755be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:05.533411 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b22ea4-956e-4cfd-99f6-5923554755be admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:05.547376 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:25:05.556765 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 926/1849] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:25:05 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 12:25:05.562471 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7ca854-04ba-4a69-bcef-8356a6a8ae96 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:05.584136 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7ca854-04ba-4a69-bcef-8356a6a8ae96 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:05.604348 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0437d8e2-7ad9-4ea6-ae02-41ac91b23691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:05.605043 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437d8e2-7ad9-4ea6-ae02-41ac91b23691 admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:05.605322 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437d8e2-7ad9-4ea6-ae02-41ac91b23691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:05.605593 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437d8e2-7ad9-4ea6-ae02-41ac91b23691 admin admin] PATH_INFO: `/v3/projects/6fc30d8615bf4255b23eb499515a1b3f/users/cff9285cb3a24b05957bde5d6d032785/roles/7f53f1c823b746529ba5057bf21b2477` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:05.610663 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:25:05.627694 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0437d8e2-7ad9-4ea6-ae02-41ac91b23691 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fc30d8615bf4255b23eb499515a1b3f, user_id=cff9285cb3a24b05957bde5d6d032785, role_id=7f53f1c823b746529ba5057bf21b2477)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:05.632354 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0437d8e2-7ad9-4ea6-ae02-41ac91b23691 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:05.653260 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 924/1850] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:25:05 2022] PUT /identity/v3/projects/6fc30d8615bf4255b23eb499515a1b3f/users/cff9285cb3a24b05957bde5d6d032785/roles/7f53f1c823b746529ba5057bf21b2477 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:25:05.658080 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b22ea4-956e-4cfd-99f6-5923554755be admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:05.672017 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b22ea4-956e-4cfd-99f6-5923554755be admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:05.759621 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ac9563-1c7e-4778-b558-3566facf4757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:05.761235 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac9563-1c7e-4778-b558-3566facf4757 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:05.761508 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac9563-1c7e-4778-b558-3566facf4757 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:05.761786 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac9563-1c7e-4778-b558-3566facf4757 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:05.762640 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ac9563-1c7e-4778-b558-3566facf4757 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:05.765587 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ac9563-1c7e-4778-b558-3566facf4757 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:05.788603 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0437d8e2-7ad9-4ea6-ae02-41ac91b23691 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:05.789117 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 927/1851] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:25:05 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:25:05.803375 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0437d8e2-7ad9-4ea6-ae02-41ac91b23691 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:05.808406 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d25c9d-87ef-448b-93e5-cc6c1c7ab63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:05.809247 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d25c9d-87ef-448b-93e5-cc6c1c7ab63b admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:05.809593 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d25c9d-87ef-448b-93e5-cc6c1c7ab63b admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:05.809937 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d25c9d-87ef-448b-93e5-cc6c1c7ab63b admin admin] PATH_INFO: `/v3/projects/6fc30d8615bf4255b23eb499515a1b3f/users/cff9285cb3a24b05957bde5d6d032785/roles/7f53f1c823b746529ba5057bf21b2477` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:05.812039 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d25c9d-87ef-448b-93e5-cc6c1c7ab63b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fc30d8615bf4255b23eb499515a1b3f, user_id=cff9285cb3a24b05957bde5d6d032785, role_id=7f53f1c823b746529ba5057bf21b2477)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:05.815220 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d25c9d-87ef-448b-93e5-cc6c1c7ab63b admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:05.827426 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 925/1852] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:25:05 2022] PUT /identity/v3/projects/6fc30d8615bf4255b23eb499515a1b3f/users/cff9285cb3a24b05957bde5d6d032785/roles/7f53f1c823b746529ba5057bf21b2477 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:25:05.838000 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f5819-109c-46f1-8aec-21984c185e9b None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:05.838295 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f5819-109c-46f1-8aec-21984c185e9b None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:05.838624 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f5819-109c-46f1-8aec-21984c185e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:05.902759 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-713f5819-109c-46f1-8aec-21984c185e9b None None] MFA Rules not processed for user `cff9285cb3a24b05957bde5d6d032785`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:25:05.904887 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-713f5819-109c-46f1-8aec-21984c185e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:06.037188 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 928/1853] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:25:05 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:25:06.050194 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d25c9d-87ef-448b-93e5-cc6c1c7ab63b admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:06.052768 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-10d25c9d-87ef-448b-93e5-cc6c1c7ab63b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:06.132780 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8214cfb2-a245-4df0-94fb-177ddf782894 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:06.133966 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8214cfb2-a245-4df0-94fb-177ddf782894 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:06.134317 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8214cfb2-a245-4df0-94fb-177ddf782894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:06.219646 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-8214cfb2-a245-4df0-94fb-177ddf782894 None None] MFA Rules not processed for user `f38118641726493db6024f0cb4562ad4`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:25:06.220917 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-8214cfb2-a245-4df0-94fb-177ddf782894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:06.259639 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d25c9d-87ef-448b-93e5-cc6c1c7ab63b admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:06.269206 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a933634b-e7b8-403a-a770-4676c82db922 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceafc5e4283841528053f01931f10293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:06.270179 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a933634b-e7b8-403a-a770-4676c82db922 service cinder] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:06.270664 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a933634b-e7b8-403a-a770-4676c82db922 service cinder] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:06.271161 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a933634b-e7b8-403a-a770-4676c82db922 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:06.289690 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a933634b-e7b8-403a-a770-4676c82db922 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:06.293283 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a933634b-e7b8-403a-a770-4676c82db922 service cinder] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:06.314323 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 926/1854] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:25:06 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:25:06.361530 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 929/1855] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:25:06 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:25:06.372051 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af48cdaf-fdf8-40ae-8cc0-636df8f29dcd None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:06.372343 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af48cdaf-fdf8-40ae-8cc0-636df8f29dcd None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:06.373302 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af48cdaf-fdf8-40ae-8cc0-636df8f29dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:06.395741 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-af48cdaf-fdf8-40ae-8cc0-636df8f29dcd None None] MFA Rules not processed for user `230a0cec59d94e1ab06ef6eb47391b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:25:06.396941 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-af48cdaf-fdf8-40ae-8cc0-636df8f29dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:06.443649 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8214cfb2-a245-4df0-94fb-177ddf782894 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:06.457130 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8214cfb2-a245-4df0-94fb-177ddf782894 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:06.460538 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83323d96-66d7-47f8-a10b-8926752a8e1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceafc5e4283841528053f01931f10293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:06.461267 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83323d96-66d7-47f8-a10b-8926752a8e1d service cinder] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:06.461991 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83323d96-66d7-47f8-a10b-8926752a8e1d service cinder] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:06.461991 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83323d96-66d7-47f8-a10b-8926752a8e1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:06.468963 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:25:06.501097 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 927/1856] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:25:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:25:06.550476 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83323d96-66d7-47f8-a10b-8926752a8e1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:06.552116 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83323d96-66d7-47f8-a10b-8926752a8e1d service cinder] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:06.567109 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 930/1857] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:25:06 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 12:25:06.720022 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af48cdaf-fdf8-40ae-8cc0-636df8f29dcd None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:06.721699 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-af48cdaf-fdf8-40ae-8cc0-636df8f29dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:06.868336 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af48cdaf-fdf8-40ae-8cc0-636df8f29dcd None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:06.888323 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28843742-00ee-403b-82b7-f68e32c8a9a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d05c52570474820b4ba0e2cdad5c13f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:06.889361 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28843742-00ee-403b-82b7-f68e32c8a9a0 service nova] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:06.889494 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28843742-00ee-403b-82b7-f68e32c8a9a0 service nova] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:06.889804 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28843742-00ee-403b-82b7-f68e32c8a9a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:06.905688 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28843742-00ee-403b-82b7-f68e32c8a9a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:06.907779 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28843742-00ee-403b-82b7-f68e32c8a9a0 service nova] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:06.921748 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 928/1858] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:25:06 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:25:11.957937 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83323d96-66d7-47f8-a10b-8926752a8e1d service cinder] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:12.099301 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83323d96-66d7-47f8-a10b-8926752a8e1d service cinder] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:12.114823 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a6321-aa5b-4ae3-b18f-f15bcb2bae08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:12.115568 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a6321-aa5b-4ae3-b18f-f15bcb2bae08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:12.116016 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a6321-aa5b-4ae3-b18f-f15bcb2bae08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:12.116432 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a6321-aa5b-4ae3-b18f-f15bcb2bae08 admin admin] PATH_INFO: `/v3/users/2ae2fc6a65f14859833517d4d57d0ee0` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:12.117809 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5a6321-aa5b-4ae3-b18f-f15bcb2bae08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ae2fc6a65f14859833517d4d57d0ee0)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:12.120491 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5a6321-aa5b-4ae3-b18f-f15bcb2bae08 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:12.197689 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-5f5a6321-aa5b-4ae3-b18f-f15bcb2bae08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ae2fc6a65f14859833517d4d57d0ee0'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:12.212931 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-5f5a6321-aa5b-4ae3-b18f-f15bcb2bae08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ae2fc6a65f14859833517d4d57d0ee0'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:12.213806 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-5f5a6321-aa5b-4ae3-b18f-f15bcb2bae08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ae2fc6a65f14859833517d4d57d0ee0'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:12.215136 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-5f5a6321-aa5b-4ae3-b18f-f15bcb2bae08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ae2fc6a65f14859833517d4d57d0ee0'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:12.235090 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-5f5a6321-aa5b-4ae3-b18f-f15bcb2bae08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ae2fc6a65f14859833517d4d57d0ee0'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:12.256789 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4055be-1a48-47e4-b870-5adb7a51fda9 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:12.257296 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4055be-1a48-47e4-b870-5adb7a51fda9 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:12.257405 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4055be-1a48-47e4-b870-5adb7a51fda9 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:12.259259 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 929/1859] 10.222.0.16 () {54 vars in 921 bytes} [Thu Sep 15 12:25:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:25:12.277016 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c619ab28-1099-49ea-87f7-f73059533953 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:12.277630 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c619ab28-1099-49ea-87f7-f73059533953 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:12.277996 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c619ab28-1099-49ea-87f7-f73059533953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:12.284525 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 931/1860] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:25:11 2022] DELETE /identity/v3/users/2ae2fc6a65f14859833517d4d57d0ee0 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:25:12.290497 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:25:12.303875 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd4ebc-455f-489d-8794-9e48588f7d54 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:12.304103 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd4ebc-455f-489d-8794-9e48588f7d54 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:12.315338 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd4ebc-455f-489d-8794-9e48588f7d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:12.323331 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-c619ab28-1099-49ea-87f7-f73059533953 None None] MFA Rules not processed for user `9d05c52570474820b4ba0e2cdad5c13f`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:25:12.324579 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-c619ab28-1099-49ea-87f7-f73059533953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:12.354448 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-d3dd4ebc-455f-489d-8794-9e48588f7d54 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:25:12.355934 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-d3dd4ebc-455f-489d-8794-9e48588f7d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:12.402739 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:25:12.458802 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 930/1861] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Sep 15 12:25:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:25:12.471507 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 932/1862] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:25:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:25:12.481151 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c619ab28-1099-49ea-87f7-f73059533953 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:12.482622 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-c619ab28-1099-49ea-87f7-f73059533953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:12.550392 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c619ab28-1099-49ea-87f7-f73059533953 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:12.555561 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872da404-c15b-4989-a6b8-aad6a4813585 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:12.556759 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872da404-c15b-4989-a6b8-aad6a4813585 service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:12.557408 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872da404-c15b-4989-a6b8-aad6a4813585 service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:12.558362 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872da404-c15b-4989-a6b8-aad6a4813585 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:12.570765 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872da404-c15b-4989-a6b8-aad6a4813585 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:12.572351 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872da404-c15b-4989-a6b8-aad6a4813585 service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:12.584544 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 931/1863] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:25:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:25:12.784916 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dd4ebc-455f-489d-8794-9e48588f7d54 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:12.786511 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-d3dd4ebc-455f-489d-8794-9e48588f7d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:12.803289 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dd4ebc-455f-489d-8794-9e48588f7d54 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:12.809757 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11b72f1-72db-4c1d-820e-659e503991e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d05c52570474820b4ba0e2cdad5c13f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:12.810977 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b72f1-72db-4c1d-820e-659e503991e0 service nova] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:12.811257 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b72f1-72db-4c1d-820e-659e503991e0 service nova] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:12.811526 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b72f1-72db-4c1d-820e-659e503991e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:12.821094 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11b72f1-72db-4c1d-820e-659e503991e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:12.822717 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11b72f1-72db-4c1d-820e-659e503991e0 service nova] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:12.835093 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 933/1864] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:25:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:25:12.920065 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872da404-c15b-4989-a6b8-aad6a4813585 service neutron] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:12.921607 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-872da404-c15b-4989-a6b8-aad6a4813585 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:12.956303 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872da404-c15b-4989-a6b8-aad6a4813585 service neutron] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:12.962295 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1a2d59-7e6f-49dd-a62c-edabf8311965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:12.962295 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a2d59-7e6f-49dd-a62c-edabf8311965 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:12.962565 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a2d59-7e6f-49dd-a62c-edabf8311965 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:12.962887 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a2d59-7e6f-49dd-a62c-edabf8311965 admin admin] PATH_INFO: `/v3/projects/b9fb5f7ac7514cddb4fe58814aa2a2ba` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:12.964031 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1a2d59-7e6f-49dd-a62c-edabf8311965 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9fb5f7ac7514cddb4fe58814aa2a2ba)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:12.968236 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1a2d59-7e6f-49dd-a62c-edabf8311965 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:13.023519 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-0d1a2d59-7e6f-49dd-a62c-edabf8311965 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9fb5f7ac7514cddb4fe58814aa2a2ba', 'request_id': 'req-0d1a2d59-7e6f-49dd-a62c-edabf8311965'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:13.029863 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-0d1a2d59-7e6f-49dd-a62c-edabf8311965 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9fb5f7ac7514cddb4fe58814aa2a2ba', 'request_id': 'req-0d1a2d59-7e6f-49dd-a62c-edabf8311965'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:13.040149 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-0d1a2d59-7e6f-49dd-a62c-edabf8311965 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9fb5f7ac7514cddb4fe58814aa2a2ba', 'request_id': 'req-0d1a2d59-7e6f-49dd-a62c-edabf8311965'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:13.051631 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-0d1a2d59-7e6f-49dd-a62c-edabf8311965 admin admin] The token cache is being invalidate because project b9fb5f7ac7514cddb4fe58814aa2a2ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:25:13.051923 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-0d1a2d59-7e6f-49dd-a62c-edabf8311965 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:13.052545 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-0d1a2d59-7e6f-49dd-a62c-edabf8311965 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:13.054316 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 932/1865] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:25:12 2022] DELETE /identity/v3/projects/b9fb5f7ac7514cddb4fe58814aa2a2ba => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:25:13.058556 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11b72f1-72db-4c1d-820e-659e503991e0 service nova] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:13.071317 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11b72f1-72db-4c1d-820e-659e503991e0 service nova] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:13.132752 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc40c55-825e-4763-a2e1-09541ca69393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:13.133387 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc40c55-825e-4763-a2e1-09541ca69393 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:13.133673 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc40c55-825e-4763-a2e1-09541ca69393 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:13.133947 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc40c55-825e-4763-a2e1-09541ca69393 admin admin] PATH_INFO: `/v3/users/cff9285cb3a24b05957bde5d6d032785` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:13.135241 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc40c55-825e-4763-a2e1-09541ca69393 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cff9285cb3a24b05957bde5d6d032785)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:13.137046 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc40c55-825e-4763-a2e1-09541ca69393 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:13.184830 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-2bc40c55-825e-4763-a2e1-09541ca69393 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cff9285cb3a24b05957bde5d6d032785'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:13.193949 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-2bc40c55-825e-4763-a2e1-09541ca69393 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cff9285cb3a24b05957bde5d6d032785'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:13.194713 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-2bc40c55-825e-4763-a2e1-09541ca69393 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cff9285cb3a24b05957bde5d6d032785'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:13.195336 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-2bc40c55-825e-4763-a2e1-09541ca69393 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cff9285cb3a24b05957bde5d6d032785'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:13.203355 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-2bc40c55-825e-4763-a2e1-09541ca69393 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cff9285cb3a24b05957bde5d6d032785'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:13.222495 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 934/1866] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:25:13 2022] DELETE /identity/v3/users/cff9285cb3a24b05957bde5d6d032785 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:25:13.565623 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1a2d59-7e6f-49dd-a62c-edabf8311965 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:13.567301 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-0d1a2d59-7e6f-49dd-a62c-edabf8311965 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:13.608347 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1a2d59-7e6f-49dd-a62c-edabf8311965 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:13.662917 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:25:13.773779 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f73edd-b986-455f-9154-d2388b6c5310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:13.778194 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f73edd-b986-455f-9154-d2388b6c5310 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:13.778501 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f73edd-b986-455f-9154-d2388b6c5310 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:13.779546 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f73edd-b986-455f-9154-d2388b6c5310 admin admin] PATH_INFO: `/v3/projects/6fc30d8615bf4255b23eb499515a1b3f` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:13.782672 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f73edd-b986-455f-9154-d2388b6c5310 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fc30d8615bf4255b23eb499515a1b3f)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:13.785570 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f73edd-b986-455f-9154-d2388b6c5310 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:13.862017 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-04f73edd-b986-455f-9154-d2388b6c5310 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fc30d8615bf4255b23eb499515a1b3f', 'request_id': 'req-04f73edd-b986-455f-9154-d2388b6c5310'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:13.868654 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-04f73edd-b986-455f-9154-d2388b6c5310 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fc30d8615bf4255b23eb499515a1b3f', 'request_id': 'req-04f73edd-b986-455f-9154-d2388b6c5310'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:13.901190 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-04f73edd-b986-455f-9154-d2388b6c5310 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fc30d8615bf4255b23eb499515a1b3f', 'request_id': 'req-04f73edd-b986-455f-9154-d2388b6c5310'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:13.931420 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-04f73edd-b986-455f-9154-d2388b6c5310 admin admin] The token cache is being invalidate because project 6fc30d8615bf4255b23eb499515a1b3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:25:13.931732 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-04f73edd-b986-455f-9154-d2388b6c5310 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:13.936416 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-04f73edd-b986-455f-9154-d2388b6c5310 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:13.940180 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 933/1867] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:25:13 2022] DELETE /identity/v3/projects/6fc30d8615bf4255b23eb499515a1b3f => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:25:13.946253 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ca9dec-1737-4036-b2f8-6a8ece40cd8e None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:13.946865 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ca9dec-1737-4036-b2f8-6a8ece40cd8e None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:13.947344 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ca9dec-1737-4036-b2f8-6a8ece40cd8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:13.981084 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-23ca9dec-1737-4036-b2f8-6a8ece40cd8e None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:25:13.982925 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-23ca9dec-1737-4036-b2f8-6a8ece40cd8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:14.016265 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:25:14.081214 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 935/1868] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:25:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:25:14.088536 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a2fb5b-a53f-4c42-b5b2-970ca7afb87a None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:14.089558 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a2fb5b-a53f-4c42-b5b2-970ca7afb87a None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:14.089558 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a2fb5b-a53f-4c42-b5b2-970ca7afb87a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:14.120533 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-32a2fb5b-a53f-4c42-b5b2-970ca7afb87a None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:25:14.121749 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-32a2fb5b-a53f-4c42-b5b2-970ca7afb87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:14.130915 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 934/1869] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:25:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:25:14.135572 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ca9dec-1737-4036-b2f8-6a8ece40cd8e None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:14.147655 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ca9dec-1737-4036-b2f8-6a8ece40cd8e None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:14.153698 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf944c4-fa72-427c-9e0f-d751f76c0d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:14.155055 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf944c4-fa72-427c-9e0f-d751f76c0d2b admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:14.155343 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf944c4-fa72-427c-9e0f-d751f76c0d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:14.155615 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf944c4-fa72-427c-9e0f-d751f76c0d2b admin admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:14.157626 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf944c4-fa72-427c-9e0f-d751f76c0d2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:25:14.157626 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf944c4-fa72-427c-9e0f-d751f76c0d2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:14.158336 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf944c4-fa72-427c-9e0f-d751f76c0d2b admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:14.172270 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 936/1870] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 15 12:25:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:25:14.176630 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a2fb5b-a53f-4c42-b5b2-970ca7afb87a None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:14.187958 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a2fb5b-a53f-4c42-b5b2-970ca7afb87a None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:14.192658 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9f95be-3296-423d-8524-886c0437a085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:14.193860 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f95be-3296-423d-8524-886c0437a085 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:14.194201 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f95be-3296-423d-8524-886c0437a085 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:14.195170 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f95be-3296-423d-8524-886c0437a085 admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:14.196412 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9f95be-3296-423d-8524-886c0437a085 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:14.198582 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9f95be-3296-423d-8524-886c0437a085 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:14.236098 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf944c4-fa72-427c-9e0f-d751f76c0d2b admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:14.242768 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 935/1871] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:25:14 2022] POST /identity/v3/projects => generated 373 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:25:14.269372 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf944c4-fa72-427c-9e0f-d751f76c0d2b admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:14.418103 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e6c997-e104-459b-bfef-5830aaa9d924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:14.419006 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e6c997-e104-459b-bfef-5830aaa9d924 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:14.419335 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e6c997-e104-459b-bfef-5830aaa9d924 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:14.420154 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e6c997-e104-459b-bfef-5830aaa9d924 admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:14.421147 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e6c997-e104-459b-bfef-5830aaa9d924 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:14.424324 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e6c997-e104-459b-bfef-5830aaa9d924 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:14.467982 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 937/1872] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:25:14 2022] POST /identity/v3/users => generated 287 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 12:25:14.472711 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9f95be-3296-423d-8524-886c0437a085 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:14.500333 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9f95be-3296-423d-8524-886c0437a085 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:14.535894 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c91f41f-1066-4a1d-9376-9c5cf885a9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:14.536797 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c91f41f-1066-4a1d-9376-9c5cf885a9bc admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:14.537273 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c91f41f-1066-4a1d-9376-9c5cf885a9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:14.537737 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c91f41f-1066-4a1d-9376-9c5cf885a9bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:14.538585 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c91f41f-1066-4a1d-9376-9c5cf885a9bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:14.540582 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c91f41f-1066-4a1d-9376-9c5cf885a9bc admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:14.572686 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e6c997-e104-459b-bfef-5830aaa9d924 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:14.574398 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 936/1873] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:25:14 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:25:14.592941 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e6c997-e104-459b-bfef-5830aaa9d924 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:14.604318 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd8a315-7551-4711-b30d-b3f84524d9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:14.605114 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd8a315-7551-4711-b30d-b3f84524d9b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:14.605499 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd8a315-7551-4711-b30d-b3f84524d9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:14.605861 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd8a315-7551-4711-b30d-b3f84524d9b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:14.606722 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd8a315-7551-4711-b30d-b3f84524d9b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:14.609445 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd8a315-7551-4711-b30d-b3f84524d9b8 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:14.637271 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 938/1874] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:25:14 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:25:14.638513 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c91f41f-1066-4a1d-9376-9c5cf885a9bc admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:14.650280 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c91f41f-1066-4a1d-9376-9c5cf885a9bc admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:14.662541 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faac8b8-e94f-4827-8143-4f0c9c091a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:14.663380 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faac8b8-e94f-4827-8143-4f0c9c091a08 admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:14.663729 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faac8b8-e94f-4827-8143-4f0c9c091a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:14.664074 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faac8b8-e94f-4827-8143-4f0c9c091a08 admin admin] PATH_INFO: `/v3/projects/36010aefc5f24b13b33537206fa11c23/users/5527a95d181d402689c8293b30bfb61c/roles/9371e5bbc55848949eb951a815f817f2` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:14.701339 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faac8b8-e94f-4827-8143-4f0c9c091a08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36010aefc5f24b13b33537206fa11c23, user_id=5527a95d181d402689c8293b30bfb61c, role_id=9371e5bbc55848949eb951a815f817f2)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:14.704423 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faac8b8-e94f-4827-8143-4f0c9c091a08 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:14.750264 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 937/1875] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:25:14 2022] PUT /identity/v3/projects/36010aefc5f24b13b33537206fa11c23/users/5527a95d181d402689c8293b30bfb61c/roles/9371e5bbc55848949eb951a815f817f2 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:25:14.756418 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54082c98-a1a7-4ddc-9835-2936473b9936 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:14.756802 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54082c98-a1a7-4ddc-9835-2936473b9936 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:14.756973 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54082c98-a1a7-4ddc-9835-2936473b9936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:14.814878 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-54082c98-a1a7-4ddc-9835-2936473b9936 None None] MFA Rules not processed for user `5527a95d181d402689c8293b30bfb61c`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:25:14.816510 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-54082c98-a1a7-4ddc-9835-2936473b9936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:14.982893 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 939/1876] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:25:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:25:14.994336 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faac8b8-e94f-4827-8143-4f0c9c091a08 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:14.996857 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-3faac8b8-e94f-4827-8143-4f0c9c091a08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:15.072591 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:25:15.079108 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faac8b8-e94f-4827-8143-4f0c9c091a08 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:15.083844 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ab2ee7-0303-489f-8d0f-4a98076a9671 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceafc5e4283841528053f01931f10293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:15.085399 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab2ee7-0303-489f-8d0f-4a98076a9671 service cinder] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:15.085820 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab2ee7-0303-489f-8d0f-4a98076a9671 service cinder] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:15.087181 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab2ee7-0303-489f-8d0f-4a98076a9671 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:15.102008 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ab2ee7-0303-489f-8d0f-4a98076a9671 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:15.104091 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ab2ee7-0303-489f-8d0f-4a98076a9671 service cinder] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:15.119661 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 938/1877] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:25:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:25:15.136937 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54082c98-a1a7-4ddc-9835-2936473b9936 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:15.168739 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:25:15.209703 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54082c98-a1a7-4ddc-9835-2936473b9936 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:15.216057 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5e30ae-ad35-4a3d-8c83-80562f9ad121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:15.216398 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e30ae-ad35-4a3d-8c83-80562f9ad121 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:15.216938 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e30ae-ad35-4a3d-8c83-80562f9ad121 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:15.217297 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e30ae-ad35-4a3d-8c83-80562f9ad121 admin admin] PATH_INFO: `/v3/users/5527a95d181d402689c8293b30bfb61c` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:15.219419 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5e30ae-ad35-4a3d-8c83-80562f9ad121 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5527a95d181d402689c8293b30bfb61c)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:15.221662 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5e30ae-ad35-4a3d-8c83-80562f9ad121 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:15.283717 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-ba5e30ae-ad35-4a3d-8c83-80562f9ad121 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5527a95d181d402689c8293b30bfb61c'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:15.297071 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-ba5e30ae-ad35-4a3d-8c83-80562f9ad121 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5527a95d181d402689c8293b30bfb61c'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:15.297520 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-ba5e30ae-ad35-4a3d-8c83-80562f9ad121 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5527a95d181d402689c8293b30bfb61c'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:15.298261 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-ba5e30ae-ad35-4a3d-8c83-80562f9ad121 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5527a95d181d402689c8293b30bfb61c'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:15.308199 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-ba5e30ae-ad35-4a3d-8c83-80562f9ad121 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5527a95d181d402689c8293b30bfb61c'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:15.334775 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 940/1878] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:25:15 2022] DELETE /identity/v3/users/5527a95d181d402689c8293b30bfb61c => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:25:15.337949 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9181f80-f618-466d-a382-d32785042c6b None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:15.338531 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9181f80-f618-466d-a382-d32785042c6b None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:15.338854 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9181f80-f618-466d-a382-d32785042c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:15.368599 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-e9181f80-f618-466d-a382-d32785042c6b None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:25:15.370421 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-e9181f80-f618-466d-a382-d32785042c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:15.480112 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 939/1879] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:25:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:25:15.491107 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5e30ae-ad35-4a3d-8c83-80562f9ad121 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:15.492510 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-ba5e30ae-ad35-4a3d-8c83-80562f9ad121 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:15.594200 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5e30ae-ad35-4a3d-8c83-80562f9ad121 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:15.599703 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1332adb-c9b3-4c68-9078-c589406f17ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:15.600517 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1332adb-c9b3-4c68-9078-c589406f17ed service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:15.600899 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1332adb-c9b3-4c68-9078-c589406f17ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:15.601270 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1332adb-c9b3-4c68-9078-c589406f17ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:15.615482 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1332adb-c9b3-4c68-9078-c589406f17ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:15.617380 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1332adb-c9b3-4c68-9078-c589406f17ed service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:15.643634 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 941/1880] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:25:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:25:16.113854 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9181f80-f618-466d-a382-d32785042c6b None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:16.116204 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-e9181f80-f618-466d-a382-d32785042c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:16.133163 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9181f80-f618-466d-a382-d32785042c6b None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:16.139035 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd02a8cf-7df5-4b17-8720-73ca87b91ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:16.140082 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd02a8cf-7df5-4b17-8720-73ca87b91ed3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:16.140558 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd02a8cf-7df5-4b17-8720-73ca87b91ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:16.140894 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd02a8cf-7df5-4b17-8720-73ca87b91ed3 admin admin] PATH_INFO: `/v3/projects/36010aefc5f24b13b33537206fa11c23` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:16.142446 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd02a8cf-7df5-4b17-8720-73ca87b91ed3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36010aefc5f24b13b33537206fa11c23)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:16.145013 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd02a8cf-7df5-4b17-8720-73ca87b91ed3 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:16.204788 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-cd02a8cf-7df5-4b17-8720-73ca87b91ed3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36010aefc5f24b13b33537206fa11c23', 'request_id': 'req-cd02a8cf-7df5-4b17-8720-73ca87b91ed3'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:16.212378 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-cd02a8cf-7df5-4b17-8720-73ca87b91ed3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36010aefc5f24b13b33537206fa11c23', 'request_id': 'req-cd02a8cf-7df5-4b17-8720-73ca87b91ed3'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:16.223273 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-cd02a8cf-7df5-4b17-8720-73ca87b91ed3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36010aefc5f24b13b33537206fa11c23', 'request_id': 'req-cd02a8cf-7df5-4b17-8720-73ca87b91ed3'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:16.240243 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-cd02a8cf-7df5-4b17-8720-73ca87b91ed3 admin admin] The token cache is being invalidate because project 36010aefc5f24b13b33537206fa11c23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:25:16.240542 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-cd02a8cf-7df5-4b17-8720-73ca87b91ed3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:16.241190 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-cd02a8cf-7df5-4b17-8720-73ca87b91ed3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:16.242737 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 940/1881] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:25:16 2022] DELETE /identity/v3/projects/36010aefc5f24b13b33537206fa11c23 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:25:16.247864 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082e613-73b0-4021-8336-4d47ae2157b1 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:16.248572 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082e613-73b0-4021-8336-4d47ae2157b1 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:16.248572 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082e613-73b0-4021-8336-4d47ae2157b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:16.269493 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-3082e613-73b0-4021-8336-4d47ae2157b1 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:25:16.270804 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-3082e613-73b0-4021-8336-4d47ae2157b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:16.315013 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:25:16.332726 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 942/1882] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:25:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:25:16.342127 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213deb87-2e28-482b-9ba6-7fe8607ad869 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:16.342406 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213deb87-2e28-482b-9ba6-7fe8607ad869 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:16.342675 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213deb87-2e28-482b-9ba6-7fe8607ad869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:16.362167 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-213deb87-2e28-482b-9ba6-7fe8607ad869 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:25:16.363388 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-213deb87-2e28-482b-9ba6-7fe8607ad869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:16.371128 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 941/1883] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:25:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:25:16.375221 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3082e613-73b0-4021-8336-4d47ae2157b1 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:16.385167 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3082e613-73b0-4021-8336-4d47ae2157b1 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:16.390182 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8537eeb-ddea-4783-b38f-d181d4bba28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:16.390808 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8537eeb-ddea-4783-b38f-d181d4bba28f admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:16.391083 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8537eeb-ddea-4783-b38f-d181d4bba28f admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:16.391354 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8537eeb-ddea-4783-b38f-d181d4bba28f admin admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:16.391996 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8537eeb-ddea-4783-b38f-d181d4bba28f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:25:16.392294 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8537eeb-ddea-4783-b38f-d181d4bba28f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:16.393869 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8537eeb-ddea-4783-b38f-d181d4bba28f admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:16.409563 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 943/1884] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 15 12:25:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:25:16.411049 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213deb87-2e28-482b-9ba6-7fe8607ad869 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:16.421413 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213deb87-2e28-482b-9ba6-7fe8607ad869 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:16.426523 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b9000d-600c-4a6e-ae8d-84ae57746f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:16.427223 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b9000d-600c-4a6e-ae8d-84ae57746f64 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:16.427507 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b9000d-600c-4a6e-ae8d-84ae57746f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:16.427780 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b9000d-600c-4a6e-ae8d-84ae57746f64 admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:16.428425 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b9000d-600c-4a6e-ae8d-84ae57746f64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:16.430363 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b9000d-600c-4a6e-ae8d-84ae57746f64 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:16.465604 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 942/1885] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:25:16 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:25:16.470469 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8537eeb-ddea-4783-b38f-d181d4bba28f admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:16.481127 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8537eeb-ddea-4783-b38f-d181d4bba28f admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:16.546298 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ef75e1-9995-424e-97cc-6bab9099be9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:16.547037 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef75e1-9995-424e-97cc-6bab9099be9f admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:16.547271 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef75e1-9995-424e-97cc-6bab9099be9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:16.547698 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef75e1-9995-424e-97cc-6bab9099be9f admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:16.548329 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ef75e1-9995-424e-97cc-6bab9099be9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:16.550228 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ef75e1-9995-424e-97cc-6bab9099be9f admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:16.579961 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 944/1886] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:25:16 2022] POST /identity/v3/users => generated 293 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:25:16.583921 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b9000d-600c-4a6e-ae8d-84ae57746f64 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:16.594037 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b9000d-600c-4a6e-ae8d-84ae57746f64 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:16.598546 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dc3219-1f94-4d98-b0f6-9628c0ecfc8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:16.599245 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc3219-1f94-4d98-b0f6-9628c0ecfc8b admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:16.599593 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc3219-1f94-4d98-b0f6-9628c0ecfc8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:16.599926 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc3219-1f94-4d98-b0f6-9628c0ecfc8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:16.600690 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dc3219-1f94-4d98-b0f6-9628c0ecfc8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:16.602360 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dc3219-1f94-4d98-b0f6-9628c0ecfc8b admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:16.613337 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 943/1887] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:25:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:25:16.617295 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ef75e1-9995-424e-97cc-6bab9099be9f admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:16.629301 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ef75e1-9995-424e-97cc-6bab9099be9f admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:16.633880 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336a197c-3df7-4b93-9954-b25be9b4051c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:16.634479 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a197c-3df7-4b93-9954-b25be9b4051c admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:16.634789 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a197c-3df7-4b93-9954-b25be9b4051c admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:16.635058 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a197c-3df7-4b93-9954-b25be9b4051c admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:16.635695 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336a197c-3df7-4b93-9954-b25be9b4051c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:16.637312 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336a197c-3df7-4b93-9954-b25be9b4051c admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:16.649153 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 945/1888] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:25:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:25:16.653257 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dc3219-1f94-4d98-b0f6-9628c0ecfc8b admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:16.674825 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dc3219-1f94-4d98-b0f6-9628c0ecfc8b admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:16.691440 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d037069-cc97-4ef2-986d-d66d571cbf2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:16.692280 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d037069-cc97-4ef2-986d-d66d571cbf2e admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:16.692790 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d037069-cc97-4ef2-986d-d66d571cbf2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:16.693270 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d037069-cc97-4ef2-986d-d66d571cbf2e admin admin] PATH_INFO: `/v3/projects/2f63a02d069e49a3a91923671e318358/users/daa662ab62a446e8bcb936853638eec2/roles/9371e5bbc55848949eb951a815f817f2` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:16.715496 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d037069-cc97-4ef2-986d-d66d571cbf2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f63a02d069e49a3a91923671e318358, user_id=daa662ab62a446e8bcb936853638eec2, role_id=9371e5bbc55848949eb951a815f817f2)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:16.718199 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d037069-cc97-4ef2-986d-d66d571cbf2e admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:16.731366 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 944/1889] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:25:16 2022] PUT /identity/v3/projects/2f63a02d069e49a3a91923671e318358/users/daa662ab62a446e8bcb936853638eec2/roles/9371e5bbc55848949eb951a815f817f2 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:25:16.742423 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f739ed9-9c9b-4404-8c86-5484f8bed3ea None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:16.742754 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f739ed9-9c9b-4404-8c86-5484f8bed3ea None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:16.742996 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f739ed9-9c9b-4404-8c86-5484f8bed3ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:16.772572 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-8f739ed9-9c9b-4404-8c86-5484f8bed3ea None None] MFA Rules not processed for user `daa662ab62a446e8bcb936853638eec2`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:25:16.773803 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-8f739ed9-9c9b-4404-8c86-5484f8bed3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:16.838243 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 946/1890] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:25:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:25:16.860068 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d037069-cc97-4ef2-986d-d66d571cbf2e admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:16.861804 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-2d037069-cc97-4ef2-986d-d66d571cbf2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:16.875613 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:25:16.929255 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d037069-cc97-4ef2-986d-d66d571cbf2e admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:16.933203 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4e9464-b50e-4916-80b1-55ae5c3e9b93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceafc5e4283841528053f01931f10293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:16.933561 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e9464-b50e-4916-80b1-55ae5c3e9b93 service cinder] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:16.933849 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e9464-b50e-4916-80b1-55ae5c3e9b93 service cinder] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:16.934384 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e9464-b50e-4916-80b1-55ae5c3e9b93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:16.944994 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4e9464-b50e-4916-80b1-55ae5c3e9b93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:16.946440 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4e9464-b50e-4916-80b1-55ae5c3e9b93 service cinder] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:16.956204 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 945/1891] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:25:16 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:25:20.387878 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f739ed9-9c9b-4404-8c86-5484f8bed3ea None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:20.389826 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-8f739ed9-9c9b-4404-8c86-5484f8bed3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:20.458188 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:25:20.491751 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f739ed9-9c9b-4404-8c86-5484f8bed3ea None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:20.496261 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ffb82f-3480-465a-9829-cc0745b41dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:20.496904 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ffb82f-3480-465a-9829-cc0745b41dac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:20.498148 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ffb82f-3480-465a-9829-cc0745b41dac admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:20.498439 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ffb82f-3480-465a-9829-cc0745b41dac admin admin] PATH_INFO: `/v3/users/e47ea7a2f72447b0be317bbf3358d110` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:20.499659 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ffb82f-3480-465a-9829-cc0745b41dac admin admin] RBAC: Authorizing `identity:delete_user(user_id=e47ea7a2f72447b0be317bbf3358d110)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:20.501852 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ffb82f-3480-465a-9829-cc0745b41dac admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:20.563519 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-93ffb82f-3480-465a-9829-cc0745b41dac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e47ea7a2f72447b0be317bbf3358d110'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:20.571509 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-93ffb82f-3480-465a-9829-cc0745b41dac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e47ea7a2f72447b0be317bbf3358d110'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:20.572252 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-93ffb82f-3480-465a-9829-cc0745b41dac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e47ea7a2f72447b0be317bbf3358d110'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:20.572861 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-93ffb82f-3480-465a-9829-cc0745b41dac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e47ea7a2f72447b0be317bbf3358d110'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:20.582888 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-93ffb82f-3480-465a-9829-cc0745b41dac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e47ea7a2f72447b0be317bbf3358d110'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:20.601221 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 947/1892] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:25:20 2022] DELETE /identity/v3/users/e47ea7a2f72447b0be317bbf3358d110 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:25:20.605721 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a21817-1329-4b9c-a957-6edadc858661 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:20.606222 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a21817-1329-4b9c-a957-6edadc858661 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:20.606357 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a21817-1329-4b9c-a957-6edadc858661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:20.625746 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-d3a21817-1329-4b9c-a957-6edadc858661 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:25:20.627209 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-d3a21817-1329-4b9c-a957-6edadc858661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:20.718924 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 946/1893] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:25:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:25:20.721172 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ffb82f-3480-465a-9829-cc0745b41dac admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:20.727570 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-93ffb82f-3480-465a-9829-cc0745b41dac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:20.792446 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ffb82f-3480-465a-9829-cc0745b41dac admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:20.796861 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e029531-8bd7-41ec-81e7-7a3caa0bcbfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:20.797741 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e029531-8bd7-41ec-81e7-7a3caa0bcbfa service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:20.797895 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e029531-8bd7-41ec-81e7-7a3caa0bcbfa service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:20.798039 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e029531-8bd7-41ec-81e7-7a3caa0bcbfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:20.808813 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e029531-8bd7-41ec-81e7-7a3caa0bcbfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:20.810490 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e029531-8bd7-41ec-81e7-7a3caa0bcbfa service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:20.822026 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 948/1894] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:25:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:25:21.138656 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a21817-1329-4b9c-a957-6edadc858661 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:21.140234 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-d3a21817-1329-4b9c-a957-6edadc858661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:21.153687 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a21817-1329-4b9c-a957-6edadc858661 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:21.157965 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641b71eb-6643-4462-b38e-b968e9f27ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:21.158718 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b71eb-6643-4462-b38e-b968e9f27ced admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:21.159073 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b71eb-6643-4462-b38e-b968e9f27ced admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:21.159416 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b71eb-6643-4462-b38e-b968e9f27ced admin admin] PATH_INFO: `/v3/projects/bfe9374e562f48319e49c1b8692be447` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:21.160628 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641b71eb-6643-4462-b38e-b968e9f27ced admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfe9374e562f48319e49c1b8692be447)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:21.162791 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641b71eb-6643-4462-b38e-b968e9f27ced admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:21.212720 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-641b71eb-6643-4462-b38e-b968e9f27ced admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfe9374e562f48319e49c1b8692be447', 'request_id': 'req-641b71eb-6643-4462-b38e-b968e9f27ced'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:21.218918 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-641b71eb-6643-4462-b38e-b968e9f27ced admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfe9374e562f48319e49c1b8692be447', 'request_id': 'req-641b71eb-6643-4462-b38e-b968e9f27ced'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:21.226988 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-641b71eb-6643-4462-b38e-b968e9f27ced admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfe9374e562f48319e49c1b8692be447', 'request_id': 'req-641b71eb-6643-4462-b38e-b968e9f27ced'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:21.238900 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-641b71eb-6643-4462-b38e-b968e9f27ced admin admin] The token cache is being invalidate because project bfe9374e562f48319e49c1b8692be447 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:25:21.239188 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-641b71eb-6643-4462-b38e-b968e9f27ced admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:21.239826 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-641b71eb-6643-4462-b38e-b968e9f27ced admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:21.241540 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 947/1895] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:25:21 2022] DELETE /identity/v3/projects/bfe9374e562f48319e49c1b8692be447 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:25:21.245259 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e029531-8bd7-41ec-81e7-7a3caa0bcbfa service neutron] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:21.256027 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e029531-8bd7-41ec-81e7-7a3caa0bcbfa service neutron] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:21.316399 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a73a8b8-0da8-4f9b-bc00-4d968c71f4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:21.317227 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a73a8b8-0da8-4f9b-bc00-4d968c71f4e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:21.317600 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a73a8b8-0da8-4f9b-bc00-4d968c71f4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:21.318048 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a73a8b8-0da8-4f9b-bc00-4d968c71f4e0 admin admin] PATH_INFO: `/v3/users/aba1025e340140f79da7c8b479d1ecd3` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:21.319288 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a73a8b8-0da8-4f9b-bc00-4d968c71f4e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aba1025e340140f79da7c8b479d1ecd3)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:21.321306 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a73a8b8-0da8-4f9b-bc00-4d968c71f4e0 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:21.327661 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:25:21.380418 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-3a73a8b8-0da8-4f9b-bc00-4d968c71f4e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aba1025e340140f79da7c8b479d1ecd3'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:21.390914 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-3a73a8b8-0da8-4f9b-bc00-4d968c71f4e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aba1025e340140f79da7c8b479d1ecd3'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:21.391851 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-3a73a8b8-0da8-4f9b-bc00-4d968c71f4e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aba1025e340140f79da7c8b479d1ecd3'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:21.392533 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-3a73a8b8-0da8-4f9b-bc00-4d968c71f4e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aba1025e340140f79da7c8b479d1ecd3'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:21.400150 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-3a73a8b8-0da8-4f9b-bc00-4d968c71f4e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aba1025e340140f79da7c8b479d1ecd3'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:21.417509 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 949/1896] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:25:21 2022] DELETE /identity/v3/users/aba1025e340140f79da7c8b479d1ecd3 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:25:21.897525 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641b71eb-6643-4462-b38e-b968e9f27ced admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:21.899016 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-641b71eb-6643-4462-b38e-b968e9f27ced admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:21.925408 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641b71eb-6643-4462-b38e-b968e9f27ced admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:21.994928 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:25:22.057376 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9785d210-6bb2-427a-a49c-72667ed52f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:22.058107 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785d210-6bb2-427a-a49c-72667ed52f87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:22.058394 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785d210-6bb2-427a-a49c-72667ed52f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:22.058670 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785d210-6bb2-427a-a49c-72667ed52f87 admin admin] PATH_INFO: `/v3/projects/d38de732d9894c22936d6cfaf9c4d779` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:22.060684 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9785d210-6bb2-427a-a49c-72667ed52f87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d38de732d9894c22936d6cfaf9c4d779)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:22.064035 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9785d210-6bb2-427a-a49c-72667ed52f87 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:22.127956 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-9785d210-6bb2-427a-a49c-72667ed52f87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd38de732d9894c22936d6cfaf9c4d779', 'request_id': 'req-9785d210-6bb2-427a-a49c-72667ed52f87'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:22.134985 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-9785d210-6bb2-427a-a49c-72667ed52f87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd38de732d9894c22936d6cfaf9c4d779', 'request_id': 'req-9785d210-6bb2-427a-a49c-72667ed52f87'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:22.145280 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-9785d210-6bb2-427a-a49c-72667ed52f87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd38de732d9894c22936d6cfaf9c4d779', 'request_id': 'req-9785d210-6bb2-427a-a49c-72667ed52f87'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:22.162584 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-9785d210-6bb2-427a-a49c-72667ed52f87 admin admin] The token cache is being invalidate because project d38de732d9894c22936d6cfaf9c4d779 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:25:22.162936 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-9785d210-6bb2-427a-a49c-72667ed52f87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:22.163552 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-9785d210-6bb2-427a-a49c-72667ed52f87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:22.167479 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 948/1897] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:25:21 2022] DELETE /identity/v3/projects/d38de732d9894c22936d6cfaf9c4d779 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:25:22.171562 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d3705-4546-4332-b29b-5629de4a87f7 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:22.171940 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d3705-4546-4332-b29b-5629de4a87f7 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:22.172249 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d3705-4546-4332-b29b-5629de4a87f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:22.200054 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-4e6d3705-4546-4332-b29b-5629de4a87f7 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:25:22.202387 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-4e6d3705-4546-4332-b29b-5629de4a87f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:22.269055 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 950/1898] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:25:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:25:22.279162 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86758cf9-f01f-4fab-8ca8-7be348ccb1e6 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:22.279522 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86758cf9-f01f-4fab-8ca8-7be348ccb1e6 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:22.279894 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86758cf9-f01f-4fab-8ca8-7be348ccb1e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:22.300552 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-86758cf9-f01f-4fab-8ca8-7be348ccb1e6 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:25:22.301758 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-86758cf9-f01f-4fab-8ca8-7be348ccb1e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:22.310079 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 949/1899] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:25:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:25:22.314455 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6d3705-4546-4332-b29b-5629de4a87f7 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:22.324151 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6d3705-4546-4332-b29b-5629de4a87f7 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:22.329169 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f79347-f5a3-47ec-ae59-59e5d0361530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:22.329774 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f79347-f5a3-47ec-ae59-59e5d0361530 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:22.330083 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f79347-f5a3-47ec-ae59-59e5d0361530 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:22.330357 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f79347-f5a3-47ec-ae59-59e5d0361530 admin admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:22.331049 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f79347-f5a3-47ec-ae59-59e5d0361530 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:25:22.331352 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f79347-f5a3-47ec-ae59-59e5d0361530 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:22.332938 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f79347-f5a3-47ec-ae59-59e5d0361530 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:22.345150 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 951/1900] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 15 12:25:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:25:22.349558 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86758cf9-f01f-4fab-8ca8-7be348ccb1e6 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:22.358926 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86758cf9-f01f-4fab-8ca8-7be348ccb1e6 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:22.363532 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6e8540-33de-4793-bf54-a059f65d8344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:22.364137 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e8540-33de-4793-bf54-a059f65d8344 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:22.364412 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e8540-33de-4793-bf54-a059f65d8344 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:22.364677 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e8540-33de-4793-bf54-a059f65d8344 admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:22.365316 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6e8540-33de-4793-bf54-a059f65d8344 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:22.367284 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6e8540-33de-4793-bf54-a059f65d8344 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:22.397058 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 950/1901] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:25:22 2022] POST /identity/v3/projects => generated 365 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:25:22.402718 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f79347-f5a3-47ec-ae59-59e5d0361530 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:22.426173 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f79347-f5a3-47ec-ae59-59e5d0361530 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:22.427876 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6e8540-33de-4793-bf54-a059f65d8344 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:22.429531 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-7c6e8540-33de-4793-bf54-a059f65d8344 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:22.511742 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6e8540-33de-4793-bf54-a059f65d8344 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:22.515008 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8416cc55-8faa-4639-bc9d-b32426be6b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:22.515805 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8416cc55-8faa-4639-bc9d-b32426be6b8d admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:22.516080 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8416cc55-8faa-4639-bc9d-b32426be6b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:22.516392 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8416cc55-8faa-4639-bc9d-b32426be6b8d admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:22.516992 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8416cc55-8faa-4639-bc9d-b32426be6b8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:22.517549 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ecb906-ab74-4cc6-8154-e1232537fccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:22.518198 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ecb906-ab74-4cc6-8154-e1232537fccb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:22.518476 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ecb906-ab74-4cc6-8154-e1232537fccb admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:22.518783 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ecb906-ab74-4cc6-8154-e1232537fccb admin admin] PATH_INFO: `/v3/users/daa662ab62a446e8bcb936853638eec2` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:22.518960 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8416cc55-8faa-4639-bc9d-b32426be6b8d admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:22.519924 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ecb906-ab74-4cc6-8154-e1232537fccb admin admin] RBAC: Authorizing `identity:delete_user(user_id=daa662ab62a446e8bcb936853638eec2)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:22.521903 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ecb906-ab74-4cc6-8154-e1232537fccb admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:22.544796 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 952/1902] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:25:22 2022] POST /identity/v3/users => generated 283 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 12:25:22.549005 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8416cc55-8faa-4639-bc9d-b32426be6b8d admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:22.555065 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:25:22.563804 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8416cc55-8faa-4639-bc9d-b32426be6b8d admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:22.569708 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2d695f-c912-4ef8-8a05-523a92f2f247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:22.571360 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2d695f-c912-4ef8-8a05-523a92f2f247 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:22.571360 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2d695f-c912-4ef8-8a05-523a92f2f247 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:22.571557 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2d695f-c912-4ef8-8a05-523a92f2f247 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:22.572816 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2d695f-c912-4ef8-8a05-523a92f2f247 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:22.573285 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:25:22.574193 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2d695f-c912-4ef8-8a05-523a92f2f247 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:22.582056 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-f3ecb906-ab74-4cc6-8154-e1232537fccb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'daa662ab62a446e8bcb936853638eec2'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:22.593216 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 953/1903] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:25:22 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 12:25:22.599887 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2d695f-c912-4ef8-8a05-523a92f2f247 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:22.600537 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-f3ecb906-ab74-4cc6-8154-e1232537fccb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'daa662ab62a446e8bcb936853638eec2'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:22.602479 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-f3ecb906-ab74-4cc6-8154-e1232537fccb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'daa662ab62a446e8bcb936853638eec2'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:22.603318 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-f3ecb906-ab74-4cc6-8154-e1232537fccb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'daa662ab62a446e8bcb936853638eec2'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:22.610935 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2d695f-c912-4ef8-8a05-523a92f2f247 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:22.612124 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-f3ecb906-ab74-4cc6-8154-e1232537fccb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'daa662ab62a446e8bcb936853638eec2'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:22.615943 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4b8e37-257d-4f01-a78d-94b028a93c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:22.616796 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b8e37-257d-4f01-a78d-94b028a93c6f admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:22.617395 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b8e37-257d-4f01-a78d-94b028a93c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:22.617586 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b8e37-257d-4f01-a78d-94b028a93c6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:22.618421 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4b8e37-257d-4f01-a78d-94b028a93c6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:22.620343 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4b8e37-257d-4f01-a78d-94b028a93c6f admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:22.635838 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 954/1904] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:25:22 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:25:22.640834 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4b8e37-257d-4f01-a78d-94b028a93c6f admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:22.643250 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-ba4b8e37-257d-4f01-a78d-94b028a93c6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:22.650189 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 951/1905] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:25:22 2022] DELETE /identity/v3/users/daa662ab62a446e8bcb936853638eec2 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:25:22.654709 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56620234-993f-4858-a154-8c1f31187263 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:22.655095 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56620234-993f-4858-a154-8c1f31187263 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:22.655439 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56620234-993f-4858-a154-8c1f31187263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:22.660520 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4b8e37-257d-4f01-a78d-94b028a93c6f admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:22.683811 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-56620234-993f-4858-a154-8c1f31187263 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:25:22.686242 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-56620234-993f-4858-a154-8c1f31187263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:22.741765 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d5fb51-eb0d-4b4b-81bb-6cef5927f896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:22.742595 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5fb51-eb0d-4b4b-81bb-6cef5927f896 admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:22.743041 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5fb51-eb0d-4b4b-81bb-6cef5927f896 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:22.743541 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5fb51-eb0d-4b4b-81bb-6cef5927f896 admin admin] PATH_INFO: `/v3/projects/3e2f36d9ae964c7eb3d0b4243f8b3e99/users/832f3de2e2ce40b3bad210bc8ca49954/roles/9371e5bbc55848949eb951a815f817f2` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:22.768908 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 952/1906] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:25:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:25:22.775914 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d5fb51-eb0d-4b4b-81bb-6cef5927f896 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e2f36d9ae964c7eb3d0b4243f8b3e99, user_id=832f3de2e2ce40b3bad210bc8ca49954, role_id=9371e5bbc55848949eb951a815f817f2)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:22.778932 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d5fb51-eb0d-4b4b-81bb-6cef5927f896 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:22.784698 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56620234-993f-4858-a154-8c1f31187263 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:22.786217 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-56620234-993f-4858-a154-8c1f31187263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:22.799492 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 955/1907] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:25:22 2022] PUT /identity/v3/projects/3e2f36d9ae964c7eb3d0b4243f8b3e99/users/832f3de2e2ce40b3bad210bc8ca49954/roles/9371e5bbc55848949eb951a815f817f2 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:25:22.809367 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3969bd0-d78a-4850-910a-8e7e497a028a None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:22.810189 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3969bd0-d78a-4850-910a-8e7e497a028a None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:22.810459 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3969bd0-d78a-4850-910a-8e7e497a028a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:22.847389 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-d3969bd0-d78a-4850-910a-8e7e497a028a None None] MFA Rules not processed for user `832f3de2e2ce40b3bad210bc8ca49954`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:25:22.848591 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-d3969bd0-d78a-4850-910a-8e7e497a028a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:22.868323 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56620234-993f-4858-a154-8c1f31187263 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:22.928018 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 956/1908] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:25:22 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:25:22.932584 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3969bd0-d78a-4850-910a-8e7e497a028a None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:22.932801 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e58d0e-cc29-426f-b7a6-d18bea32eaee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:22.933425 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e58d0e-cc29-426f-b7a6-d18bea32eaee service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:22.933698 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e58d0e-cc29-426f-b7a6-d18bea32eaee service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:22.933965 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e58d0e-cc29-426f-b7a6-d18bea32eaee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:22.975511 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:25:22.999982 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:25:23.017123 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3969bd0-d78a-4850-910a-8e7e497a028a None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:23.027486 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e58d0e-cc29-426f-b7a6-d18bea32eaee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:23.029224 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e58d0e-cc29-426f-b7a6-d18bea32eaee service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:23.032887 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4515946e-dc62-4677-8cd1-1d223ba39cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:23.033792 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4515946e-dc62-4677-8cd1-1d223ba39cd0 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:23.034240 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4515946e-dc62-4677-8cd1-1d223ba39cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:23.034714 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4515946e-dc62-4677-8cd1-1d223ba39cd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:23.035436 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4515946e-dc62-4677-8cd1-1d223ba39cd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:23.037482 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4515946e-dc62-4677-8cd1-1d223ba39cd0 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:23.041568 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 953/1909] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:25:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:25:23.067801 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 957/1910] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:25:22 2022] POST /identity/v3/projects => generated 363 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 12:25:23.071887 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e58d0e-cc29-426f-b7a6-d18bea32eaee service neutron] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:23.081650 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e58d0e-cc29-426f-b7a6-d18bea32eaee service neutron] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:23.144047 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da412fac-40f0-4389-a51a-b64a0b2d6f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:23.144665 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da412fac-40f0-4389-a51a-b64a0b2d6f66 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:23.144942 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da412fac-40f0-4389-a51a-b64a0b2d6f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:23.145209 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da412fac-40f0-4389-a51a-b64a0b2d6f66 admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:23.145851 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da412fac-40f0-4389-a51a-b64a0b2d6f66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:23.148008 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da412fac-40f0-4389-a51a-b64a0b2d6f66 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:23.169946 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 954/1911] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:25:23 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 12:25:23.173949 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4515946e-dc62-4677-8cd1-1d223ba39cd0 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:23.186363 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4515946e-dc62-4677-8cd1-1d223ba39cd0 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:23.192641 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507738aa-1f8f-4cbf-a041-a759b1e4fc56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:23.193262 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507738aa-1f8f-4cbf-a041-a759b1e4fc56 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:23.193535 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507738aa-1f8f-4cbf-a041-a759b1e4fc56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:23.193802 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507738aa-1f8f-4cbf-a041-a759b1e4fc56 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:23.194443 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507738aa-1f8f-4cbf-a041-a759b1e4fc56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:23.196622 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507738aa-1f8f-4cbf-a041-a759b1e4fc56 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:23.207678 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 958/1912] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:25:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:25:23.211676 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da412fac-40f0-4389-a51a-b64a0b2d6f66 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:23.221989 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da412fac-40f0-4389-a51a-b64a0b2d6f66 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:23.226762 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783ac3a7-18a6-42d4-85ff-b2e6f6fbbc5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:23.227422 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ac3a7-18a6-42d4-85ff-b2e6f6fbbc5f admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:23.227760 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ac3a7-18a6-42d4-85ff-b2e6f6fbbc5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:23.227974 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ac3a7-18a6-42d4-85ff-b2e6f6fbbc5f admin admin] PATH_INFO: `/v3/projects/f75ff5b0d14d4b9089ab36baff7a3111/users/d60a114dc93b4d2583d6c23246c27f31/roles/7f53f1c823b746529ba5057bf21b2477` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:23.243380 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783ac3a7-18a6-42d4-85ff-b2e6f6fbbc5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f75ff5b0d14d4b9089ab36baff7a3111, user_id=d60a114dc93b4d2583d6c23246c27f31, role_id=7f53f1c823b746529ba5057bf21b2477)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:23.246047 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783ac3a7-18a6-42d4-85ff-b2e6f6fbbc5f admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:23.260928 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 955/1913] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:25:23 2022] PUT /identity/v3/projects/f75ff5b0d14d4b9089ab36baff7a3111/users/d60a114dc93b4d2583d6c23246c27f31/roles/7f53f1c823b746529ba5057bf21b2477 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:25:23.265158 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507738aa-1f8f-4cbf-a041-a759b1e4fc56 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:23.275536 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507738aa-1f8f-4cbf-a041-a759b1e4fc56 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:23.316948 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783ac3a7-18a6-42d4-85ff-b2e6f6fbbc5f admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:23.319265 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-783ac3a7-18a6-42d4-85ff-b2e6f6fbbc5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:23.341553 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff86525e-2541-4c68-80d4-72834e2eebfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:23.341795 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff86525e-2541-4c68-80d4-72834e2eebfc admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:23.342070 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff86525e-2541-4c68-80d4-72834e2eebfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:23.342334 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff86525e-2541-4c68-80d4-72834e2eebfc admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:23.343056 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff86525e-2541-4c68-80d4-72834e2eebfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:23.344628 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff86525e-2541-4c68-80d4-72834e2eebfc admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:23.354680 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 959/1914] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:25:23 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:25:23.359788 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff86525e-2541-4c68-80d4-72834e2eebfc admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:23.370344 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff86525e-2541-4c68-80d4-72834e2eebfc admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:23.375182 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c4457d-b962-41fd-82c2-0867edc614ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:23.375829 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c4457d-b962-41fd-82c2-0867edc614ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:23.376105 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c4457d-b962-41fd-82c2-0867edc614ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:23.376372 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c4457d-b962-41fd-82c2-0867edc614ac admin admin] PATH_INFO: `/v3/projects/f75ff5b0d14d4b9089ab36baff7a3111/users/d60a114dc93b4d2583d6c23246c27f31/roles/7f53f1c823b746529ba5057bf21b2477` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:23.378797 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c4457d-b962-41fd-82c2-0867edc614ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=f75ff5b0d14d4b9089ab36baff7a3111, user_id=d60a114dc93b4d2583d6c23246c27f31, role_id=7f53f1c823b746529ba5057bf21b2477)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:23.381563 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c4457d-b962-41fd-82c2-0867edc614ac admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:23.391988 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783ac3a7-18a6-42d4-85ff-b2e6f6fbbc5f admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:23.392525 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 960/1915] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:25:23 2022] PUT /identity/v3/projects/f75ff5b0d14d4b9089ab36baff7a3111/users/d60a114dc93b4d2583d6c23246c27f31/roles/7f53f1c823b746529ba5057bf21b2477 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:25:23.403871 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440760df-5edd-4373-8a52-5cb7826c149b None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:23.404462 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440760df-5edd-4373-8a52-5cb7826c149b None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:23.404462 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440760df-5edd-4373-8a52-5cb7826c149b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:23.426601 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:25:23.447985 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-440760df-5edd-4373-8a52-5cb7826c149b None None] MFA Rules not processed for user `d60a114dc93b4d2583d6c23246c27f31`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:25:23.451169 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-440760df-5edd-4373-8a52-5cb7826c149b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:23.460617 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b419d2a1-034c-4bd9-928b-310897637196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:23.461351 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419d2a1-034c-4bd9-928b-310897637196 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:23.461701 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419d2a1-034c-4bd9-928b-310897637196 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:23.462055 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419d2a1-034c-4bd9-928b-310897637196 admin admin] PATH_INFO: `/v3/projects/2f63a02d069e49a3a91923671e318358` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:23.463303 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b419d2a1-034c-4bd9-928b-310897637196 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f63a02d069e49a3a91923671e318358)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:23.465454 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b419d2a1-034c-4bd9-928b-310897637196 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:23.520612 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-b419d2a1-034c-4bd9-928b-310897637196 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f63a02d069e49a3a91923671e318358', 'request_id': 'req-b419d2a1-034c-4bd9-928b-310897637196'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:23.527542 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-b419d2a1-034c-4bd9-928b-310897637196 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f63a02d069e49a3a91923671e318358', 'request_id': 'req-b419d2a1-034c-4bd9-928b-310897637196'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:23.537673 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-b419d2a1-034c-4bd9-928b-310897637196 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f63a02d069e49a3a91923671e318358', 'request_id': 'req-b419d2a1-034c-4bd9-928b-310897637196'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:23.545061 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 961/1916] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:25:23 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:25:23.555022 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-b419d2a1-034c-4bd9-928b-310897637196 admin admin] The token cache is being invalidate because project 2f63a02d069e49a3a91923671e318358 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:25:23.555499 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-b419d2a1-034c-4bd9-928b-310897637196 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:23.556173 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-b419d2a1-034c-4bd9-928b-310897637196 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:23.556851 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440760df-5edd-4373-8a52-5cb7826c149b None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:23.557854 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 956/1917] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:25:23 2022] DELETE /identity/v3/projects/2f63a02d069e49a3a91923671e318358 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:25:23.558334 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-440760df-5edd-4373-8a52-5cb7826c149b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:23.562280 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd1ddd-4c56-4a30-8fa3-caa5ec6b92f0 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:23.562635 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd1ddd-4c56-4a30-8fa3-caa5ec6b92f0 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:23.562871 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd1ddd-4c56-4a30-8fa3-caa5ec6b92f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:23.583488 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-0dbd1ddd-4c56-4a30-8fa3-caa5ec6b92f0 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:25:23.584763 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-0dbd1ddd-4c56-4a30-8fa3-caa5ec6b92f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:23.604808 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:25:23.632727 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440760df-5edd-4373-8a52-5cb7826c149b None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:23.666535 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 957/1918] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:25:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:25:23.674997 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610407e-f7d1-4f7f-9198-1ecfe04976a1 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:23.675279 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610407e-f7d1-4f7f-9198-1ecfe04976a1 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:23.675576 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610407e-f7d1-4f7f-9198-1ecfe04976a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:23.697855 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce084ab7-e764-4c1b-9ac1-8bf5af6c17e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceafc5e4283841528053f01931f10293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:23.698647 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce084ab7-e764-4c1b-9ac1-8bf5af6c17e0 service cinder] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:23.699015 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce084ab7-e764-4c1b-9ac1-8bf5af6c17e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:23.699287 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce084ab7-e764-4c1b-9ac1-8bf5af6c17e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:23.701685 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-ce084ab7-e764-4c1b-9ac1-8bf5af6c17e0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:23.703507 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-c610407e-f7d1-4f7f-9198-1ecfe04976a1 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:25:23.704949 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-c610407e-f7d1-4f7f-9198-1ecfe04976a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:23.726427 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 958/1919] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:25:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:25:23.730569 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c610407e-f7d1-4f7f-9198-1ecfe04976a1 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:23.743207 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c610407e-f7d1-4f7f-9198-1ecfe04976a1 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:23.752509 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf6f068-8ab7-485c-a25b-c0868b7d14c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:23.758355 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf6f068-8ab7-485c-a25b-c0868b7d14c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:23.758949 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf6f068-8ab7-485c-a25b-c0868b7d14c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:23.759321 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf6f068-8ab7-485c-a25b-c0868b7d14c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:23.760626 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf6f068-8ab7-485c-a25b-c0868b7d14c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:25:23.760779 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf6f068-8ab7-485c-a25b-c0868b7d14c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:23.763111 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf6f068-8ab7-485c-a25b-c0868b7d14c7 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:23.799389 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 959/1920] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 15 12:25:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:25:23.803768 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf6f068-8ab7-485c-a25b-c0868b7d14c7 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:23.830796 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf6f068-8ab7-485c-a25b-c0868b7d14c7 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:23.847683 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee73cd0d-6ff4-4b7a-8fd0-3a56fa177571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:23.848607 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee73cd0d-6ff4-4b7a-8fd0-3a56fa177571 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:23.848873 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee73cd0d-6ff4-4b7a-8fd0-3a56fa177571 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:23.849141 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee73cd0d-6ff4-4b7a-8fd0-3a56fa177571 admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:23.849786 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee73cd0d-6ff4-4b7a-8fd0-3a56fa177571 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:23.851905 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee73cd0d-6ff4-4b7a-8fd0-3a56fa177571 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:23.862075 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce084ab7-e764-4c1b-9ac1-8bf5af6c17e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:23.867184 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce084ab7-e764-4c1b-9ac1-8bf5af6c17e0 service cinder] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:23.891392 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 960/1922] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:25:23 2022] POST /identity/v3/projects => generated 375 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:25:23.894407 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 962/1922] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:25:23 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 12:25:23.895452 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee73cd0d-6ff4-4b7a-8fd0-3a56fa177571 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:23.963966 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:25:24.035415 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce084ab7-e764-4c1b-9ac1-8bf5af6c17e0 service cinder] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:24.036961 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-ce084ab7-e764-4c1b-9ac1-8bf5af6c17e0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:24.060879 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee73cd0d-6ff4-4b7a-8fd0-3a56fa177571 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:24.064454 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce084ab7-e764-4c1b-9ac1-8bf5af6c17e0 service cinder] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:24.068748 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ab83e-2655-448b-b57e-ad5d919fb849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:24.069787 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ab83e-2655-448b-b57e-ad5d919fb849 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:24.071087 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ab83e-2655-448b-b57e-ad5d919fb849 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:24.071892 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ab83e-2655-448b-b57e-ad5d919fb849 admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:24.073373 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410ab83e-2655-448b-b57e-ad5d919fb849 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:24.076091 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410ab83e-2655-448b-b57e-ad5d919fb849 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:24.114426 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 961/1923] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:25:23 2022] POST /identity/v3/users => generated 288 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 12:25:24.119160 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ab83e-2655-448b-b57e-ad5d919fb849 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:24.137426 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ab83e-2655-448b-b57e-ad5d919fb849 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:24.144260 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de699ddd-fe88-495c-ab46-576ea13d0f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:24.145014 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de699ddd-fe88-495c-ab46-576ea13d0f47 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:24.145366 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de699ddd-fe88-495c-ab46-576ea13d0f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:24.145768 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de699ddd-fe88-495c-ab46-576ea13d0f47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:24.146532 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de699ddd-fe88-495c-ab46-576ea13d0f47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:24.149139 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de699ddd-fe88-495c-ab46-576ea13d0f47 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:24.165672 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 962/1924] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:25:24 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:25:24.171513 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de699ddd-fe88-495c-ab46-576ea13d0f47 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:24.181203 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dacd6c5-0446-4590-9507-5976cba201a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceafc5e4283841528053f01931f10293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:24.182304 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dacd6c5-0446-4590-9507-5976cba201a8 service cinder] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:24.182304 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dacd6c5-0446-4590-9507-5976cba201a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:24.182471 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dacd6c5-0446-4590-9507-5976cba201a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:24.208589 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-0dacd6c5-0446-4590-9507-5976cba201a8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:24.220834 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de699ddd-fe88-495c-ab46-576ea13d0f47 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:24.240194 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891d081c-1a2a-4335-aa02-e20c79895d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:24.240194 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d081c-1a2a-4335-aa02-e20c79895d0b admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:24.240194 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d081c-1a2a-4335-aa02-e20c79895d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:24.240194 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d081c-1a2a-4335-aa02-e20c79895d0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:24.240657 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891d081c-1a2a-4335-aa02-e20c79895d0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:24.240657 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891d081c-1a2a-4335-aa02-e20c79895d0b admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:24.263665 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 963/1925] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:25:24 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:25:24.268520 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891d081c-1a2a-4335-aa02-e20c79895d0b admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:24.290857 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891d081c-1a2a-4335-aa02-e20c79895d0b admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:24.305396 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4540afc7-913a-4239-8980-f77100b9073b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:24.306170 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4540afc7-913a-4239-8980-f77100b9073b admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:24.308694 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4540afc7-913a-4239-8980-f77100b9073b admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:24.309631 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4540afc7-913a-4239-8980-f77100b9073b admin admin] PATH_INFO: `/v3/projects/590f42f1340f4615b98be12b16895854/users/9f93bbd8ebba4aac9cafe925369601e0/roles/9371e5bbc55848949eb951a815f817f2` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:24.333109 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4540afc7-913a-4239-8980-f77100b9073b admin admin] RBAC: Authorizing `identity:create_grant(project_id=590f42f1340f4615b98be12b16895854, user_id=9f93bbd8ebba4aac9cafe925369601e0, role_id=9371e5bbc55848949eb951a815f817f2)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:24.336412 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4540afc7-913a-4239-8980-f77100b9073b admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:24.345235 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:25:24.349282 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dacd6c5-0446-4590-9507-5976cba201a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:24.352739 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dacd6c5-0446-4590-9507-5976cba201a8 service cinder] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:24.364637 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 964/1926] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:25:24 2022] PUT /identity/v3/projects/590f42f1340f4615b98be12b16895854/users/9f93bbd8ebba4aac9cafe925369601e0/roles/9371e5bbc55848949eb951a815f817f2 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:25:24.375334 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 963/1927] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:25:24 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:25:24.375914 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f717673f-024e-445c-b38a-ac8879a065f3 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:24.376272 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f717673f-024e-445c-b38a-ac8879a065f3 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:24.376789 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f717673f-024e-445c-b38a-ac8879a065f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:24.411981 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-f717673f-024e-445c-b38a-ac8879a065f3 None None] MFA Rules not processed for user `9f93bbd8ebba4aac9cafe925369601e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:25:24.413406 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-f717673f-024e-445c-b38a-ac8879a065f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:24.540648 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 965/1928] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:25:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:25:24.552897 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dacd6c5-0446-4590-9507-5976cba201a8 service cinder] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:24.563255 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dacd6c5-0446-4590-9507-5976cba201a8 service cinder] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:24.628294 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cdf6ab-79f3-417b-ab5e-f2fcca9b3aa1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceafc5e4283841528053f01931f10293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:24.629759 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cdf6ab-79f3-417b-ab5e-f2fcca9b3aa1 service cinder] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:24.630224 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cdf6ab-79f3-417b-ab5e-f2fcca9b3aa1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:24.630652 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cdf6ab-79f3-417b-ab5e-f2fcca9b3aa1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:24.643831 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cdf6ab-79f3-417b-ab5e-f2fcca9b3aa1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:24.645541 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cdf6ab-79f3-417b-ab5e-f2fcca9b3aa1 service cinder] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:24.656754 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 964/1929] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:25:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:25:27.843103 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f717673f-024e-445c-b38a-ac8879a065f3 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:27.948382 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f717673f-024e-445c-b38a-ac8879a065f3 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:27.953622 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68aa163-7c6e-48c9-9283-8aa1263dbfc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:27.954278 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68aa163-7c6e-48c9-9283-8aa1263dbfc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:27.954563 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68aa163-7c6e-48c9-9283-8aa1263dbfc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:27.954937 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68aa163-7c6e-48c9-9283-8aa1263dbfc9 admin admin] PATH_INFO: `/v3/users/9f93bbd8ebba4aac9cafe925369601e0` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:27.956406 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68aa163-7c6e-48c9-9283-8aa1263dbfc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f93bbd8ebba4aac9cafe925369601e0)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:27.958505 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68aa163-7c6e-48c9-9283-8aa1263dbfc9 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:27.960346 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:25:28.030943 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-e68aa163-7c6e-48c9-9283-8aa1263dbfc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f93bbd8ebba4aac9cafe925369601e0'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:28.038873 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-e68aa163-7c6e-48c9-9283-8aa1263dbfc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f93bbd8ebba4aac9cafe925369601e0'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:28.039608 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-e68aa163-7c6e-48c9-9283-8aa1263dbfc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f93bbd8ebba4aac9cafe925369601e0'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:28.040297 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-e68aa163-7c6e-48c9-9283-8aa1263dbfc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f93bbd8ebba4aac9cafe925369601e0'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:28.048876 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-e68aa163-7c6e-48c9-9283-8aa1263dbfc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f93bbd8ebba4aac9cafe925369601e0'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:28.084886 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 966/1930] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:25:27 2022] DELETE /identity/v3/users/9f93bbd8ebba4aac9cafe925369601e0 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:25:28.089363 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d129f0-c9a4-45b7-82d5-a066d08f62f2 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:28.089804 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d129f0-c9a4-45b7-82d5-a066d08f62f2 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:28.089962 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d129f0-c9a4-45b7-82d5-a066d08f62f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:28.110153 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-73d129f0-c9a4-45b7-82d5-a066d08f62f2 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:25:28.112364 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-73d129f0-c9a4-45b7-82d5-a066d08f62f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:28.173741 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 965/1931] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:25:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:25:28.183682 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68aa163-7c6e-48c9-9283-8aa1263dbfc9 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:28.185800 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-e68aa163-7c6e-48c9-9283-8aa1263dbfc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:28.249349 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68aa163-7c6e-48c9-9283-8aa1263dbfc9 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:28.253185 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a723ec74-cb89-467a-a7da-acf3b95a3eea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:28.253794 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a723ec74-cb89-467a-a7da-acf3b95a3eea service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:28.254074 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a723ec74-cb89-467a-a7da-acf3b95a3eea service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:28.254347 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a723ec74-cb89-467a-a7da-acf3b95a3eea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:28.263359 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a723ec74-cb89-467a-a7da-acf3b95a3eea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:28.264822 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a723ec74-cb89-467a-a7da-acf3b95a3eea service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:28.274811 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 967/1932] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:25:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:25:28.534411 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d129f0-c9a4-45b7-82d5-a066d08f62f2 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:28.536108 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-73d129f0-c9a4-45b7-82d5-a066d08f62f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:28.559168 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d129f0-c9a4-45b7-82d5-a066d08f62f2 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:28.565150 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ffe5ba-aedb-4b44-9f4f-a81273ebace2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:28.565781 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ffe5ba-aedb-4b44-9f4f-a81273ebace2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:28.566062 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ffe5ba-aedb-4b44-9f4f-a81273ebace2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:28.566367 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ffe5ba-aedb-4b44-9f4f-a81273ebace2 admin admin] PATH_INFO: `/v3/projects/590f42f1340f4615b98be12b16895854` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:28.567626 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ffe5ba-aedb-4b44-9f4f-a81273ebace2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=590f42f1340f4615b98be12b16895854)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:28.570074 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ffe5ba-aedb-4b44-9f4f-a81273ebace2 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:28.627437 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-69ffe5ba-aedb-4b44-9f4f-a81273ebace2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '590f42f1340f4615b98be12b16895854', 'request_id': 'req-69ffe5ba-aedb-4b44-9f4f-a81273ebace2'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:28.634023 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-69ffe5ba-aedb-4b44-9f4f-a81273ebace2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '590f42f1340f4615b98be12b16895854', 'request_id': 'req-69ffe5ba-aedb-4b44-9f4f-a81273ebace2'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:28.639842 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-69ffe5ba-aedb-4b44-9f4f-a81273ebace2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '590f42f1340f4615b98be12b16895854', 'request_id': 'req-69ffe5ba-aedb-4b44-9f4f-a81273ebace2'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:28.652545 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-69ffe5ba-aedb-4b44-9f4f-a81273ebace2 admin admin] The token cache is being invalidate because project 590f42f1340f4615b98be12b16895854 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:25:28.652843 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-69ffe5ba-aedb-4b44-9f4f-a81273ebace2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:28.654007 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-69ffe5ba-aedb-4b44-9f4f-a81273ebace2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:28.655740 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 966/1933] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:25:28 2022] DELETE /identity/v3/projects/590f42f1340f4615b98be12b16895854 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:25:31.596562 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a723ec74-cb89-467a-a7da-acf3b95a3eea service neutron] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:31.598119 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-a723ec74-cb89-467a-a7da-acf3b95a3eea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:31.611117 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a723ec74-cb89-467a-a7da-acf3b95a3eea service neutron] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:31.666999 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ad6b3f-9f2f-4185-8557-ae870ea3efd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:31.667635 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad6b3f-9f2f-4185-8557-ae870ea3efd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:31.667912 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad6b3f-9f2f-4185-8557-ae870ea3efd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:31.668185 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad6b3f-9f2f-4185-8557-ae870ea3efd4 admin admin] PATH_INFO: `/v3/users/832f3de2e2ce40b3bad210bc8ca49954` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:31.669324 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ad6b3f-9f2f-4185-8557-ae870ea3efd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=832f3de2e2ce40b3bad210bc8ca49954)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:31.671291 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ad6b3f-9f2f-4185-8557-ae870ea3efd4 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:31.694427 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:25:31.723155 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-19ad6b3f-9f2f-4185-8557-ae870ea3efd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '832f3de2e2ce40b3bad210bc8ca49954'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:31.732297 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-19ad6b3f-9f2f-4185-8557-ae870ea3efd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '832f3de2e2ce40b3bad210bc8ca49954'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:31.732898 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-19ad6b3f-9f2f-4185-8557-ae870ea3efd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '832f3de2e2ce40b3bad210bc8ca49954'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:31.733633 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-19ad6b3f-9f2f-4185-8557-ae870ea3efd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '832f3de2e2ce40b3bad210bc8ca49954'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:31.741198 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-19ad6b3f-9f2f-4185-8557-ae870ea3efd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '832f3de2e2ce40b3bad210bc8ca49954'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:31.763108 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 968/1934] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:25:31 2022] DELETE /identity/v3/users/832f3de2e2ce40b3bad210bc8ca49954 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:25:31.764571 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70857ab-8c42-4fc1-b952-aab21d3eb76d None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:31.765036 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70857ab-8c42-4fc1-b952-aab21d3eb76d None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:31.765253 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70857ab-8c42-4fc1-b952-aab21d3eb76d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:31.787364 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-c70857ab-8c42-4fc1-b952-aab21d3eb76d None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:25:31.789089 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-c70857ab-8c42-4fc1-b952-aab21d3eb76d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:31.809068 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:25:31.895936 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 967/1935] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:25:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:25:31.903399 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ad6b3f-9f2f-4185-8557-ae870ea3efd4 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:31.905247 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-19ad6b3f-9f2f-4185-8557-ae870ea3efd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:31.971736 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ad6b3f-9f2f-4185-8557-ae870ea3efd4 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:31.976492 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adc76dd-6a93-44a0-884f-dd76f59f359a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:31.977161 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adc76dd-6a93-44a0-884f-dd76f59f359a service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:31.977446 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adc76dd-6a93-44a0-884f-dd76f59f359a service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:31.977720 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adc76dd-6a93-44a0-884f-dd76f59f359a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:31.989567 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adc76dd-6a93-44a0-884f-dd76f59f359a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:31.990989 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adc76dd-6a93-44a0-884f-dd76f59f359a service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:32.003782 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 969/1936] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:25:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:25:32.285166 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70857ab-8c42-4fc1-b952-aab21d3eb76d None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:32.286903 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-c70857ab-8c42-4fc1-b952-aab21d3eb76d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:32.300791 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70857ab-8c42-4fc1-b952-aab21d3eb76d None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:32.306283 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e1671a-6bad-4fe8-9e55-fd0b76e388e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:32.307085 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e1671a-6bad-4fe8-9e55-fd0b76e388e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:32.308017 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e1671a-6bad-4fe8-9e55-fd0b76e388e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:32.308399 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e1671a-6bad-4fe8-9e55-fd0b76e388e3 admin admin] PATH_INFO: `/v3/projects/3e2f36d9ae964c7eb3d0b4243f8b3e99` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:32.310175 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e1671a-6bad-4fe8-9e55-fd0b76e388e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e2f36d9ae964c7eb3d0b4243f8b3e99)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:32.312508 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e1671a-6bad-4fe8-9e55-fd0b76e388e3 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:32.364589 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-19e1671a-6bad-4fe8-9e55-fd0b76e388e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e2f36d9ae964c7eb3d0b4243f8b3e99', 'request_id': 'req-19e1671a-6bad-4fe8-9e55-fd0b76e388e3'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:32.371136 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-19e1671a-6bad-4fe8-9e55-fd0b76e388e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e2f36d9ae964c7eb3d0b4243f8b3e99', 'request_id': 'req-19e1671a-6bad-4fe8-9e55-fd0b76e388e3'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:32.377903 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-19e1671a-6bad-4fe8-9e55-fd0b76e388e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e2f36d9ae964c7eb3d0b4243f8b3e99', 'request_id': 'req-19e1671a-6bad-4fe8-9e55-fd0b76e388e3'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:32.390451 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-19e1671a-6bad-4fe8-9e55-fd0b76e388e3 admin admin] The token cache is being invalidate because project 3e2f36d9ae964c7eb3d0b4243f8b3e99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:25:32.390787 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-19e1671a-6bad-4fe8-9e55-fd0b76e388e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:32.391413 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-19e1671a-6bad-4fe8-9e55-fd0b76e388e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:32.393010 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 968/1937] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:25:32 2022] DELETE /identity/v3/projects/3e2f36d9ae964c7eb3d0b4243f8b3e99 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:25:32.397136 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adc76dd-6a93-44a0-884f-dd76f59f359a service neutron] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:32.407649 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adc76dd-6a93-44a0-884f-dd76f59f359a service neutron] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:32.464917 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55437762-5b5c-4ff2-9024-07f212ed4182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:32.466089 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55437762-5b5c-4ff2-9024-07f212ed4182 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:32.466366 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55437762-5b5c-4ff2-9024-07f212ed4182 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:32.466631 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55437762-5b5c-4ff2-9024-07f212ed4182 admin admin] PATH_INFO: `/v3/users/d60a114dc93b4d2583d6c23246c27f31` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:32.467799 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55437762-5b5c-4ff2-9024-07f212ed4182 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d60a114dc93b4d2583d6c23246c27f31)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:32.469710 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55437762-5b5c-4ff2-9024-07f212ed4182 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:32.522749 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:25:32.524629 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-55437762-5b5c-4ff2-9024-07f212ed4182 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd60a114dc93b4d2583d6c23246c27f31'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:32.537429 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-55437762-5b5c-4ff2-9024-07f212ed4182 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd60a114dc93b4d2583d6c23246c27f31'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:32.538262 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-55437762-5b5c-4ff2-9024-07f212ed4182 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd60a114dc93b4d2583d6c23246c27f31'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:32.539303 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-55437762-5b5c-4ff2-9024-07f212ed4182 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd60a114dc93b4d2583d6c23246c27f31'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:32.548745 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-55437762-5b5c-4ff2-9024-07f212ed4182 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd60a114dc93b4d2583d6c23246c27f31'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:32.569702 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 970/1938] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:25:32 2022] DELETE /identity/v3/users/d60a114dc93b4d2583d6c23246c27f31 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:25:32.995472 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e1671a-6bad-4fe8-9e55-fd0b76e388e3 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:32.998453 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-19e1671a-6bad-4fe8-9e55-fd0b76e388e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:33.016679 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e1671a-6bad-4fe8-9e55-fd0b76e388e3 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:33.077722 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d629214-b102-4c9a-91d8-c80e686a77d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:33.078249 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d629214-b102-4c9a-91d8-c80e686a77d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:33.078709 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d629214-b102-4c9a-91d8-c80e686a77d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:33.078857 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d629214-b102-4c9a-91d8-c80e686a77d5 admin admin] PATH_INFO: `/v3/projects/f75ff5b0d14d4b9089ab36baff7a3111` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:33.079957 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d629214-b102-4c9a-91d8-c80e686a77d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f75ff5b0d14d4b9089ab36baff7a3111)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:33.082080 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d629214-b102-4c9a-91d8-c80e686a77d5 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:33.127988 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:25:33.129363 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-7d629214-b102-4c9a-91d8-c80e686a77d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f75ff5b0d14d4b9089ab36baff7a3111', 'request_id': 'req-7d629214-b102-4c9a-91d8-c80e686a77d5'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:33.137760 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-7d629214-b102-4c9a-91d8-c80e686a77d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f75ff5b0d14d4b9089ab36baff7a3111', 'request_id': 'req-7d629214-b102-4c9a-91d8-c80e686a77d5'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:33.143939 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-7d629214-b102-4c9a-91d8-c80e686a77d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f75ff5b0d14d4b9089ab36baff7a3111', 'request_id': 'req-7d629214-b102-4c9a-91d8-c80e686a77d5'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:33.158092 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-7d629214-b102-4c9a-91d8-c80e686a77d5 admin admin] The token cache is being invalidate because project f75ff5b0d14d4b9089ab36baff7a3111 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:25:33.158379 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-7d629214-b102-4c9a-91d8-c80e686a77d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:33.159129 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-7d629214-b102-4c9a-91d8-c80e686a77d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:33.162924 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 969/1939] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:25:32 2022] DELETE /identity/v3/projects/f75ff5b0d14d4b9089ab36baff7a3111 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:25:33.165470 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f812996-7091-47ae-814b-6eafaac5cca9 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:33.165960 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f812996-7091-47ae-814b-6eafaac5cca9 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:33.166088 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f812996-7091-47ae-814b-6eafaac5cca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:33.186407 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-2f812996-7091-47ae-814b-6eafaac5cca9 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:25:33.189408 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-2f812996-7091-47ae-814b-6eafaac5cca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:33.255704 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 971/1940] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:25:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:25:33.263868 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc5cb9c-a07d-4e9e-9d55-7a91a7f9aa55 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:33.264158 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc5cb9c-a07d-4e9e-9d55-7a91a7f9aa55 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:33.264455 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc5cb9c-a07d-4e9e-9d55-7a91a7f9aa55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:33.285601 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-fbc5cb9c-a07d-4e9e-9d55-7a91a7f9aa55 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:25:33.286864 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-fbc5cb9c-a07d-4e9e-9d55-7a91a7f9aa55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:33.295761 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 970/1941] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:25:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:25:33.300144 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f812996-7091-47ae-814b-6eafaac5cca9 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:33.318975 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f812996-7091-47ae-814b-6eafaac5cca9 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:33.324637 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b4233-70ec-4f94-8db3-20e7ff22e511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:33.326042 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b4233-70ec-4f94-8db3-20e7ff22e511 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:33.326340 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b4233-70ec-4f94-8db3-20e7ff22e511 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:33.326675 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b4233-70ec-4f94-8db3-20e7ff22e511 admin admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:33.327275 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3b4233-70ec-4f94-8db3-20e7ff22e511 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:25:33.327564 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3b4233-70ec-4f94-8db3-20e7ff22e511 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:33.329998 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3b4233-70ec-4f94-8db3-20e7ff22e511 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:33.343141 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 972/1942] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 15 12:25:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:25:33.348077 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc5cb9c-a07d-4e9e-9d55-7a91a7f9aa55 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:33.357763 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc5cb9c-a07d-4e9e-9d55-7a91a7f9aa55 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:33.362486 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0312810-d328-4094-ad0c-d252647a1f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:33.363125 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0312810-d328-4094-ad0c-d252647a1f9f admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:33.363408 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0312810-d328-4094-ad0c-d252647a1f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:33.363681 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0312810-d328-4094-ad0c-d252647a1f9f admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:33.364324 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0312810-d328-4094-ad0c-d252647a1f9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:33.366236 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0312810-d328-4094-ad0c-d252647a1f9f admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:33.403471 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 971/1943] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:25:33 2022] POST /identity/v3/projects => generated 367 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:25:33.405119 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b4233-70ec-4f94-8db3-20e7ff22e511 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:33.417259 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b4233-70ec-4f94-8db3-20e7ff22e511 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:33.500035 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277ff09d-65be-4398-8bab-0eaa7af94670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:33.500908 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277ff09d-65be-4398-8bab-0eaa7af94670 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:33.501338 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277ff09d-65be-4398-8bab-0eaa7af94670 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:33.502009 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277ff09d-65be-4398-8bab-0eaa7af94670 admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:33.502861 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277ff09d-65be-4398-8bab-0eaa7af94670 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:33.504962 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277ff09d-65be-4398-8bab-0eaa7af94670 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:33.544686 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 973/1944] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:25:33 2022] POST /identity/v3/users => generated 284 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:25:33.549822 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0312810-d328-4094-ad0c-d252647a1f9f admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:33.564065 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0312810-d328-4094-ad0c-d252647a1f9f admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:33.581336 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0681a6-f6c8-41d7-a11e-71263411ff18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:33.582334 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0681a6-f6c8-41d7-a11e-71263411ff18 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:33.582625 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0681a6-f6c8-41d7-a11e-71263411ff18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:33.582950 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0681a6-f6c8-41d7-a11e-71263411ff18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:33.583613 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0681a6-f6c8-41d7-a11e-71263411ff18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:33.585853 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0681a6-f6c8-41d7-a11e-71263411ff18 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:33.603869 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277ff09d-65be-4398-8bab-0eaa7af94670 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:33.611930 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 972/1945] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:25:33 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:25:33.619671 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277ff09d-65be-4398-8bab-0eaa7af94670 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:33.635655 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f780f7-3963-4984-8a67-e9239bc87fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:33.638176 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f780f7-3963-4984-8a67-e9239bc87fbe admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:33.638482 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f780f7-3963-4984-8a67-e9239bc87fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:33.638744 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f780f7-3963-4984-8a67-e9239bc87fbe admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:33.639406 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f780f7-3963-4984-8a67-e9239bc87fbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:33.641039 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f780f7-3963-4984-8a67-e9239bc87fbe admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:33.670475 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 974/1946] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:25:33 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:25:33.675116 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0681a6-f6c8-41d7-a11e-71263411ff18 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:33.699308 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0681a6-f6c8-41d7-a11e-71263411ff18 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:33.705505 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e4ce32-3643-4669-8a82-57c0fc13b7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:33.706372 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e4ce32-3643-4669-8a82-57c0fc13b7f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:33.706905 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e4ce32-3643-4669-8a82-57c0fc13b7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:33.707200 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e4ce32-3643-4669-8a82-57c0fc13b7f4 admin admin] PATH_INFO: `/v3/projects/9710118e79b54fea8b3b513d8cecf173/users/693337a653e84faebf6b5080695d1180/roles/9371e5bbc55848949eb951a815f817f2` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:33.731950 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e4ce32-3643-4669-8a82-57c0fc13b7f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9710118e79b54fea8b3b513d8cecf173, user_id=693337a653e84faebf6b5080695d1180, role_id=9371e5bbc55848949eb951a815f817f2)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:33.735785 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e4ce32-3643-4669-8a82-57c0fc13b7f4 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:33.766007 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 973/1947] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:25:33 2022] PUT /identity/v3/projects/9710118e79b54fea8b3b513d8cecf173/users/693337a653e84faebf6b5080695d1180/roles/9371e5bbc55848949eb951a815f817f2 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:25:33.776606 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbfc844-5ab4-48ba-8e70-6ce730e1bace None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:33.776890 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbfc844-5ab4-48ba-8e70-6ce730e1bace None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:33.777191 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbfc844-5ab4-48ba-8e70-6ce730e1bace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:33.824618 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-2fbfc844-5ab4-48ba-8e70-6ce730e1bace None None] MFA Rules not processed for user `693337a653e84faebf6b5080695d1180`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:25:33.826898 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-2fbfc844-5ab4-48ba-8e70-6ce730e1bace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:33.848533 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:25:33.907620 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 975/1948] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:25:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:25:33.911877 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e4ce32-3643-4669-8a82-57c0fc13b7f4 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:34.005334 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e4ce32-3643-4669-8a82-57c0fc13b7f4 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:34.011868 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4effc54-b5f1-4095-88dd-837b23928635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:34.012916 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4effc54-b5f1-4095-88dd-837b23928635 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:34.013374 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4effc54-b5f1-4095-88dd-837b23928635 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:34.013917 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4effc54-b5f1-4095-88dd-837b23928635 admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:34.014780 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4effc54-b5f1-4095-88dd-837b23928635 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:34.017714 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4effc54-b5f1-4095-88dd-837b23928635 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:34.068007 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 974/1949] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:25:33 2022] POST /identity/v3/projects => generated 369 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:25:34.072341 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbfc844-5ab4-48ba-8e70-6ce730e1bace None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:34.088539 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbfc844-5ab4-48ba-8e70-6ce730e1bace None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:34.196407 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba47290-3e2e-4176-963b-6b1bbd637c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:34.197078 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba47290-3e2e-4176-963b-6b1bbd637c98 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:34.197392 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba47290-3e2e-4176-963b-6b1bbd637c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:34.197638 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba47290-3e2e-4176-963b-6b1bbd637c98 admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:34.201707 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba47290-3e2e-4176-963b-6b1bbd637c98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:34.203837 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba47290-3e2e-4176-963b-6b1bbd637c98 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:34.252204 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 976/1950] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:25:34 2022] POST /identity/v3/users => generated 291 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:25:34.253016 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4effc54-b5f1-4095-88dd-837b23928635 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:34.267345 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4effc54-b5f1-4095-88dd-837b23928635 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:34.274785 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18b0bf8-c88c-4450-aa76-91d82b7e5722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:34.275786 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b0bf8-c88c-4450-aa76-91d82b7e5722 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:34.276417 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b0bf8-c88c-4450-aa76-91d82b7e5722 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:34.276919 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b0bf8-c88c-4450-aa76-91d82b7e5722 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:34.277752 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18b0bf8-c88c-4450-aa76-91d82b7e5722 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:34.280142 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18b0bf8-c88c-4450-aa76-91d82b7e5722 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:34.306998 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 975/1951] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:25:34 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 12:25:34.308326 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba47290-3e2e-4176-963b-6b1bbd637c98 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:34.326990 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba47290-3e2e-4176-963b-6b1bbd637c98 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:34.333991 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35e4509-664d-40bf-bd85-de89890ac201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:34.334771 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e4509-664d-40bf-bd85-de89890ac201 admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:34.335125 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e4509-664d-40bf-bd85-de89890ac201 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:34.335528 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e4509-664d-40bf-bd85-de89890ac201 admin admin] PATH_INFO: `/v3/projects/109c56050b784fdab5b1f059a348ad95/users/737647813e394606a9faa68660af6c6f/roles/7f53f1c823b746529ba5057bf21b2477` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:34.354409 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35e4509-664d-40bf-bd85-de89890ac201 admin admin] RBAC: Authorizing `identity:create_grant(project_id=109c56050b784fdab5b1f059a348ad95, user_id=737647813e394606a9faa68660af6c6f, role_id=7f53f1c823b746529ba5057bf21b2477)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:34.357217 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35e4509-664d-40bf-bd85-de89890ac201 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:34.376111 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 977/1952] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:25:34 2022] PUT /identity/v3/projects/109c56050b784fdab5b1f059a348ad95/users/737647813e394606a9faa68660af6c6f/roles/7f53f1c823b746529ba5057bf21b2477 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:25:34.379560 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18b0bf8-c88c-4450-aa76-91d82b7e5722 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:34.391031 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18b0bf8-c88c-4450-aa76-91d82b7e5722 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:34.439249 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:25:34.453920 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7be232-9d86-4a32-9695-45f2897b48af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:34.454619 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7be232-9d86-4a32-9695-45f2897b48af admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:34.455115 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7be232-9d86-4a32-9695-45f2897b48af admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:34.455447 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7be232-9d86-4a32-9695-45f2897b48af admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:34.456154 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7be232-9d86-4a32-9695-45f2897b48af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:34.457823 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7be232-9d86-4a32-9695-45f2897b48af admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:34.470762 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 976/1953] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:25:34 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:25:34.473602 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35e4509-664d-40bf-bd85-de89890ac201 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:34.484483 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35e4509-664d-40bf-bd85-de89890ac201 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:34.489450 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74a02b8-de09-42d7-9e83-6fdbbbae0b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:34.490130 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74a02b8-de09-42d7-9e83-6fdbbbae0b08 admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:34.490412 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74a02b8-de09-42d7-9e83-6fdbbbae0b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:34.490709 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74a02b8-de09-42d7-9e83-6fdbbbae0b08 admin admin] PATH_INFO: `/v3/projects/109c56050b784fdab5b1f059a348ad95/users/737647813e394606a9faa68660af6c6f/roles/7f53f1c823b746529ba5057bf21b2477` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:34.492716 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74a02b8-de09-42d7-9e83-6fdbbbae0b08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=109c56050b784fdab5b1f059a348ad95, user_id=737647813e394606a9faa68660af6c6f, role_id=7f53f1c823b746529ba5057bf21b2477)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:34.495588 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74a02b8-de09-42d7-9e83-6fdbbbae0b08 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:34.508914 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 978/1954] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:25:34 2022] PUT /identity/v3/projects/109c56050b784fdab5b1f059a348ad95/users/737647813e394606a9faa68660af6c6f/roles/7f53f1c823b746529ba5057bf21b2477 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:25:34.520946 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d764dc-bc6b-44b3-b6a9-b4926c0d53a4 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:34.521230 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d764dc-bc6b-44b3-b6a9-b4926c0d53a4 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:34.521508 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d764dc-bc6b-44b3-b6a9-b4926c0d53a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:34.554136 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-33d764dc-bc6b-44b3-b6a9-b4926c0d53a4 None None] MFA Rules not processed for user `737647813e394606a9faa68660af6c6f`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:25:34.555399 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-33d764dc-bc6b-44b3-b6a9-b4926c0d53a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:34.644021 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 977/1955] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:25:34 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:25:34.656270 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74a02b8-de09-42d7-9e83-6fdbbbae0b08 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:34.657873 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-f74a02b8-de09-42d7-9e83-6fdbbbae0b08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:34.764402 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74a02b8-de09-42d7-9e83-6fdbbbae0b08 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:34.770525 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b534126e-4fbe-45a8-879f-e6f0eb1ef4e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceafc5e4283841528053f01931f10293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:34.772330 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534126e-4fbe-45a8-879f-e6f0eb1ef4e6 service cinder] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:34.772766 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534126e-4fbe-45a8-879f-e6f0eb1ef4e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:34.773242 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534126e-4fbe-45a8-879f-e6f0eb1ef4e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:34.789761 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b534126e-4fbe-45a8-879f-e6f0eb1ef4e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:34.791502 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b534126e-4fbe-45a8-879f-e6f0eb1ef4e6 service cinder] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:34.812442 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 979/1956] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:25:34 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:25:34.891911 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d764dc-bc6b-44b3-b6a9-b4926c0d53a4 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:34.893413 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-33d764dc-bc6b-44b3-b6a9-b4926c0d53a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:34.912457 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d764dc-bc6b-44b3-b6a9-b4926c0d53a4 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:34.923924 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d1dca9-ec56-4016-b732-50846a442c38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceafc5e4283841528053f01931f10293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:34.924552 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d1dca9-ec56-4016-b732-50846a442c38 service cinder] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:34.924837 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d1dca9-ec56-4016-b732-50846a442c38 service cinder] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:34.925108 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d1dca9-ec56-4016-b732-50846a442c38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:35.028941 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d1dca9-ec56-4016-b732-50846a442c38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:35.030375 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d1dca9-ec56-4016-b732-50846a442c38 service cinder] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:35.040009 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 978/1957] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:25:34 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 12:25:38.741251 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b534126e-4fbe-45a8-879f-e6f0eb1ef4e6 service cinder] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:38.754318 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:25:38.805528 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b534126e-4fbe-45a8-879f-e6f0eb1ef4e6 service cinder] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:38.810904 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76326151-21fe-4e3f-a8c7-03c975110b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:38.811592 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76326151-21fe-4e3f-a8c7-03c975110b8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:38.811870 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76326151-21fe-4e3f-a8c7-03c975110b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:38.812147 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76326151-21fe-4e3f-a8c7-03c975110b8b admin admin] PATH_INFO: `/v3/users/693337a653e84faebf6b5080695d1180` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:38.813338 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76326151-21fe-4e3f-a8c7-03c975110b8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=693337a653e84faebf6b5080695d1180)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:38.815322 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76326151-21fe-4e3f-a8c7-03c975110b8b admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:38.866255 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-76326151-21fe-4e3f-a8c7-03c975110b8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '693337a653e84faebf6b5080695d1180'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:38.874207 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-76326151-21fe-4e3f-a8c7-03c975110b8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '693337a653e84faebf6b5080695d1180'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:38.874832 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-76326151-21fe-4e3f-a8c7-03c975110b8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '693337a653e84faebf6b5080695d1180'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:38.875439 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-76326151-21fe-4e3f-a8c7-03c975110b8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '693337a653e84faebf6b5080695d1180'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:38.882996 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-76326151-21fe-4e3f-a8c7-03c975110b8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '693337a653e84faebf6b5080695d1180'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:38.901009 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 980/1958] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:25:38 2022] DELETE /identity/v3/users/693337a653e84faebf6b5080695d1180 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:25:38.906094 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a963eed-6bd5-40f3-b7c2-bcc9c0d8ffce None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:38.906559 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a963eed-6bd5-40f3-b7c2-bcc9c0d8ffce None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:38.906824 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a963eed-6bd5-40f3-b7c2-bcc9c0d8ffce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:38.926006 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-3a963eed-6bd5-40f3-b7c2-bcc9c0d8ffce None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:25:38.927239 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-3a963eed-6bd5-40f3-b7c2-bcc9c0d8ffce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:38.993287 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 979/1959] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:25:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:25:39.006244 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76326151-21fe-4e3f-a8c7-03c975110b8b admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:39.007736 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-76326151-21fe-4e3f-a8c7-03c975110b8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:39.071339 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76326151-21fe-4e3f-a8c7-03c975110b8b admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:39.075855 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff92953-75e2-4b50-b2ae-fa57c7ea8c9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:39.076561 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff92953-75e2-4b50-b2ae-fa57c7ea8c9b service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:39.076918 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff92953-75e2-4b50-b2ae-fa57c7ea8c9b service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:39.077262 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff92953-75e2-4b50-b2ae-fa57c7ea8c9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:39.088276 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff92953-75e2-4b50-b2ae-fa57c7ea8c9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:39.089965 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff92953-75e2-4b50-b2ae-fa57c7ea8c9b service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:39.114082 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 981/1960] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:25:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:25:39.442218 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a963eed-6bd5-40f3-b7c2-bcc9c0d8ffce None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:39.443665 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-3a963eed-6bd5-40f3-b7c2-bcc9c0d8ffce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:39.457269 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a963eed-6bd5-40f3-b7c2-bcc9c0d8ffce None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:39.464496 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19100cec-a1ab-43d3-b36f-7c8046bb99dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:39.466154 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19100cec-a1ab-43d3-b36f-7c8046bb99dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:39.466584 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19100cec-a1ab-43d3-b36f-7c8046bb99dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:39.466896 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19100cec-a1ab-43d3-b36f-7c8046bb99dc admin admin] PATH_INFO: `/v3/projects/9710118e79b54fea8b3b513d8cecf173` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:39.468148 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19100cec-a1ab-43d3-b36f-7c8046bb99dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=9710118e79b54fea8b3b513d8cecf173)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:39.470773 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19100cec-a1ab-43d3-b36f-7c8046bb99dc admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:39.478568 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:25:39.539575 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-19100cec-a1ab-43d3-b36f-7c8046bb99dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9710118e79b54fea8b3b513d8cecf173', 'request_id': 'req-19100cec-a1ab-43d3-b36f-7c8046bb99dc'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:39.546396 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-19100cec-a1ab-43d3-b36f-7c8046bb99dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9710118e79b54fea8b3b513d8cecf173', 'request_id': 'req-19100cec-a1ab-43d3-b36f-7c8046bb99dc'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:39.552069 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-19100cec-a1ab-43d3-b36f-7c8046bb99dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9710118e79b54fea8b3b513d8cecf173', 'request_id': 'req-19100cec-a1ab-43d3-b36f-7c8046bb99dc'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:39.568509 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-19100cec-a1ab-43d3-b36f-7c8046bb99dc admin admin] The token cache is being invalidate because project 9710118e79b54fea8b3b513d8cecf173 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:25:39.568921 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-19100cec-a1ab-43d3-b36f-7c8046bb99dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:39.570388 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-19100cec-a1ab-43d3-b36f-7c8046bb99dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:39.571933 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 980/1961] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:25:39 2022] DELETE /identity/v3/projects/9710118e79b54fea8b3b513d8cecf173 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:25:39.576722 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff92953-75e2-4b50-b2ae-fa57c7ea8c9b service neutron] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:39.588828 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff92953-75e2-4b50-b2ae-fa57c7ea8c9b service neutron] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:39.627020 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:25:39.653702 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088f473c-87dd-4ce8-b445-3433d5196096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:39.654259 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f473c-87dd-4ce8-b445-3433d5196096 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:39.654534 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f473c-87dd-4ce8-b445-3433d5196096 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:39.654842 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f473c-87dd-4ce8-b445-3433d5196096 admin admin] PATH_INFO: `/v3/users/737647813e394606a9faa68660af6c6f` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:39.655945 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088f473c-87dd-4ce8-b445-3433d5196096 admin admin] RBAC: Authorizing `identity:delete_user(user_id=737647813e394606a9faa68660af6c6f)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:39.657902 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088f473c-87dd-4ce8-b445-3433d5196096 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:39.701544 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-088f473c-87dd-4ce8-b445-3433d5196096 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '737647813e394606a9faa68660af6c6f'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:39.708408 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-088f473c-87dd-4ce8-b445-3433d5196096 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '737647813e394606a9faa68660af6c6f'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:39.710914 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-088f473c-87dd-4ce8-b445-3433d5196096 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '737647813e394606a9faa68660af6c6f'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:39.711591 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-088f473c-87dd-4ce8-b445-3433d5196096 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '737647813e394606a9faa68660af6c6f'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:39.719434 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-088f473c-87dd-4ce8-b445-3433d5196096 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '737647813e394606a9faa68660af6c6f'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:39.737782 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 982/1962] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:25:39 2022] DELETE /identity/v3/users/737647813e394606a9faa68660af6c6f => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:25:40.133519 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19100cec-a1ab-43d3-b36f-7c8046bb99dc admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:40.135201 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-19100cec-a1ab-43d3-b36f-7c8046bb99dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:40.151981 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19100cec-a1ab-43d3-b36f-7c8046bb99dc admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:40.212011 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e4d8aa-8f92-406f-b8ab-b3ffeaf49026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:40.212653 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e4d8aa-8f92-406f-b8ab-b3ffeaf49026 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:40.212933 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e4d8aa-8f92-406f-b8ab-b3ffeaf49026 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:40.213206 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e4d8aa-8f92-406f-b8ab-b3ffeaf49026 admin admin] PATH_INFO: `/v3/projects/109c56050b784fdab5b1f059a348ad95` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:40.214333 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e4d8aa-8f92-406f-b8ab-b3ffeaf49026 admin admin] RBAC: Authorizing `identity:delete_project(project_id=109c56050b784fdab5b1f059a348ad95)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:40.216837 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e4d8aa-8f92-406f-b8ab-b3ffeaf49026 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:40.268197 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-71e4d8aa-8f92-406f-b8ab-b3ffeaf49026 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '109c56050b784fdab5b1f059a348ad95', 'request_id': 'req-71e4d8aa-8f92-406f-b8ab-b3ffeaf49026'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:40.276291 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-71e4d8aa-8f92-406f-b8ab-b3ffeaf49026 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '109c56050b784fdab5b1f059a348ad95', 'request_id': 'req-71e4d8aa-8f92-406f-b8ab-b3ffeaf49026'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:40.284700 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-71e4d8aa-8f92-406f-b8ab-b3ffeaf49026 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '109c56050b784fdab5b1f059a348ad95', 'request_id': 'req-71e4d8aa-8f92-406f-b8ab-b3ffeaf49026'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:40.310072 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-71e4d8aa-8f92-406f-b8ab-b3ffeaf49026 admin admin] The token cache is being invalidate because project 109c56050b784fdab5b1f059a348ad95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:25:40.310443 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-71e4d8aa-8f92-406f-b8ab-b3ffeaf49026 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:40.311022 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-71e4d8aa-8f92-406f-b8ab-b3ffeaf49026 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:40.312717 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 981/1963] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:25:40 2022] DELETE /identity/v3/projects/109c56050b784fdab5b1f059a348ad95 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:25:40.317520 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b14d5-c4be-40e5-a9ab-687b8698ae1e None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:40.318003 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b14d5-c4be-40e5-a9ab-687b8698ae1e None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:40.318389 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b14d5-c4be-40e5-a9ab-687b8698ae1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:40.340731 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-4e2b14d5-c4be-40e5-a9ab-687b8698ae1e None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:25:40.342161 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-4e2b14d5-c4be-40e5-a9ab-687b8698ae1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:40.416015 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 983/1964] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:25:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:25:40.423822 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8218de2-9b36-44ac-bb41-1b2e80fb6494 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:40.424104 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8218de2-9b36-44ac-bb41-1b2e80fb6494 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:40.424379 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8218de2-9b36-44ac-bb41-1b2e80fb6494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:40.444067 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-d8218de2-9b36-44ac-bb41-1b2e80fb6494 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:25:40.445181 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-d8218de2-9b36-44ac-bb41-1b2e80fb6494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:40.454062 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 982/1965] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:25:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:25:40.458282 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2b14d5-c4be-40e5-a9ab-687b8698ae1e None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:40.468682 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2b14d5-c4be-40e5-a9ab-687b8698ae1e None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:40.474453 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fded37-d8d7-4775-977e-d0cbfda16d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:40.474866 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fded37-d8d7-4775-977e-d0cbfda16d32 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:40.475145 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fded37-d8d7-4775-977e-d0cbfda16d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:40.475414 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fded37-d8d7-4775-977e-d0cbfda16d32 admin admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:40.476058 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fded37-d8d7-4775-977e-d0cbfda16d32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:25:40.476359 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fded37-d8d7-4775-977e-d0cbfda16d32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:40.477981 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fded37-d8d7-4775-977e-d0cbfda16d32 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:40.490315 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 984/1966] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 15 12:25:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:25:40.497570 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8218de2-9b36-44ac-bb41-1b2e80fb6494 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:40.507471 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8218de2-9b36-44ac-bb41-1b2e80fb6494 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:40.512905 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1150fd-105f-4d01-bae5-0c224455c31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:40.513503 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1150fd-105f-4d01-bae5-0c224455c31f admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:40.513805 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1150fd-105f-4d01-bae5-0c224455c31f admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:40.514097 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1150fd-105f-4d01-bae5-0c224455c31f admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:40.514731 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1150fd-105f-4d01-bae5-0c224455c31f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:40.516613 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1150fd-105f-4d01-bae5-0c224455c31f admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:40.527967 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:25:40.545492 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 983/1967] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:25:40 2022] POST /identity/v3/projects => generated 387 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:25:40.549685 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fded37-d8d7-4775-977e-d0cbfda16d32 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:40.560068 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fded37-d8d7-4775-977e-d0cbfda16d32 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:40.601096 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:25:40.631513 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096c0f3b-2583-4fcd-b045-82a700e1ad19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:40.632232 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096c0f3b-2583-4fcd-b045-82a700e1ad19 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:40.632733 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096c0f3b-2583-4fcd-b045-82a700e1ad19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:40.633083 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096c0f3b-2583-4fcd-b045-82a700e1ad19 admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:40.633798 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096c0f3b-2583-4fcd-b045-82a700e1ad19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:40.636291 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096c0f3b-2583-4fcd-b045-82a700e1ad19 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:40.677742 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 985/1968] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:25:40 2022] POST /identity/v3/users => generated 294 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:25:40.681776 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1150fd-105f-4d01-bae5-0c224455c31f admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:40.704991 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1150fd-105f-4d01-bae5-0c224455c31f admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:40.711743 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadc86cf-3b55-46c7-ab76-06a4fd7cf2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:40.712429 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc86cf-3b55-46c7-ab76-06a4fd7cf2b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:40.712774 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc86cf-3b55-46c7-ab76-06a4fd7cf2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:40.713117 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc86cf-3b55-46c7-ab76-06a4fd7cf2b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:40.713827 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadc86cf-3b55-46c7-ab76-06a4fd7cf2b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:40.716118 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadc86cf-3b55-46c7-ab76-06a4fd7cf2b5 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:40.728086 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 984/1969] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:25:40 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:25:40.732811 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096c0f3b-2583-4fcd-b045-82a700e1ad19 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:40.745014 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096c0f3b-2583-4fcd-b045-82a700e1ad19 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:40.749827 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28f5f56-a1cf-4c0e-aed8-802d5983514e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:40.750537 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f5f56-a1cf-4c0e-aed8-802d5983514e admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:40.750975 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f5f56-a1cf-4c0e-aed8-802d5983514e admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:40.751334 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f5f56-a1cf-4c0e-aed8-802d5983514e admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:40.752300 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28f5f56-a1cf-4c0e-aed8-802d5983514e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:40.753961 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28f5f56-a1cf-4c0e-aed8-802d5983514e admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:40.769476 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 986/1970] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:25:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:25:40.770706 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadc86cf-3b55-46c7-ab76-06a4fd7cf2b5 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:40.782044 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadc86cf-3b55-46c7-ab76-06a4fd7cf2b5 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:40.786564 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da21deb3-94e6-4fe7-aa0c-714d4ef8b0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:40.787267 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da21deb3-94e6-4fe7-aa0c-714d4ef8b0b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:40.787544 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da21deb3-94e6-4fe7-aa0c-714d4ef8b0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:40.787817 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da21deb3-94e6-4fe7-aa0c-714d4ef8b0b9 admin admin] PATH_INFO: `/v3/projects/e3d7cc0aaaa64d17b40aa289f7653abb/users/e717c18ba7e14fa0b65820c3784ce926/roles/9371e5bbc55848949eb951a815f817f2` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:40.806860 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da21deb3-94e6-4fe7-aa0c-714d4ef8b0b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3d7cc0aaaa64d17b40aa289f7653abb, user_id=e717c18ba7e14fa0b65820c3784ce926, role_id=9371e5bbc55848949eb951a815f817f2)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:40.809907 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da21deb3-94e6-4fe7-aa0c-714d4ef8b0b9 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:40.824783 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 985/1971] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:25:40 2022] PUT /identity/v3/projects/e3d7cc0aaaa64d17b40aa289f7653abb/users/e717c18ba7e14fa0b65820c3784ce926/roles/9371e5bbc55848949eb951a815f817f2 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:25:40.834955 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd31f2ac-453b-4a59-a0cf-43ed9b23082d None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:40.835375 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd31f2ac-453b-4a59-a0cf-43ed9b23082d None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:40.835656 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd31f2ac-453b-4a59-a0cf-43ed9b23082d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:40.865492 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-bd31f2ac-453b-4a59-a0cf-43ed9b23082d None None] MFA Rules not processed for user `e717c18ba7e14fa0b65820c3784ce926`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:25:40.866724 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-bd31f2ac-453b-4a59-a0cf-43ed9b23082d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:40.931504 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 987/1972] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:25:40 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:25:40.936114 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da21deb3-94e6-4fe7-aa0c-714d4ef8b0b9 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:41.000063 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da21deb3-94e6-4fe7-aa0c-714d4ef8b0b9 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:41.005146 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448ba56e-ef08-4166-a07d-cbeaf4a9a51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:41.005783 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ba56e-ef08-4166-a07d-cbeaf4a9a51b admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:41.006062 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ba56e-ef08-4166-a07d-cbeaf4a9a51b admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:41.006337 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ba56e-ef08-4166-a07d-cbeaf4a9a51b admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:41.007038 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448ba56e-ef08-4166-a07d-cbeaf4a9a51b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:41.009016 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448ba56e-ef08-4166-a07d-cbeaf4a9a51b admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:41.036919 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 986/1973] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:25:40 2022] POST /identity/v3/projects => generated 385 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 12:25:41.040921 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd31f2ac-453b-4a59-a0cf-43ed9b23082d None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:41.052031 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd31f2ac-453b-4a59-a0cf-43ed9b23082d None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:41.113162 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef9abea-0dac-4727-830e-1420a3d9c659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:41.113822 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef9abea-0dac-4727-830e-1420a3d9c659 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:41.114135 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef9abea-0dac-4727-830e-1420a3d9c659 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:41.114413 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef9abea-0dac-4727-830e-1420a3d9c659 admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:41.115078 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef9abea-0dac-4727-830e-1420a3d9c659 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:41.117013 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef9abea-0dac-4727-830e-1420a3d9c659 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:41.143134 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 988/1974] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:25:41 2022] POST /identity/v3/users => generated 299 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:25:41.144398 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448ba56e-ef08-4166-a07d-cbeaf4a9a51b admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:41.161619 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448ba56e-ef08-4166-a07d-cbeaf4a9a51b admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:41.166384 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce16de0d-0049-4e73-a68f-56d9212173de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:41.167085 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce16de0d-0049-4e73-a68f-56d9212173de admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:41.167366 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce16de0d-0049-4e73-a68f-56d9212173de admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:41.167638 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce16de0d-0049-4e73-a68f-56d9212173de admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:41.168273 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce16de0d-0049-4e73-a68f-56d9212173de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:41.170101 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce16de0d-0049-4e73-a68f-56d9212173de admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:41.181809 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 987/1975] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:25:41 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 12:25:41.186097 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef9abea-0dac-4727-830e-1420a3d9c659 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:41.196092 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef9abea-0dac-4727-830e-1420a3d9c659 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:41.201186 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ae78fa-0f8b-4f9a-9333-6a115bc25057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:41.201828 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae78fa-0f8b-4f9a-9333-6a115bc25057 admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:41.202104 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae78fa-0f8b-4f9a-9333-6a115bc25057 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:41.202374 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae78fa-0f8b-4f9a-9333-6a115bc25057 admin admin] PATH_INFO: `/v3/projects/6cb435a2cd6d48ddab80bfa5d8ee2e8b/users/45977db9eeca4dab98bf7f6cdfecea23/roles/7f53f1c823b746529ba5057bf21b2477` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:41.217923 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ae78fa-0f8b-4f9a-9333-6a115bc25057 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cb435a2cd6d48ddab80bfa5d8ee2e8b, user_id=45977db9eeca4dab98bf7f6cdfecea23, role_id=7f53f1c823b746529ba5057bf21b2477)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:41.220589 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ae78fa-0f8b-4f9a-9333-6a115bc25057 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:41.233097 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 989/1976] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:25:41 2022] PUT /identity/v3/projects/6cb435a2cd6d48ddab80bfa5d8ee2e8b/users/45977db9eeca4dab98bf7f6cdfecea23/roles/7f53f1c823b746529ba5057bf21b2477 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:25:41.237083 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce16de0d-0049-4e73-a68f-56d9212173de admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:41.246982 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce16de0d-0049-4e73-a68f-56d9212173de admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:41.301029 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec36e971-3c5c-4240-b907-b408980299d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:41.301625 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec36e971-3c5c-4240-b907-b408980299d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:41.301898 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec36e971-3c5c-4240-b907-b408980299d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:41.302166 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec36e971-3c5c-4240-b907-b408980299d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:41.302824 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec36e971-3c5c-4240-b907-b408980299d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:41.304397 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec36e971-3c5c-4240-b907-b408980299d1 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:41.314406 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 988/1977] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:25:41 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:25:41.318644 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ae78fa-0f8b-4f9a-9333-6a115bc25057 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:41.329353 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ae78fa-0f8b-4f9a-9333-6a115bc25057 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:41.333924 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a6c6f-1327-41b7-9e04-cf6b525424f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:41.334564 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a6c6f-1327-41b7-9e04-cf6b525424f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:41.334883 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a6c6f-1327-41b7-9e04-cf6b525424f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:41.335154 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a6c6f-1327-41b7-9e04-cf6b525424f1 admin admin] PATH_INFO: `/v3/projects/6cb435a2cd6d48ddab80bfa5d8ee2e8b/users/45977db9eeca4dab98bf7f6cdfecea23/roles/7f53f1c823b746529ba5057bf21b2477` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:41.337034 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030a6c6f-1327-41b7-9e04-cf6b525424f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cb435a2cd6d48ddab80bfa5d8ee2e8b, user_id=45977db9eeca4dab98bf7f6cdfecea23, role_id=7f53f1c823b746529ba5057bf21b2477)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:41.339669 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030a6c6f-1327-41b7-9e04-cf6b525424f1 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:41.349510 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 990/1978] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:25:41 2022] PUT /identity/v3/projects/6cb435a2cd6d48ddab80bfa5d8ee2e8b/users/45977db9eeca4dab98bf7f6cdfecea23/roles/7f53f1c823b746529ba5057bf21b2477 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:25:41.360494 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d079e-5e23-4e5a-8810-761bd00c692b None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:41.360855 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d079e-5e23-4e5a-8810-761bd00c692b None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:41.361187 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d079e-5e23-4e5a-8810-761bd00c692b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:41.393587 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-aa5d079e-5e23-4e5a-8810-761bd00c692b None None] MFA Rules not processed for user `45977db9eeca4dab98bf7f6cdfecea23`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:25:41.394832 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-aa5d079e-5e23-4e5a-8810-761bd00c692b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:41.408655 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:25:41.467115 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 989/1979] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:25:41 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:25:41.477704 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a6c6f-1327-41b7-9e04-cf6b525424f1 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:41.480117 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-030a6c6f-1327-41b7-9e04-cf6b525424f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:41.485829 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:25:41.542397 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a6c6f-1327-41b7-9e04-cf6b525424f1 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:41.546144 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09938636-9e5d-4abb-8a21-17ef7ea486b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceafc5e4283841528053f01931f10293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:41.546783 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09938636-9e5d-4abb-8a21-17ef7ea486b5 service cinder] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:41.547061 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09938636-9e5d-4abb-8a21-17ef7ea486b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:41.547328 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09938636-9e5d-4abb-8a21-17ef7ea486b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:41.556326 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09938636-9e5d-4abb-8a21-17ef7ea486b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:41.557747 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09938636-9e5d-4abb-8a21-17ef7ea486b5 service cinder] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:41.567618 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 991/1980] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:25:41 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:25:42.110895 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5d079e-5e23-4e5a-8810-761bd00c692b None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:42.175998 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5d079e-5e23-4e5a-8810-761bd00c692b None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:42.180737 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830c2149-bf38-4c72-ba36-fc0d54997b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:42.181662 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830c2149-bf38-4c72-ba36-fc0d54997b1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:42.181943 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830c2149-bf38-4c72-ba36-fc0d54997b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:42.182216 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830c2149-bf38-4c72-ba36-fc0d54997b1a admin admin] PATH_INFO: `/v3/users/e717c18ba7e14fa0b65820c3784ce926` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:42.183357 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830c2149-bf38-4c72-ba36-fc0d54997b1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e717c18ba7e14fa0b65820c3784ce926)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:42.185831 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830c2149-bf38-4c72-ba36-fc0d54997b1a admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:42.240228 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-830c2149-bf38-4c72-ba36-fc0d54997b1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e717c18ba7e14fa0b65820c3784ce926'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:42.249655 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-830c2149-bf38-4c72-ba36-fc0d54997b1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e717c18ba7e14fa0b65820c3784ce926'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:42.250559 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-830c2149-bf38-4c72-ba36-fc0d54997b1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e717c18ba7e14fa0b65820c3784ce926'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:42.251316 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-830c2149-bf38-4c72-ba36-fc0d54997b1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e717c18ba7e14fa0b65820c3784ce926'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:42.261463 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-830c2149-bf38-4c72-ba36-fc0d54997b1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e717c18ba7e14fa0b65820c3784ce926'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:42.283673 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 990/1981] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:25:42 2022] DELETE /identity/v3/users/e717c18ba7e14fa0b65820c3784ce926 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:25:42.287982 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3da287-089f-4a6c-95ff-13edf5cfd852 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:42.288790 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3da287-089f-4a6c-95ff-13edf5cfd852 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:42.289749 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3da287-089f-4a6c-95ff-13edf5cfd852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:42.313882 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-4d3da287-089f-4a6c-95ff-13edf5cfd852 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:25:42.315245 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-4d3da287-089f-4a6c-95ff-13edf5cfd852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:42.409815 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 992/1982] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:25:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:25:42.420735 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830c2149-bf38-4c72-ba36-fc0d54997b1a admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:42.422379 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-830c2149-bf38-4c72-ba36-fc0d54997b1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:42.458930 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:25:42.483780 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830c2149-bf38-4c72-ba36-fc0d54997b1a admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:42.487388 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c532018-5847-4a43-a674-2043c63cdb31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:42.487990 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c532018-5847-4a43-a674-2043c63cdb31 service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:42.488271 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c532018-5847-4a43-a674-2043c63cdb31 service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:42.488546 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c532018-5847-4a43-a674-2043c63cdb31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:42.497947 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c532018-5847-4a43-a674-2043c63cdb31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:42.499408 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c532018-5847-4a43-a674-2043c63cdb31 service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:42.509041 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 991/1983] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:25:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 12:25:42.781354 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3da287-089f-4a6c-95ff-13edf5cfd852 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:42.783127 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-4d3da287-089f-4a6c-95ff-13edf5cfd852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:42.798607 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3da287-089f-4a6c-95ff-13edf5cfd852 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:42.804098 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b10dd08-abb2-4c49-9e05-f75840240398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:42.804873 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b10dd08-abb2-4c49-9e05-f75840240398 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:42.805954 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b10dd08-abb2-4c49-9e05-f75840240398 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:42.806301 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b10dd08-abb2-4c49-9e05-f75840240398 admin admin] PATH_INFO: `/v3/projects/e3d7cc0aaaa64d17b40aa289f7653abb` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:42.807884 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b10dd08-abb2-4c49-9e05-f75840240398 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3d7cc0aaaa64d17b40aa289f7653abb)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:42.810458 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b10dd08-abb2-4c49-9e05-f75840240398 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:42.861354 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-1b10dd08-abb2-4c49-9e05-f75840240398 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3d7cc0aaaa64d17b40aa289f7653abb', 'request_id': 'req-1b10dd08-abb2-4c49-9e05-f75840240398'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:42.868003 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-1b10dd08-abb2-4c49-9e05-f75840240398 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3d7cc0aaaa64d17b40aa289f7653abb', 'request_id': 'req-1b10dd08-abb2-4c49-9e05-f75840240398'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:42.877735 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-1b10dd08-abb2-4c49-9e05-f75840240398 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3d7cc0aaaa64d17b40aa289f7653abb', 'request_id': 'req-1b10dd08-abb2-4c49-9e05-f75840240398'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:42.889849 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-1b10dd08-abb2-4c49-9e05-f75840240398 admin admin] The token cache is being invalidate because project e3d7cc0aaaa64d17b40aa289f7653abb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:25:42.890134 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-1b10dd08-abb2-4c49-9e05-f75840240398 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:42.890837 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-1b10dd08-abb2-4c49-9e05-f75840240398 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:42.892343 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 993/1984] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:25:42 2022] DELETE /identity/v3/projects/e3d7cc0aaaa64d17b40aa289f7653abb => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:25:42.896433 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c532018-5847-4a43-a674-2043c63cdb31 service neutron] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:42.907011 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c532018-5847-4a43-a674-2043c63cdb31 service neutron] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:42.975291 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4d19bc-43da-4757-af80-e40e3dedb917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:42.975938 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4d19bc-43da-4757-af80-e40e3dedb917 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:42.976277 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4d19bc-43da-4757-af80-e40e3dedb917 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:42.977266 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4d19bc-43da-4757-af80-e40e3dedb917 admin admin] PATH_INFO: `/v3/users/45977db9eeca4dab98bf7f6cdfecea23` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:42.978025 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4d19bc-43da-4757-af80-e40e3dedb917 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45977db9eeca4dab98bf7f6cdfecea23)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:42.980138 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4d19bc-43da-4757-af80-e40e3dedb917 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:43.038774 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-2b4d19bc-43da-4757-af80-e40e3dedb917 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45977db9eeca4dab98bf7f6cdfecea23'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:43.047773 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-2b4d19bc-43da-4757-af80-e40e3dedb917 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45977db9eeca4dab98bf7f6cdfecea23'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:43.048378 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-2b4d19bc-43da-4757-af80-e40e3dedb917 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45977db9eeca4dab98bf7f6cdfecea23'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:43.049001 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-2b4d19bc-43da-4757-af80-e40e3dedb917 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45977db9eeca4dab98bf7f6cdfecea23'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:43.056520 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-2b4d19bc-43da-4757-af80-e40e3dedb917 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45977db9eeca4dab98bf7f6cdfecea23'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:43.074664 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 992/1985] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:25:42 2022] DELETE /identity/v3/users/45977db9eeca4dab98bf7f6cdfecea23 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:25:43.338525 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b10dd08-abb2-4c49-9e05-f75840240398 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:43.340194 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-1b10dd08-abb2-4c49-9e05-f75840240398 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:43.353213 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b10dd08-abb2-4c49-9e05-f75840240398 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:43.384987 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:25:43.428639 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b9e1a9-3888-41bc-b5d3-dea1485c29eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:43.429329 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b9e1a9-3888-41bc-b5d3-dea1485c29eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:43.429619 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b9e1a9-3888-41bc-b5d3-dea1485c29eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:43.429893 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b9e1a9-3888-41bc-b5d3-dea1485c29eb admin admin] PATH_INFO: `/v3/projects/6cb435a2cd6d48ddab80bfa5d8ee2e8b` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:43.431067 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b9e1a9-3888-41bc-b5d3-dea1485c29eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cb435a2cd6d48ddab80bfa5d8ee2e8b)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:43.433009 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b9e1a9-3888-41bc-b5d3-dea1485c29eb admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:43.488386 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-39b9e1a9-3888-41bc-b5d3-dea1485c29eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cb435a2cd6d48ddab80bfa5d8ee2e8b', 'request_id': 'req-39b9e1a9-3888-41bc-b5d3-dea1485c29eb'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:43.495323 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-39b9e1a9-3888-41bc-b5d3-dea1485c29eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cb435a2cd6d48ddab80bfa5d8ee2e8b', 'request_id': 'req-39b9e1a9-3888-41bc-b5d3-dea1485c29eb'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:43.505224 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-39b9e1a9-3888-41bc-b5d3-dea1485c29eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cb435a2cd6d48ddab80bfa5d8ee2e8b', 'request_id': 'req-39b9e1a9-3888-41bc-b5d3-dea1485c29eb'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:43.518331 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-39b9e1a9-3888-41bc-b5d3-dea1485c29eb admin admin] The token cache is being invalidate because project 6cb435a2cd6d48ddab80bfa5d8ee2e8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:25:43.518625 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-39b9e1a9-3888-41bc-b5d3-dea1485c29eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:43.519297 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-39b9e1a9-3888-41bc-b5d3-dea1485c29eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:43.520811 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 994/1986] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:25:43 2022] DELETE /identity/v3/projects/6cb435a2cd6d48ddab80bfa5d8ee2e8b => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:25:43.525497 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aaf136-b0c0-4f05-8e99-2e552cb46374 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:43.525973 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aaf136-b0c0-4f05-8e99-2e552cb46374 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:43.526206 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aaf136-b0c0-4f05-8e99-2e552cb46374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:43.545604 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-d7aaf136-b0c0-4f05-8e99-2e552cb46374 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:25:43.546839 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-d7aaf136-b0c0-4f05-8e99-2e552cb46374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:43.594853 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:25:43.608817 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 993/1987] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:25:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:25:43.616945 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248443f1-1a0e-4efe-addf-9c2550e17856 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:43.617232 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248443f1-1a0e-4efe-addf-9c2550e17856 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:43.617509 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248443f1-1a0e-4efe-addf-9c2550e17856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:43.638750 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-248443f1-1a0e-4efe-addf-9c2550e17856 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:25:43.639988 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-248443f1-1a0e-4efe-addf-9c2550e17856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:43.651323 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 995/1988] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:25:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:25:43.656181 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aaf136-b0c0-4f05-8e99-2e552cb46374 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:43.667678 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aaf136-b0c0-4f05-8e99-2e552cb46374 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:43.672202 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad9c5c4-ca19-4e35-bfe0-69c14c04be8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:43.672803 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad9c5c4-ca19-4e35-bfe0-69c14c04be8d admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:43.673083 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad9c5c4-ca19-4e35-bfe0-69c14c04be8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:43.673353 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad9c5c4-ca19-4e35-bfe0-69c14c04be8d admin admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:43.673999 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad9c5c4-ca19-4e35-bfe0-69c14c04be8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:25:43.674307 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad9c5c4-ca19-4e35-bfe0-69c14c04be8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:43.676125 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad9c5c4-ca19-4e35-bfe0-69c14c04be8d admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:43.688320 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 994/1989] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 15 12:25:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:25:43.692834 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248443f1-1a0e-4efe-addf-9c2550e17856 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:43.703464 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248443f1-1a0e-4efe-addf-9c2550e17856 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:43.709218 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9e4c77-909d-4f2e-a6d7-4685bd65b52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:43.709989 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e4c77-909d-4f2e-a6d7-4685bd65b52c admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:43.710306 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e4c77-909d-4f2e-a6d7-4685bd65b52c admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:43.710625 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e4c77-909d-4f2e-a6d7-4685bd65b52c admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:43.711341 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9e4c77-909d-4f2e-a6d7-4685bd65b52c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:43.713414 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9e4c77-909d-4f2e-a6d7-4685bd65b52c admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:43.748383 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 996/1990] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:25:43 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:25:43.749340 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad9c5c4-ca19-4e35-bfe0-69c14c04be8d admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:43.759829 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad9c5c4-ca19-4e35-bfe0-69c14c04be8d admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:43.817801 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9fcdc1-49d7-49aa-a43b-fa2ab08f5b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:43.818414 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9fcdc1-49d7-49aa-a43b-fa2ab08f5b3f admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:43.818755 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9fcdc1-49d7-49aa-a43b-fa2ab08f5b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:43.819033 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9fcdc1-49d7-49aa-a43b-fa2ab08f5b3f admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:43.819675 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9fcdc1-49d7-49aa-a43b-fa2ab08f5b3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:43.821591 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9fcdc1-49d7-49aa-a43b-fa2ab08f5b3f admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:43.846351 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 995/1991] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:25:43 2022] POST /identity/v3/users => generated 286 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:25:43.847495 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9e4c77-909d-4f2e-a6d7-4685bd65b52c admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:43.859145 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9e4c77-909d-4f2e-a6d7-4685bd65b52c admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:43.863312 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9fcdc1-49d7-49aa-a43b-fa2ab08f5b3f admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:43.864416 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5721b006-a134-46fa-8ddb-42185a243bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:43.864970 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-5f9fcdc1-49d7-49aa-a43b-fa2ab08f5b3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:43.865071 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5721b006-a134-46fa-8ddb-42185a243bf3 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:43.865289 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5721b006-a134-46fa-8ddb-42185a243bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:43.865615 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5721b006-a134-46fa-8ddb-42185a243bf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:43.866267 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5721b006-a134-46fa-8ddb-42185a243bf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:43.867894 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5721b006-a134-46fa-8ddb-42185a243bf3 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:43.881653 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 997/1992] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:25:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:25:43.882680 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5721b006-a134-46fa-8ddb-42185a243bf3 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:43.892387 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5721b006-a134-46fa-8ddb-42185a243bf3 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:43.897122 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6653a3b6-e763-4e5a-bcf5-dbb6e0790471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:43.897728 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6653a3b6-e763-4e5a-bcf5-dbb6e0790471 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:43.898013 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6653a3b6-e763-4e5a-bcf5-dbb6e0790471 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:43.898288 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6653a3b6-e763-4e5a-bcf5-dbb6e0790471 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:43.898947 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6653a3b6-e763-4e5a-bcf5-dbb6e0790471 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:43.900524 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6653a3b6-e763-4e5a-bcf5-dbb6e0790471 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:43.916959 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 998/1993] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:25:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:25:43.917992 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6653a3b6-e763-4e5a-bcf5-dbb6e0790471 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:43.927021 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9fcdc1-49d7-49aa-a43b-fa2ab08f5b3f admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:43.928187 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6653a3b6-e763-4e5a-bcf5-dbb6e0790471 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:43.930914 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a5f920-8c4e-42d5-a89b-5cb3d8ec51a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceafc5e4283841528053f01931f10293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:43.931519 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a5f920-8c4e-42d5-a89b-5cb3d8ec51a8 service cinder] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:43.931793 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a5f920-8c4e-42d5-a89b-5cb3d8ec51a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:43.932057 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a5f920-8c4e-42d5-a89b-5cb3d8ec51a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:43.933093 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8af9fd-c84c-4231-9ded-ec925eb0b2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:43.933723 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8af9fd-c84c-4231-9ded-ec925eb0b2d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:43.933895 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-e6a5f920-8c4e-42d5-a89b-5cb3d8ec51a8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:43.934066 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8af9fd-c84c-4231-9ded-ec925eb0b2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:43.934344 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8af9fd-c84c-4231-9ded-ec925eb0b2d2 admin admin] PATH_INFO: `/v3/projects/f521bff7b33342eb9d2cd7e4a0924de9/users/3d15cf3c29ee4f1d818e0252633d118b/roles/9371e5bbc55848949eb951a815f817f2` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:43.952718 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8af9fd-c84c-4231-9ded-ec925eb0b2d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f521bff7b33342eb9d2cd7e4a0924de9, user_id=3d15cf3c29ee4f1d818e0252633d118b, role_id=9371e5bbc55848949eb951a815f817f2)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:43.956836 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8af9fd-c84c-4231-9ded-ec925eb0b2d2 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:43.972346 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 999/1994] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:25:43 2022] PUT /identity/v3/projects/f521bff7b33342eb9d2cd7e4a0924de9/users/3d15cf3c29ee4f1d818e0252633d118b/roles/9371e5bbc55848949eb951a815f817f2 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:25:43.984789 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16addfd-00ab-4977-80be-eccc94f49d83 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:43.985099 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16addfd-00ab-4977-80be-eccc94f49d83 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:43.985366 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16addfd-00ab-4977-80be-eccc94f49d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:44.009688 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a5f920-8c4e-42d5-a89b-5cb3d8ec51a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:44.011205 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a5f920-8c4e-42d5-a89b-5cb3d8ec51a8 service cinder] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:44.016762 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-c16addfd-00ab-4977-80be-eccc94f49d83 None None] MFA Rules not processed for user `3d15cf3c29ee4f1d818e0252633d118b`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:25:44.018001 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-c16addfd-00ab-4977-80be-eccc94f49d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:44.022589 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 996/1995] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:25:43 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 12:25:44.054096 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:25:44.095409 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1000/1996] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:25:43 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:25:44.110358 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a5f920-8c4e-42d5-a89b-5cb3d8ec51a8 service cinder] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:44.112090 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-e6a5f920-8c4e-42d5-a89b-5cb3d8ec51a8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:44.139169 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:25:44.211578 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a5f920-8c4e-42d5-a89b-5cb3d8ec51a8 service cinder] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:44.274721 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505a53d0-a603-4401-ad9c-5dd548923489 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd057b651769b4ae99c1d4f2b0fc31fb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:44.275383 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a53d0-a603-4401-ad9c-5dd548923489 service glance] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:44.275667 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a53d0-a603-4401-ad9c-5dd548923489 service glance] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:44.275944 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a53d0-a603-4401-ad9c-5dd548923489 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:44.285414 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505a53d0-a603-4401-ad9c-5dd548923489 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:44.287270 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505a53d0-a603-4401-ad9c-5dd548923489 service glance] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:44.300401 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 997/1997] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:25:44 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:25:54.092300 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=12 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:25:54.293218 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=46 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:25:58.119077 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed028fc-5786-462f-b632-9d4386a01df4 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:58.119595 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed028fc-5786-462f-b632-9d4386a01df4 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:58.119864 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed028fc-5786-462f-b632-9d4386a01df4 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:58.121808 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1001/1998] 10.222.0.16 () {54 vars in 921 bytes} [Thu Sep 15 12:25:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:25:58.132455 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e23cdf-7c96-4fe9-83f5-7bc53b5e8522 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:58.132952 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e23cdf-7c96-4fe9-83f5-7bc53b5e8522 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:58.133207 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e23cdf-7c96-4fe9-83f5-7bc53b5e8522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:58.153248 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-e7e23cdf-7c96-4fe9-83f5-7bc53b5e8522 None None] MFA Rules not processed for user `b7ff8a5ddf1e422ca97f92bd9d4e5fb8`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:25:58.154443 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-e7e23cdf-7c96-4fe9-83f5-7bc53b5e8522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:58.192324 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed028fc-5786-462f-b632-9d4386a01df4 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:58.194457 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-7ed028fc-5786-462f-b632-9d4386a01df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:58.233290 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 998/1999] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Sep 15 12:25:58 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:25:58.301754 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed028fc-5786-462f-b632-9d4386a01df4 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:58.306218 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c9b8c4-4c18-4c9b-b523-7179ea4007a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:58.306885 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c9b8c4-4c18-4c9b-b523-7179ea4007a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:58.307163 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c9b8c4-4c18-4c9b-b523-7179ea4007a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:58.307432 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c9b8c4-4c18-4c9b-b523-7179ea4007a7 admin admin] PATH_INFO: `/v3/users/218bb1de31574611b85b60851252bc8a` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:58.307539 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afab1de9-8229-416e-8513-803e45c97376 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:58.307930 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afab1de9-8229-416e-8513-803e45c97376 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:58.308357 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afab1de9-8229-416e-8513-803e45c97376 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:58.308633 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c9b8c4-4c18-4c9b-b523-7179ea4007a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=218bb1de31574611b85b60851252bc8a)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:58.309901 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 999/2000] 10.222.0.16 () {54 vars in 961 bytes} [Thu Sep 15 12:25:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 12:25:58.310541 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c9b8c4-4c18-4c9b-b523-7179ea4007a7 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:58.315039 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37901f38-36ff-4159-bdee-b172b30691d6 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:58.315319 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37901f38-36ff-4159-bdee-b172b30691d6 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:58.315592 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37901f38-36ff-4159-bdee-b172b30691d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:58.340477 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-37901f38-36ff-4159-bdee-b172b30691d6 None None] MFA Rules not processed for user `b7ff8a5ddf1e422ca97f92bd9d4e5fb8`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:25:58.342165 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-37901f38-36ff-4159-bdee-b172b30691d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:58.352180 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1000/2001] 10.222.0.16 () {58 vars in 1058 bytes} [Thu Sep 15 12:25:58 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:25:58.360639 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37901f38-36ff-4159-bdee-b172b30691d6 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:58.363146 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-f3c9b8c4-4c18-4c9b-b523-7179ea4007a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '218bb1de31574611b85b60851252bc8a'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:58.371619 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37901f38-36ff-4159-bdee-b172b30691d6 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:58.371802 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-f3c9b8c4-4c18-4c9b-b523-7179ea4007a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '218bb1de31574611b85b60851252bc8a'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:58.372570 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-f3c9b8c4-4c18-4c9b-b523-7179ea4007a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '218bb1de31574611b85b60851252bc8a'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:58.373258 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-f3c9b8c4-4c18-4c9b-b523-7179ea4007a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '218bb1de31574611b85b60851252bc8a'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:58.377023 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27024d7-fe74-49f5-9a8a-cd4e89143a6b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ff8a5ddf1e422ca97f92bd9d4e5fb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:58.377612 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27024d7-fe74-49f5-9a8a-cd4e89143a6b service placement] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:58.377885 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27024d7-fe74-49f5-9a8a-cd4e89143a6b service placement] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:58.378157 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27024d7-fe74-49f5-9a8a-cd4e89143a6b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:58.379857 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-a27024d7-fe74-49f5-9a8a-cd4e89143a6b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:58.381007 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-f3c9b8c4-4c18-4c9b-b523-7179ea4007a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '218bb1de31574611b85b60851252bc8a'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:58.391545 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27024d7-fe74-49f5-9a8a-cd4e89143a6b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:58.393117 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27024d7-fe74-49f5-9a8a-cd4e89143a6b service placement] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:58.399023 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1002/2002] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:25:58 2022] DELETE /identity/v3/users/218bb1de31574611b85b60851252bc8a => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:25:58.403569 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1001/2003] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:25:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:25:58.578512 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c9b8c4-4c18-4c9b-b523-7179ea4007a7 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:58.580097 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-f3c9b8c4-4c18-4c9b-b523-7179ea4007a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:58.649428 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c9b8c4-4c18-4c9b-b523-7179ea4007a7 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:58.654904 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9235a25-4314-44ed-8c46-17615aaaf18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:58.655454 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9235a25-4314-44ed-8c46-17615aaaf18a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:58.655756 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9235a25-4314-44ed-8c46-17615aaaf18a admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:58.656031 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9235a25-4314-44ed-8c46-17615aaaf18a admin admin] PATH_INFO: `/v3/projects/633c28b3d08c430b91c8921ec4bbe617` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:58.657202 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9235a25-4314-44ed-8c46-17615aaaf18a admin admin] RBAC: Authorizing `identity:delete_project(project_id=633c28b3d08c430b91c8921ec4bbe617)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:58.659142 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9235a25-4314-44ed-8c46-17615aaaf18a admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:58.682980 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:25:58.709537 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-f9235a25-4314-44ed-8c46-17615aaaf18a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '633c28b3d08c430b91c8921ec4bbe617', 'request_id': 'req-f9235a25-4314-44ed-8c46-17615aaaf18a'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:58.716142 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-f9235a25-4314-44ed-8c46-17615aaaf18a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '633c28b3d08c430b91c8921ec4bbe617', 'request_id': 'req-f9235a25-4314-44ed-8c46-17615aaaf18a'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:58.723974 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-f9235a25-4314-44ed-8c46-17615aaaf18a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '633c28b3d08c430b91c8921ec4bbe617', 'request_id': 'req-f9235a25-4314-44ed-8c46-17615aaaf18a'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:58.736015 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-f9235a25-4314-44ed-8c46-17615aaaf18a admin admin] The token cache is being invalidate because project 633c28b3d08c430b91c8921ec4bbe617 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:25:58.736319 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-f9235a25-4314-44ed-8c46-17615aaaf18a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:58.737115 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-f9235a25-4314-44ed-8c46-17615aaaf18a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:25:58.738737 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1003/2004] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:25:58 2022] DELETE /identity/v3/projects/633c28b3d08c430b91c8921ec4bbe617 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:25:58.745349 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d93e39-e8dc-4c65-a3bb-4887aa4bade4 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:58.745633 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d93e39-e8dc-4c65-a3bb-4887aa4bade4 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:58.746394 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d93e39-e8dc-4c65-a3bb-4887aa4bade4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:58.767308 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-54d93e39-e8dc-4c65-a3bb-4887aa4bade4 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:25:58.768519 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-54d93e39-e8dc-4c65-a3bb-4887aa4bade4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:58.840195 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1002/2005] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:25:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:25:58.841832 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c734731-6dad-4ea7-bcc7-304ded09f173 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:58.842129 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c734731-6dad-4ea7-bcc7-304ded09f173 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:58.842409 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c734731-6dad-4ea7-bcc7-304ded09f173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:58.862994 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-2c734731-6dad-4ea7-bcc7-304ded09f173 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:25:58.864344 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-2c734731-6dad-4ea7-bcc7-304ded09f173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:58.872892 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1004/2006] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:25:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:25:58.877361 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d93e39-e8dc-4c65-a3bb-4887aa4bade4 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:58.887661 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d93e39-e8dc-4c65-a3bb-4887aa4bade4 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:58.892236 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e4528-966b-41c5-8821-161e77fdd4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:58.892869 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e4528-966b-41c5-8821-161e77fdd4d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:58.893147 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e4528-966b-41c5-8821-161e77fdd4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:58.893424 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e4528-966b-41c5-8821-161e77fdd4d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:58.894100 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5e4528-966b-41c5-8821-161e77fdd4d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:25:58.894406 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5e4528-966b-41c5-8821-161e77fdd4d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:58.896048 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5e4528-966b-41c5-8821-161e77fdd4d4 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:58.908137 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1003/2007] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 15 12:25:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:25:58.912295 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c734731-6dad-4ea7-bcc7-304ded09f173 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:58.922908 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c734731-6dad-4ea7-bcc7-304ded09f173 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:58.927837 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1001cf33-5dd9-4dd5-8613-7117fbdd08a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:58.928448 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1001cf33-5dd9-4dd5-8613-7117fbdd08a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:58.928726 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1001cf33-5dd9-4dd5-8613-7117fbdd08a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:58.929001 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1001cf33-5dd9-4dd5-8613-7117fbdd08a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:58.929638 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1001cf33-5dd9-4dd5-8613-7117fbdd08a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:58.931611 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1001cf33-5dd9-4dd5-8613-7117fbdd08a3 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:58.965163 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1005/2008] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:25:58 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 12:25:58.966228 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e4528-966b-41c5-8821-161e77fdd4d4 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:58.977986 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e4528-966b-41c5-8821-161e77fdd4d4 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:59.047615 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232d9580-2f7f-4404-a17a-3686bb31402f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:59.048181 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232d9580-2f7f-4404-a17a-3686bb31402f admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:59.048469 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232d9580-2f7f-4404-a17a-3686bb31402f admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:59.050955 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232d9580-2f7f-4404-a17a-3686bb31402f admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:59.051803 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232d9580-2f7f-4404-a17a-3686bb31402f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:59.053785 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232d9580-2f7f-4404-a17a-3686bb31402f admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:59.065462 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:25:59.080527 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1004/2009] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:25:58 2022] POST /identity/v3/users => generated 292 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 12:25:59.084618 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1001cf33-5dd9-4dd5-8613-7117fbdd08a3 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:59.095134 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1001cf33-5dd9-4dd5-8613-7117fbdd08a3 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:59.102303 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eddda0f-8fc8-4052-843a-52f677735710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:59.103070 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eddda0f-8fc8-4052-843a-52f677735710 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:59.103430 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eddda0f-8fc8-4052-843a-52f677735710 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:59.103754 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eddda0f-8fc8-4052-843a-52f677735710 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:59.104476 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eddda0f-8fc8-4052-843a-52f677735710 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:59.106918 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eddda0f-8fc8-4052-843a-52f677735710 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:59.124636 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1006/2010] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:25:59 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 12:25:59.129142 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232d9580-2f7f-4404-a17a-3686bb31402f admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:59.140179 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232d9580-2f7f-4404-a17a-3686bb31402f admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:59.145491 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5947e2a1-883e-4663-b282-0470cbf89e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:59.146165 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5947e2a1-883e-4663-b282-0470cbf89e12 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:59.146665 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5947e2a1-883e-4663-b282-0470cbf89e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:59.147078 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5947e2a1-883e-4663-b282-0470cbf89e12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:59.147844 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5947e2a1-883e-4663-b282-0470cbf89e12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:59.149555 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5947e2a1-883e-4663-b282-0470cbf89e12 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:59.166901 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1005/2011] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:25:59 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:25:59.169780 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eddda0f-8fc8-4052-843a-52f677735710 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:59.181824 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eddda0f-8fc8-4052-843a-52f677735710 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:59.188117 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eb18c7-f07d-4e12-a590-373e62ee47f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:59.188796 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb18c7-f07d-4e12-a590-373e62ee47f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:59.189079 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb18c7-f07d-4e12-a590-373e62ee47f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:59.189355 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb18c7-f07d-4e12-a590-373e62ee47f7 admin admin] PATH_INFO: `/v3/projects/34f698d6b6884606861b45be197e0679/users/5c52ba7a858b4aed83f74d3d00b18e40/roles/9371e5bbc55848949eb951a815f817f2` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:59.207154 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eb18c7-f07d-4e12-a590-373e62ee47f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34f698d6b6884606861b45be197e0679, user_id=5c52ba7a858b4aed83f74d3d00b18e40, role_id=9371e5bbc55848949eb951a815f817f2)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:59.218874 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eb18c7-f07d-4e12-a590-373e62ee47f7 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:59.229054 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1007/2012] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:25:59 2022] PUT /identity/v3/projects/34f698d6b6884606861b45be197e0679/users/5c52ba7a858b4aed83f74d3d00b18e40/roles/9371e5bbc55848949eb951a815f817f2 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:25:59.241997 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb393b-ac24-40b2-829b-6174676adbad None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:59.242369 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb393b-ac24-40b2-829b-6174676adbad None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:59.242735 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb393b-ac24-40b2-829b-6174676adbad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:59.276070 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-72bb393b-ac24-40b2-829b-6174676adbad None None] MFA Rules not processed for user `5c52ba7a858b4aed83f74d3d00b18e40`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:25:59.277526 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-72bb393b-ac24-40b2-829b-6174676adbad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:59.366665 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1006/2013] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:25:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:25:59.370273 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eb18c7-f07d-4e12-a590-373e62ee47f7 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:59.439620 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eb18c7-f07d-4e12-a590-373e62ee47f7 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:59.444898 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0948a64-e390-4dbe-9c21-105c929dfd9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:59.445579 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0948a64-e390-4dbe-9c21-105c929dfd9f admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:59.445853 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0948a64-e390-4dbe-9c21-105c929dfd9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:59.446119 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0948a64-e390-4dbe-9c21-105c929dfd9f admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:59.446782 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0948a64-e390-4dbe-9c21-105c929dfd9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:59.448749 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0948a64-e390-4dbe-9c21-105c929dfd9f admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:59.478451 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1008/2014] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:25:59 2022] POST /identity/v3/projects => generated 383 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:25:59.482804 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bb393b-ac24-40b2-829b-6174676adbad None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:59.494474 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bb393b-ac24-40b2-829b-6174676adbad None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:59.555927 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4128506e-0581-432f-bdd3-262fc1bd77e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:59.556591 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4128506e-0581-432f-bdd3-262fc1bd77e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:59.556889 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4128506e-0581-432f-bdd3-262fc1bd77e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:59.557194 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4128506e-0581-432f-bdd3-262fc1bd77e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:59.557845 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4128506e-0581-432f-bdd3-262fc1bd77e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:59.560400 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4128506e-0581-432f-bdd3-262fc1bd77e2 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:59.597726 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1007/2015] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:25:59 2022] POST /identity/v3/users => generated 298 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 12:25:59.601661 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0948a64-e390-4dbe-9c21-105c929dfd9f admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:59.614498 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0948a64-e390-4dbe-9c21-105c929dfd9f admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:59.621370 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ec3730-3ba1-45f2-b0c9-84cc90c4cd6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:59.622174 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ec3730-3ba1-45f2-b0c9-84cc90c4cd6e admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:59.622704 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ec3730-3ba1-45f2-b0c9-84cc90c4cd6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:59.623023 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ec3730-3ba1-45f2-b0c9-84cc90c4cd6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:59.623767 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ec3730-3ba1-45f2-b0c9-84cc90c4cd6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:59.626783 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ec3730-3ba1-45f2-b0c9-84cc90c4cd6e admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:59.643033 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1009/2016] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:25:59 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:25:59.647325 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4128506e-0581-432f-bdd3-262fc1bd77e2 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:59.659561 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4128506e-0581-432f-bdd3-262fc1bd77e2 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:59.665214 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18af7064-e34c-47cc-964a-5608380ce915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:59.665873 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af7064-e34c-47cc-964a-5608380ce915 admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:59.666184 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af7064-e34c-47cc-964a-5608380ce915 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:59.666412 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af7064-e34c-47cc-964a-5608380ce915 admin admin] PATH_INFO: `/v3/projects/07c902ec9333446cb032100db9b49a41/users/3098171d21f943169070449b6eab7bcd/roles/7f53f1c823b746529ba5057bf21b2477` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:59.682276 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18af7064-e34c-47cc-964a-5608380ce915 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07c902ec9333446cb032100db9b49a41, user_id=3098171d21f943169070449b6eab7bcd, role_id=7f53f1c823b746529ba5057bf21b2477)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:59.685143 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18af7064-e34c-47cc-964a-5608380ce915 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:59.702574 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1008/2017] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:25:59 2022] PUT /identity/v3/projects/07c902ec9333446cb032100db9b49a41/users/3098171d21f943169070449b6eab7bcd/roles/7f53f1c823b746529ba5057bf21b2477 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:25:59.706631 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ec3730-3ba1-45f2-b0c9-84cc90c4cd6e admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:59.719352 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ec3730-3ba1-45f2-b0c9-84cc90c4cd6e admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:59.747463 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:25:59.794228 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93833afa-69f0-48cf-a6dd-f9898c86b85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:59.794887 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93833afa-69f0-48cf-a6dd-f9898c86b85c admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:59.795170 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93833afa-69f0-48cf-a6dd-f9898c86b85c admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:59.795450 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93833afa-69f0-48cf-a6dd-f9898c86b85c admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:59.796104 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93833afa-69f0-48cf-a6dd-f9898c86b85c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:59.797707 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93833afa-69f0-48cf-a6dd-f9898c86b85c admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:59.807806 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1010/2018] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:25:59 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:25:59.812028 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18af7064-e34c-47cc-964a-5608380ce915 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:59.822115 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18af7064-e34c-47cc-964a-5608380ce915 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:25:59.827390 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027268b6-6f03-4c77-a706-fd72cf9d8748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:25:59.828049 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027268b6-6f03-4c77-a706-fd72cf9d8748 admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:59.828328 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027268b6-6f03-4c77-a706-fd72cf9d8748 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:59.828602 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027268b6-6f03-4c77-a706-fd72cf9d8748 admin admin] PATH_INFO: `/v3/projects/07c902ec9333446cb032100db9b49a41/users/3098171d21f943169070449b6eab7bcd/roles/7f53f1c823b746529ba5057bf21b2477` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:59.830488 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027268b6-6f03-4c77-a706-fd72cf9d8748 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07c902ec9333446cb032100db9b49a41, user_id=3098171d21f943169070449b6eab7bcd, role_id=7f53f1c823b746529ba5057bf21b2477)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:25:59.833162 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027268b6-6f03-4c77-a706-fd72cf9d8748 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:25:59.844150 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1009/2019] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:25:59 2022] PUT /identity/v3/projects/07c902ec9333446cb032100db9b49a41/users/3098171d21f943169070449b6eab7bcd/roles/7f53f1c823b746529ba5057bf21b2477 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:25:59.855537 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7227c0-9d06-4b76-ba79-fedb3ad50782 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:25:59.855849 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7227c0-9d06-4b76-ba79-fedb3ad50782 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:25:59.856129 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7227c0-9d06-4b76-ba79-fedb3ad50782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:25:59.884653 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-4e7227c0-9d06-4b76-ba79-fedb3ad50782 None None] MFA Rules not processed for user `3098171d21f943169070449b6eab7bcd`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:25:59.885859 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-4e7227c0-9d06-4b76-ba79-fedb3ad50782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:25:59.953610 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1011/2020] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:25:59 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:25:59.964902 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027268b6-6f03-4c77-a706-fd72cf9d8748 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:25:59.966602 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-027268b6-6f03-4c77-a706-fd72cf9d8748 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:26:00.002039 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:26:00.033311 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027268b6-6f03-4c77-a706-fd72cf9d8748 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:00.037157 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcd12bd-73bd-4151-8229-e39383dfe4bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceafc5e4283841528053f01931f10293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:00.037767 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd12bd-73bd-4151-8229-e39383dfe4bc service cinder] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:00.038073 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd12bd-73bd-4151-8229-e39383dfe4bc service cinder] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:00.038344 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd12bd-73bd-4151-8229-e39383dfe4bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:00.048321 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcd12bd-73bd-4151-8229-e39383dfe4bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:00.049732 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcd12bd-73bd-4151-8229-e39383dfe4bc service cinder] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:00.059150 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1010/2021] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:25:59 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:26:00.165349 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7227c0-9d06-4b76-ba79-fedb3ad50782 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:00.175617 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7227c0-9d06-4b76-ba79-fedb3ad50782 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:00.179118 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a747903b-4a03-465c-a581-097332a332e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceafc5e4283841528053f01931f10293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:00.179717 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a747903b-4a03-465c-a581-097332a332e8 service cinder] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:00.179996 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a747903b-4a03-465c-a581-097332a332e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:00.180270 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a747903b-4a03-465c-a581-097332a332e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:00.235566 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a747903b-4a03-465c-a581-097332a332e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:00.236995 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a747903b-4a03-465c-a581-097332a332e8 service cinder] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:00.246340 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1012/2022] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:26:00 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:26:03.917904 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcd12bd-73bd-4151-8229-e39383dfe4bc service cinder] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:03.990855 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcd12bd-73bd-4151-8229-e39383dfe4bc service cinder] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:03.990855 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1232d38b-f534-4cf8-8b83-138850b123b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:03.990855 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1232d38b-f534-4cf8-8b83-138850b123b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:03.990855 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1232d38b-f534-4cf8-8b83-138850b123b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:03.991244 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1232d38b-f534-4cf8-8b83-138850b123b9 admin admin] PATH_INFO: `/v3/users/5c52ba7a858b4aed83f74d3d00b18e40` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:03.991244 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1232d38b-f534-4cf8-8b83-138850b123b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c52ba7a858b4aed83f74d3d00b18e40)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:03.991244 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1232d38b-f534-4cf8-8b83-138850b123b9 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:04.039669 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-1232d38b-f534-4cf8-8b83-138850b123b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c52ba7a858b4aed83f74d3d00b18e40'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:04.049350 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-1232d38b-f534-4cf8-8b83-138850b123b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c52ba7a858b4aed83f74d3d00b18e40'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:04.049996 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-1232d38b-f534-4cf8-8b83-138850b123b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c52ba7a858b4aed83f74d3d00b18e40'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:04.050621 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-1232d38b-f534-4cf8-8b83-138850b123b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c52ba7a858b4aed83f74d3d00b18e40'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:04.058093 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-1232d38b-f534-4cf8-8b83-138850b123b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c52ba7a858b4aed83f74d3d00b18e40'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:04.079882 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1011/2023] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:26:03 2022] DELETE /identity/v3/users/5c52ba7a858b4aed83f74d3d00b18e40 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:26:04.084240 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c95c50c-a005-439d-a983-1b54091dafc6 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:04.084682 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c95c50c-a005-439d-a983-1b54091dafc6 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:04.084793 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c95c50c-a005-439d-a983-1b54091dafc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:04.104038 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-1c95c50c-a005-439d-a983-1b54091dafc6 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:26:04.105221 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-1c95c50c-a005-439d-a983-1b54091dafc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:26:04.139449 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:26:04.165638 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1013/2024] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:26:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:26:04.175455 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1232d38b-f534-4cf8-8b83-138850b123b9 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:04.177041 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-1232d38b-f534-4cf8-8b83-138850b123b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:26:04.232781 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:26:04.240685 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1232d38b-f534-4cf8-8b83-138850b123b9 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:04.245040 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c48b6b-ecec-415a-b74a-5d4d11f9d7ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:04.245735 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c48b6b-ecec-415a-b74a-5d4d11f9d7ff service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:04.246124 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c48b6b-ecec-415a-b74a-5d4d11f9d7ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:04.246488 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c48b6b-ecec-415a-b74a-5d4d11f9d7ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:04.266520 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c48b6b-ecec-415a-b74a-5d4d11f9d7ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:04.268623 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c48b6b-ecec-415a-b74a-5d4d11f9d7ff service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:04.279771 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1012/2025] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:26:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:26:04.632589 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c95c50c-a005-439d-a983-1b54091dafc6 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:04.634430 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-1c95c50c-a005-439d-a983-1b54091dafc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:26:04.649508 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c95c50c-a005-439d-a983-1b54091dafc6 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:04.654859 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d837126-6acd-45bc-811d-39aeb7cc7220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:04.655489 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d837126-6acd-45bc-811d-39aeb7cc7220 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:04.655755 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d837126-6acd-45bc-811d-39aeb7cc7220 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:04.656022 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d837126-6acd-45bc-811d-39aeb7cc7220 admin admin] PATH_INFO: `/v3/projects/34f698d6b6884606861b45be197e0679` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:04.657134 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d837126-6acd-45bc-811d-39aeb7cc7220 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34f698d6b6884606861b45be197e0679)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:04.659125 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d837126-6acd-45bc-811d-39aeb7cc7220 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:04.705504 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-1d837126-6acd-45bc-811d-39aeb7cc7220 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34f698d6b6884606861b45be197e0679', 'request_id': 'req-1d837126-6acd-45bc-811d-39aeb7cc7220'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:04.712031 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-1d837126-6acd-45bc-811d-39aeb7cc7220 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34f698d6b6884606861b45be197e0679', 'request_id': 'req-1d837126-6acd-45bc-811d-39aeb7cc7220'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:04.719140 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-1d837126-6acd-45bc-811d-39aeb7cc7220 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34f698d6b6884606861b45be197e0679', 'request_id': 'req-1d837126-6acd-45bc-811d-39aeb7cc7220'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:04.733812 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-1d837126-6acd-45bc-811d-39aeb7cc7220 admin admin] The token cache is being invalidate because project 34f698d6b6884606861b45be197e0679 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:26:04.734245 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-1d837126-6acd-45bc-811d-39aeb7cc7220 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:04.734974 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-1d837126-6acd-45bc-811d-39aeb7cc7220 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:04.736747 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1014/2026] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:26:04 2022] DELETE /identity/v3/projects/34f698d6b6884606861b45be197e0679 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:26:04.740580 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c48b6b-ecec-415a-b74a-5d4d11f9d7ff service neutron] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:04.751934 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c48b6b-ecec-415a-b74a-5d4d11f9d7ff service neutron] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:04.808255 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e44f00-9dfb-4a82-8a90-78f86a7ff293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:04.808875 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e44f00-9dfb-4a82-8a90-78f86a7ff293 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:04.809672 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e44f00-9dfb-4a82-8a90-78f86a7ff293 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:04.809941 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e44f00-9dfb-4a82-8a90-78f86a7ff293 admin admin] PATH_INFO: `/v3/users/3098171d21f943169070449b6eab7bcd` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:04.811129 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e44f00-9dfb-4a82-8a90-78f86a7ff293 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3098171d21f943169070449b6eab7bcd)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:04.813078 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e44f00-9dfb-4a82-8a90-78f86a7ff293 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:04.857260 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-02e44f00-9dfb-4a82-8a90-78f86a7ff293 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3098171d21f943169070449b6eab7bcd'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:04.864041 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-02e44f00-9dfb-4a82-8a90-78f86a7ff293 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3098171d21f943169070449b6eab7bcd'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:04.864647 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-02e44f00-9dfb-4a82-8a90-78f86a7ff293 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3098171d21f943169070449b6eab7bcd'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:04.865242 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-02e44f00-9dfb-4a82-8a90-78f86a7ff293 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3098171d21f943169070449b6eab7bcd'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:04.872504 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-02e44f00-9dfb-4a82-8a90-78f86a7ff293 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3098171d21f943169070449b6eab7bcd'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:04.890626 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1013/2027] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:26:04 2022] DELETE /identity/v3/users/3098171d21f943169070449b6eab7bcd => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:26:05.155753 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d837126-6acd-45bc-811d-39aeb7cc7220 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:05.157221 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-1d837126-6acd-45bc-811d-39aeb7cc7220 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:26:05.171003 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d837126-6acd-45bc-811d-39aeb7cc7220 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:05.226637 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3725e8ba-4ef9-4236-b734-e7fe5d0f9597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:05.227226 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3725e8ba-4ef9-4236-b734-e7fe5d0f9597 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:05.227504 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3725e8ba-4ef9-4236-b734-e7fe5d0f9597 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:05.227775 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3725e8ba-4ef9-4236-b734-e7fe5d0f9597 admin admin] PATH_INFO: `/v3/projects/07c902ec9333446cb032100db9b49a41` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:05.228903 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3725e8ba-4ef9-4236-b734-e7fe5d0f9597 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07c902ec9333446cb032100db9b49a41)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:05.231370 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3725e8ba-4ef9-4236-b734-e7fe5d0f9597 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:05.277681 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-3725e8ba-4ef9-4236-b734-e7fe5d0f9597 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07c902ec9333446cb032100db9b49a41', 'request_id': 'req-3725e8ba-4ef9-4236-b734-e7fe5d0f9597'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:05.283759 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-3725e8ba-4ef9-4236-b734-e7fe5d0f9597 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07c902ec9333446cb032100db9b49a41', 'request_id': 'req-3725e8ba-4ef9-4236-b734-e7fe5d0f9597'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:05.290955 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-3725e8ba-4ef9-4236-b734-e7fe5d0f9597 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07c902ec9333446cb032100db9b49a41', 'request_id': 'req-3725e8ba-4ef9-4236-b734-e7fe5d0f9597'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:05.292101 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:26:05.304989 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-3725e8ba-4ef9-4236-b734-e7fe5d0f9597 admin admin] The token cache is being invalidate because project 07c902ec9333446cb032100db9b49a41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:26:05.305274 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-3725e8ba-4ef9-4236-b734-e7fe5d0f9597 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:05.305909 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-3725e8ba-4ef9-4236-b734-e7fe5d0f9597 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:05.307424 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1015/2028] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:26:05 2022] DELETE /identity/v3/projects/07c902ec9333446cb032100db9b49a41 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:26:05.312324 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6581eba2-c773-4597-91e2-5b2d33397314 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:05.312808 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6581eba2-c773-4597-91e2-5b2d33397314 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:05.312904 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6581eba2-c773-4597-91e2-5b2d33397314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:05.332855 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-6581eba2-c773-4597-91e2-5b2d33397314 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:26:05.334060 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-6581eba2-c773-4597-91e2-5b2d33397314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:26:05.396210 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1014/2029] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:26:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:26:05.404204 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd73ebb5-3481-488e-a7ef-de82d0da0e4b None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:05.404486 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd73ebb5-3481-488e-a7ef-de82d0da0e4b None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:05.404760 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd73ebb5-3481-488e-a7ef-de82d0da0e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:05.425297 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-dd73ebb5-3481-488e-a7ef-de82d0da0e4b None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:26:05.426491 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-dd73ebb5-3481-488e-a7ef-de82d0da0e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:26:05.434742 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1016/2030] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:26:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:26:05.438856 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6581eba2-c773-4597-91e2-5b2d33397314 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:05.448804 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6581eba2-c773-4597-91e2-5b2d33397314 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:05.453513 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac2eecb-e90d-43cd-ac15-4efdbae25e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:05.454143 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac2eecb-e90d-43cd-ac15-4efdbae25e70 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:05.454434 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac2eecb-e90d-43cd-ac15-4efdbae25e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:05.454716 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac2eecb-e90d-43cd-ac15-4efdbae25e70 admin admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:05.455369 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac2eecb-e90d-43cd-ac15-4efdbae25e70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:26:05.455674 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac2eecb-e90d-43cd-ac15-4efdbae25e70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:05.457274 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac2eecb-e90d-43cd-ac15-4efdbae25e70 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:05.459648 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:26:05.472422 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1015/2031] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 15 12:26:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:26:05.476527 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd73ebb5-3481-488e-a7ef-de82d0da0e4b None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:05.487968 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd73ebb5-3481-488e-a7ef-de82d0da0e4b None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:05.492611 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7b0d54-8d09-4879-aba9-61943eb39d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:05.493208 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b0d54-8d09-4879-aba9-61943eb39d96 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:05.493487 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b0d54-8d09-4879-aba9-61943eb39d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:05.493872 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b0d54-8d09-4879-aba9-61943eb39d96 admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:05.494507 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7b0d54-8d09-4879-aba9-61943eb39d96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:05.496462 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7b0d54-8d09-4879-aba9-61943eb39d96 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:05.523505 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1017/2032] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:26:05 2022] POST /identity/v3/projects => generated 407 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 12:26:05.527576 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac2eecb-e90d-43cd-ac15-4efdbae25e70 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:05.537767 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac2eecb-e90d-43cd-ac15-4efdbae25e70 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:05.594265 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818e9a6c-6224-48ef-98db-7415d3a2bb7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:05.594887 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818e9a6c-6224-48ef-98db-7415d3a2bb7d admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:05.595163 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818e9a6c-6224-48ef-98db-7415d3a2bb7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:05.595430 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818e9a6c-6224-48ef-98db-7415d3a2bb7d admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:05.596049 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818e9a6c-6224-48ef-98db-7415d3a2bb7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:05.597948 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818e9a6c-6224-48ef-98db-7415d3a2bb7d admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:05.618370 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1016/2033] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:26:05 2022] POST /identity/v3/users => generated 304 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:26:05.622959 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7b0d54-8d09-4879-aba9-61943eb39d96 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:05.633367 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7b0d54-8d09-4879-aba9-61943eb39d96 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:05.638676 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119d3fd0-d50c-44d0-8533-3280e106b574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:05.639319 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119d3fd0-d50c-44d0-8533-3280e106b574 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:05.639606 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119d3fd0-d50c-44d0-8533-3280e106b574 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:05.639879 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119d3fd0-d50c-44d0-8533-3280e106b574 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:05.640525 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119d3fd0-d50c-44d0-8533-3280e106b574 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:05.642154 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119d3fd0-d50c-44d0-8533-3280e106b574 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:05.652569 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1018/2034] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:26:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:26:05.656527 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818e9a6c-6224-48ef-98db-7415d3a2bb7d admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:05.666461 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818e9a6c-6224-48ef-98db-7415d3a2bb7d admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:05.671568 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc8c12e-aa9f-4bf5-aafc-df9b37fefda2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:05.672157 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc8c12e-aa9f-4bf5-aafc-df9b37fefda2 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:05.672431 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc8c12e-aa9f-4bf5-aafc-df9b37fefda2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:05.672706 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc8c12e-aa9f-4bf5-aafc-df9b37fefda2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:05.673334 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc8c12e-aa9f-4bf5-aafc-df9b37fefda2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:05.674932 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc8c12e-aa9f-4bf5-aafc-df9b37fefda2 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:05.686308 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1017/2035] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:26:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:26:05.690454 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119d3fd0-d50c-44d0-8533-3280e106b574 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:05.700481 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119d3fd0-d50c-44d0-8533-3280e106b574 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:05.705081 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3202bb15-a7a6-410b-9071-64904f469fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:05.705737 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202bb15-a7a6-410b-9071-64904f469fd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:05.706040 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202bb15-a7a6-410b-9071-64904f469fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:05.706312 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202bb15-a7a6-410b-9071-64904f469fd3 admin admin] PATH_INFO: `/v3/projects/21a1ca691409463b90c292a97388803c/users/ffd63e95b5444aa985f9bbf4c470523b/roles/9371e5bbc55848949eb951a815f817f2` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:05.722936 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3202bb15-a7a6-410b-9071-64904f469fd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21a1ca691409463b90c292a97388803c, user_id=ffd63e95b5444aa985f9bbf4c470523b, role_id=9371e5bbc55848949eb951a815f817f2)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:05.725677 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3202bb15-a7a6-410b-9071-64904f469fd3 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:05.740130 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1019/2036] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:26:05 2022] PUT /identity/v3/projects/21a1ca691409463b90c292a97388803c/users/ffd63e95b5444aa985f9bbf4c470523b/roles/9371e5bbc55848949eb951a815f817f2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:26:05.751127 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d3efa4-3c7f-4e47-98b6-3b75c5b0a5cc None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:05.751411 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d3efa4-3c7f-4e47-98b6-3b75c5b0a5cc None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:05.751947 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d3efa4-3c7f-4e47-98b6-3b75c5b0a5cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:05.779866 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-a5d3efa4-3c7f-4e47-98b6-3b75c5b0a5cc None None] MFA Rules not processed for user `ffd63e95b5444aa985f9bbf4c470523b`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:26:05.781167 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-a5d3efa4-3c7f-4e47-98b6-3b75c5b0a5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:26:05.846654 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1018/2037] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:26:05 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:26:05.851260 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3202bb15-a7a6-410b-9071-64904f469fd3 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:05.911787 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3202bb15-a7a6-410b-9071-64904f469fd3 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:05.916416 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2394ecf-76f6-4348-b584-4d29da06ec70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:05.917013 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2394ecf-76f6-4348-b584-4d29da06ec70 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:05.917290 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2394ecf-76f6-4348-b584-4d29da06ec70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:05.917557 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2394ecf-76f6-4348-b584-4d29da06ec70 admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:05.918180 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2394ecf-76f6-4348-b584-4d29da06ec70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:05.921931 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2394ecf-76f6-4348-b584-4d29da06ec70 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:05.948818 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1020/2038] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:26:05 2022] POST /identity/v3/projects => generated 409 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:26:05.953175 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d3efa4-3c7f-4e47-98b6-3b75c5b0a5cc None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:05.964062 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d3efa4-3c7f-4e47-98b6-3b75c5b0a5cc None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:06.021127 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656d126d-f11f-4e3c-8dde-45b3e928ea21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:06.021659 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d126d-f11f-4e3c-8dde-45b3e928ea21 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:06.021938 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d126d-f11f-4e3c-8dde-45b3e928ea21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:06.022211 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d126d-f11f-4e3c-8dde-45b3e928ea21 admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:06.022882 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656d126d-f11f-4e3c-8dde-45b3e928ea21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:06.024785 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656d126d-f11f-4e3c-8dde-45b3e928ea21 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:06.034591 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:26:06.046043 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1019/2039] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:26:05 2022] POST /identity/v3/users => generated 311 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:26:06.050031 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2394ecf-76f6-4348-b584-4d29da06ec70 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:06.060955 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2394ecf-76f6-4348-b584-4d29da06ec70 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:06.067013 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a0491-5e66-46a6-a2c8-8839021b8b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:06.067615 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a0491-5e66-46a6-a2c8-8839021b8b76 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:06.067904 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a0491-5e66-46a6-a2c8-8839021b8b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:06.068165 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a0491-5e66-46a6-a2c8-8839021b8b76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:06.068804 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4a0491-5e66-46a6-a2c8-8839021b8b76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:06.070399 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4a0491-5e66-46a6-a2c8-8839021b8b76 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:06.082598 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1021/2040] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:26:06.087242 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656d126d-f11f-4e3c-8dde-45b3e928ea21 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:06.097576 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656d126d-f11f-4e3c-8dde-45b3e928ea21 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:06.103448 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e7c246-6a15-4ff7-884a-4fd149eb7802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:06.104106 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7c246-6a15-4ff7-884a-4fd149eb7802 admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:06.104384 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7c246-6a15-4ff7-884a-4fd149eb7802 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:06.104687 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7c246-6a15-4ff7-884a-4fd149eb7802 admin admin] PATH_INFO: `/v3/projects/5e7fd89ae99b486bb66ebb3c26d818df/users/fa0992dc4873438490a03d7ae51cd8e2/roles/7f53f1c823b746529ba5057bf21b2477` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:06.119333 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e7c246-6a15-4ff7-884a-4fd149eb7802 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e7fd89ae99b486bb66ebb3c26d818df, user_id=fa0992dc4873438490a03d7ae51cd8e2, role_id=7f53f1c823b746529ba5057bf21b2477)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:06.122500 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e7c246-6a15-4ff7-884a-4fd149eb7802 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:06.135456 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1020/2041] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:26:06 2022] PUT /identity/v3/projects/5e7fd89ae99b486bb66ebb3c26d818df/users/fa0992dc4873438490a03d7ae51cd8e2/roles/7f53f1c823b746529ba5057bf21b2477 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:26:06.139937 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a0491-5e66-46a6-a2c8-8839021b8b76 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:06.150257 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a0491-5e66-46a6-a2c8-8839021b8b76 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:06.204897 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522a69e8-1b88-4efd-b7b6-eada75cb1ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:06.205531 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a69e8-1b88-4efd-b7b6-eada75cb1ecf admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:06.205756 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a69e8-1b88-4efd-b7b6-eada75cb1ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:06.206019 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a69e8-1b88-4efd-b7b6-eada75cb1ecf admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:06.206641 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522a69e8-1b88-4efd-b7b6-eada75cb1ecf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:06.208246 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522a69e8-1b88-4efd-b7b6-eada75cb1ecf admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:06.213484 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:26:06.219111 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1022/2042] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:26:06.223067 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e7c246-6a15-4ff7-884a-4fd149eb7802 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:06.233980 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e7c246-6a15-4ff7-884a-4fd149eb7802 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:06.238596 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c832d1-25ec-4f38-86d4-319d6563e49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:06.239277 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c832d1-25ec-4f38-86d4-319d6563e49b admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:06.239557 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c832d1-25ec-4f38-86d4-319d6563e49b admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:06.239831 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c832d1-25ec-4f38-86d4-319d6563e49b admin admin] PATH_INFO: `/v3/projects/5e7fd89ae99b486bb66ebb3c26d818df/users/fa0992dc4873438490a03d7ae51cd8e2/roles/7f53f1c823b746529ba5057bf21b2477` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:06.241724 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c832d1-25ec-4f38-86d4-319d6563e49b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e7fd89ae99b486bb66ebb3c26d818df, user_id=fa0992dc4873438490a03d7ae51cd8e2, role_id=7f53f1c823b746529ba5057bf21b2477)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:06.244431 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c832d1-25ec-4f38-86d4-319d6563e49b admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:06.254841 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1021/2043] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:26:06 2022] PUT /identity/v3/projects/5e7fd89ae99b486bb66ebb3c26d818df/users/fa0992dc4873438490a03d7ae51cd8e2/roles/7f53f1c823b746529ba5057bf21b2477 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:26:06.265918 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15da48b-a441-4eb4-8311-208730cd4701 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:06.266207 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15da48b-a441-4eb4-8311-208730cd4701 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:06.266477 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15da48b-a441-4eb4-8311-208730cd4701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:06.294237 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-d15da48b-a441-4eb4-8311-208730cd4701 None None] MFA Rules not processed for user `fa0992dc4873438490a03d7ae51cd8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:26:06.295383 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-d15da48b-a441-4eb4-8311-208730cd4701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:26:06.361475 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1023/2044] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:26:06 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:26:06.372391 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c832d1-25ec-4f38-86d4-319d6563e49b admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:06.374114 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-63c832d1-25ec-4f38-86d4-319d6563e49b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:26:06.434935 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c832d1-25ec-4f38-86d4-319d6563e49b admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:06.438742 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d914d8-afeb-488c-a89f-571b549e5064 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceafc5e4283841528053f01931f10293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:06.439357 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d914d8-afeb-488c-a89f-571b549e5064 service cinder] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:06.439639 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d914d8-afeb-488c-a89f-571b549e5064 service cinder] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:06.439910 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d914d8-afeb-488c-a89f-571b549e5064 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:06.449366 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d914d8-afeb-488c-a89f-571b549e5064 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:06.451318 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d914d8-afeb-488c-a89f-571b549e5064 service cinder] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:06.460960 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1022/2045] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:26:06 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:26:06.619374 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15da48b-a441-4eb4-8311-208730cd4701 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:06.628886 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15da48b-a441-4eb4-8311-208730cd4701 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:06.632525 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea80bf64-abe9-4ca6-b8b0-eef7d3af7a22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceafc5e4283841528053f01931f10293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:06.633134 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea80bf64-abe9-4ca6-b8b0-eef7d3af7a22 service cinder] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:06.633408 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea80bf64-abe9-4ca6-b8b0-eef7d3af7a22 service cinder] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:06.633676 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea80bf64-abe9-4ca6-b8b0-eef7d3af7a22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:06.691129 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea80bf64-abe9-4ca6-b8b0-eef7d3af7a22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:06.692565 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea80bf64-abe9-4ca6-b8b0-eef7d3af7a22 service cinder] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:06.702010 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1024/2046] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:26:06 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:26:10.547321 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802e50e8-d112-4b22-a069-250580f7cd64 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:10.548843 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802e50e8-d112-4b22-a069-250580f7cd64 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:10.549532 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802e50e8-d112-4b22-a069-250580f7cd64 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:10.552385 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1023/2047] 10.222.0.16 () {54 vars in 921 bytes} [Thu Sep 15 12:26:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:26:10.561379 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db121b-2e9f-4014-9eae-d3a47e24b7b3 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:10.562204 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db121b-2e9f-4014-9eae-d3a47e24b7b3 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:10.563220 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db121b-2e9f-4014-9eae-d3a47e24b7b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:10.612557 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-b2db121b-2e9f-4014-9eae-d3a47e24b7b3 None None] MFA Rules not processed for user `b7ff8a5ddf1e422ca97f92bd9d4e5fb8`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:26:10.617902 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-b2db121b-2e9f-4014-9eae-d3a47e24b7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:26:10.648823 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802e50e8-d112-4b22-a069-250580f7cd64 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:10.651102 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-802e50e8-d112-4b22-a069-250580f7cd64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:26:10.697026 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1025/2048] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Sep 15 12:26:10 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:26:10.710942 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2db121b-2e9f-4014-9eae-d3a47e24b7b3 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:10.712504 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-b2db121b-2e9f-4014-9eae-d3a47e24b7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:26:10.726448 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2db121b-2e9f-4014-9eae-d3a47e24b7b3 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:10.728363 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802e50e8-d112-4b22-a069-250580f7cd64 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:10.733057 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27933cc3-21d5-493e-a816-f44f808af2a6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ff8a5ddf1e422ca97f92bd9d4e5fb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:10.733672 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27933cc3-21d5-493e-a816-f44f808af2a6 service placement] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:10.733953 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27933cc3-21d5-493e-a816-f44f808af2a6 service placement] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:10.734233 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27933cc3-21d5-493e-a816-f44f808af2a6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:10.734878 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f770cf1b-43a0-44ba-b061-8ba43043b829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:10.735837 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770cf1b-43a0-44ba-b061-8ba43043b829 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:10.736184 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770cf1b-43a0-44ba-b061-8ba43043b829 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:10.736716 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770cf1b-43a0-44ba-b061-8ba43043b829 admin admin] PATH_INFO: `/v3/users/230a0cec59d94e1ab06ef6eb47391b4f` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:10.737736 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f770cf1b-43a0-44ba-b061-8ba43043b829 admin admin] RBAC: Authorizing `identity:delete_user(user_id=230a0cec59d94e1ab06ef6eb47391b4f)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:10.739916 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f770cf1b-43a0-44ba-b061-8ba43043b829 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:10.744418 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27933cc3-21d5-493e-a816-f44f808af2a6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:10.746575 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27933cc3-21d5-493e-a816-f44f808af2a6 service placement] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:10.760184 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1026/2049] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:26:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 12:26:10.796537 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-f770cf1b-43a0-44ba-b061-8ba43043b829 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '230a0cec59d94e1ab06ef6eb47391b4f'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:10.804471 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-f770cf1b-43a0-44ba-b061-8ba43043b829 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '230a0cec59d94e1ab06ef6eb47391b4f'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:10.805370 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-f770cf1b-43a0-44ba-b061-8ba43043b829 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '230a0cec59d94e1ab06ef6eb47391b4f'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:10.806055 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-f770cf1b-43a0-44ba-b061-8ba43043b829 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '230a0cec59d94e1ab06ef6eb47391b4f'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:10.812312 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:INSERT=4,keystone:SELECT=88,keystone:DELETE=8 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:26:10.815226 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-f770cf1b-43a0-44ba-b061-8ba43043b829 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '230a0cec59d94e1ab06ef6eb47391b4f'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:10.835999 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1024/2050] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:26:10 2022] DELETE /identity/v3/users/230a0cec59d94e1ab06ef6eb47391b4f => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:26:11.031146 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27933cc3-21d5-493e-a816-f44f808af2a6 service placement] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:11.044438 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27933cc3-21d5-493e-a816-f44f808af2a6 service placement] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:11.048744 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:26:11.105459 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fd82f2-cc76-466e-ae0b-472c6ee2b9cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:11.106111 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd82f2-cc76-466e-ae0b-472c6ee2b9cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:11.106389 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd82f2-cc76-466e-ae0b-472c6ee2b9cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:11.106658 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd82f2-cc76-466e-ae0b-472c6ee2b9cb admin admin] PATH_INFO: `/v3/projects/0f5188a628bc454da91006e77ec15035` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:11.107786 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fd82f2-cc76-466e-ae0b-472c6ee2b9cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f5188a628bc454da91006e77ec15035)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:11.109682 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fd82f2-cc76-466e-ae0b-472c6ee2b9cb admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:11.155418 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-79fd82f2-cc76-466e-ae0b-472c6ee2b9cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f5188a628bc454da91006e77ec15035', 'request_id': 'req-79fd82f2-cc76-466e-ae0b-472c6ee2b9cb'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:11.161006 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-79fd82f2-cc76-466e-ae0b-472c6ee2b9cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f5188a628bc454da91006e77ec15035', 'request_id': 'req-79fd82f2-cc76-466e-ae0b-472c6ee2b9cb'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:11.168010 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-79fd82f2-cc76-466e-ae0b-472c6ee2b9cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f5188a628bc454da91006e77ec15035', 'request_id': 'req-79fd82f2-cc76-466e-ae0b-472c6ee2b9cb'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:11.178773 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-79fd82f2-cc76-466e-ae0b-472c6ee2b9cb admin admin] The token cache is being invalidate because project 0f5188a628bc454da91006e77ec15035 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:26:11.179062 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-79fd82f2-cc76-466e-ae0b-472c6ee2b9cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:11.179687 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-79fd82f2-cc76-466e-ae0b-472c6ee2b9cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:11.181147 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1027/2051] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:26:11 2022] DELETE /identity/v3/projects/0f5188a628bc454da91006e77ec15035 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:26:11.185267 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f770cf1b-43a0-44ba-b061-8ba43043b829 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:11.186650 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-f770cf1b-43a0-44ba-b061-8ba43043b829 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:26:11.199963 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f770cf1b-43a0-44ba-b061-8ba43043b829 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:11.256690 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe2e0ea-2b4d-4aea-a386-cc4f3743de1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:11.257308 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe2e0ea-2b4d-4aea-a386-cc4f3743de1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:11.257583 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe2e0ea-2b4d-4aea-a386-cc4f3743de1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:11.257850 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe2e0ea-2b4d-4aea-a386-cc4f3743de1b admin admin] PATH_INFO: `/v3/users/f38118641726493db6024f0cb4562ad4` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:11.259069 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe2e0ea-2b4d-4aea-a386-cc4f3743de1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f38118641726493db6024f0cb4562ad4)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:11.261079 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe2e0ea-2b4d-4aea-a386-cc4f3743de1b admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:11.306207 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-dbe2e0ea-2b4d-4aea-a386-cc4f3743de1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f38118641726493db6024f0cb4562ad4'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:11.313949 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-dbe2e0ea-2b4d-4aea-a386-cc4f3743de1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f38118641726493db6024f0cb4562ad4'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:11.314641 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-dbe2e0ea-2b4d-4aea-a386-cc4f3743de1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f38118641726493db6024f0cb4562ad4'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:11.315265 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-dbe2e0ea-2b4d-4aea-a386-cc4f3743de1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f38118641726493db6024f0cb4562ad4'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:11.322495 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-dbe2e0ea-2b4d-4aea-a386-cc4f3743de1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f38118641726493db6024f0cb4562ad4'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:11.342052 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1025/2052] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:26:11 2022] DELETE /identity/v3/users/f38118641726493db6024f0cb4562ad4 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:26:11.515568 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fd82f2-cc76-466e-ae0b-472c6ee2b9cb admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:11.517104 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-79fd82f2-cc76-466e-ae0b-472c6ee2b9cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:26:11.531732 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fd82f2-cc76-466e-ae0b-472c6ee2b9cb admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:11.591582 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6444d28-ba00-4e7d-bd8c-13f199315fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:11.592269 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6444d28-ba00-4e7d-bd8c-13f199315fbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:11.592479 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6444d28-ba00-4e7d-bd8c-13f199315fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:11.592750 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6444d28-ba00-4e7d-bd8c-13f199315fbd admin admin] PATH_INFO: `/v3/projects/273d46dfe5f443d78cd6687d30ef1dc9` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:11.593854 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6444d28-ba00-4e7d-bd8c-13f199315fbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=273d46dfe5f443d78cd6687d30ef1dc9)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:11.595788 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6444d28-ba00-4e7d-bd8c-13f199315fbd admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:11.638659 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:26:11.648193 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-c6444d28-ba00-4e7d-bd8c-13f199315fbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '273d46dfe5f443d78cd6687d30ef1dc9', 'request_id': 'req-c6444d28-ba00-4e7d-bd8c-13f199315fbd'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:11.654198 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-c6444d28-ba00-4e7d-bd8c-13f199315fbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '273d46dfe5f443d78cd6687d30ef1dc9', 'request_id': 'req-c6444d28-ba00-4e7d-bd8c-13f199315fbd'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:11.662804 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-c6444d28-ba00-4e7d-bd8c-13f199315fbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '273d46dfe5f443d78cd6687d30ef1dc9', 'request_id': 'req-c6444d28-ba00-4e7d-bd8c-13f199315fbd'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:11.677753 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-c6444d28-ba00-4e7d-bd8c-13f199315fbd admin admin] The token cache is being invalidate because project 273d46dfe5f443d78cd6687d30ef1dc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:26:11.678045 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-c6444d28-ba00-4e7d-bd8c-13f199315fbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:11.678734 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-c6444d28-ba00-4e7d-bd8c-13f199315fbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:11.680275 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1028/2053] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:26:11 2022] DELETE /identity/v3/projects/273d46dfe5f443d78cd6687d30ef1dc9 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:26:11.685887 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8903c30a-4b93-4bfb-92e0-406934c42c57 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:11.686429 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8903c30a-4b93-4bfb-92e0-406934c42c57 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:11.686429 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8903c30a-4b93-4bfb-92e0-406934c42c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:11.708824 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-8903c30a-4b93-4bfb-92e0-406934c42c57 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:26:11.710820 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-8903c30a-4b93-4bfb-92e0-406934c42c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:26:11.773944 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:26:11.792256 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1026/2054] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:26:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:26:11.793077 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5128cf37-24d7-4b09-b6cf-4f284b01ab0a None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:11.794330 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5128cf37-24d7-4b09-b6cf-4f284b01ab0a None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:11.794553 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5128cf37-24d7-4b09-b6cf-4f284b01ab0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:11.817256 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-5128cf37-24d7-4b09-b6cf-4f284b01ab0a None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:26:11.818521 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-5128cf37-24d7-4b09-b6cf-4f284b01ab0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:26:11.827589 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1029/2055] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:26:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:26:11.831782 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8903c30a-4b93-4bfb-92e0-406934c42c57 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:11.842857 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8903c30a-4b93-4bfb-92e0-406934c42c57 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:11.847833 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3db4ea6-20c2-46f0-af8a-5a8161250a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:11.848431 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3db4ea6-20c2-46f0-af8a-5a8161250a24 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:11.848706 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3db4ea6-20c2-46f0-af8a-5a8161250a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:11.848970 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3db4ea6-20c2-46f0-af8a-5a8161250a24 admin admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:11.850214 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3db4ea6-20c2-46f0-af8a-5a8161250a24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:26:11.850214 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3db4ea6-20c2-46f0-af8a-5a8161250a24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:11.851562 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3db4ea6-20c2-46f0-af8a-5a8161250a24 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:11.865010 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1027/2056] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 15 12:26:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:26:11.869393 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5128cf37-24d7-4b09-b6cf-4f284b01ab0a None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:11.880052 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5128cf37-24d7-4b09-b6cf-4f284b01ab0a None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:11.884644 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2840a2b-6181-4aaf-acdc-ff36f937a8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:11.885245 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2840a2b-6181-4aaf-acdc-ff36f937a8d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:11.885520 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2840a2b-6181-4aaf-acdc-ff36f937a8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:11.885907 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2840a2b-6181-4aaf-acdc-ff36f937a8d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:11.886552 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2840a2b-6181-4aaf-acdc-ff36f937a8d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:11.888561 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2840a2b-6181-4aaf-acdc-ff36f937a8d5 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:11.916836 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1030/2057] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:26:11 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 12:26:11.921249 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3db4ea6-20c2-46f0-af8a-5a8161250a24 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:11.931726 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3db4ea6-20c2-46f0-af8a-5a8161250a24 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:11.999118 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df8498a-a73f-444b-acdd-02aff841edf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:11.999721 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df8498a-a73f-444b-acdd-02aff841edf8 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:11.999998 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df8498a-a73f-444b-acdd-02aff841edf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:12.000271 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df8498a-a73f-444b-acdd-02aff841edf8 admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:12.000963 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df8498a-a73f-444b-acdd-02aff841edf8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:12.003065 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df8498a-a73f-444b-acdd-02aff841edf8 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:12.026522 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1028/2058] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:26:11 2022] POST /identity/v3/users => generated 287 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:26:12.031205 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2840a2b-6181-4aaf-acdc-ff36f937a8d5 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:12.043049 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2840a2b-6181-4aaf-acdc-ff36f937a8d5 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:12.050721 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd22160-237a-4f3e-b1ae-4f8bea4c9a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:12.051514 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd22160-237a-4f3e-b1ae-4f8bea4c9a1c admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:12.051795 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd22160-237a-4f3e-b1ae-4f8bea4c9a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:12.052068 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd22160-237a-4f3e-b1ae-4f8bea4c9a1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:12.052714 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd22160-237a-4f3e-b1ae-4f8bea4c9a1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:12.054330 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd22160-237a-4f3e-b1ae-4f8bea4c9a1c admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:12.065408 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1031/2059] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:26:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:26:12.069989 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df8498a-a73f-444b-acdd-02aff841edf8 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:12.080640 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df8498a-a73f-444b-acdd-02aff841edf8 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:12.086662 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475853cf-9a13-4d86-a39d-e04f3047936d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:12.087426 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475853cf-9a13-4d86-a39d-e04f3047936d admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:12.087750 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475853cf-9a13-4d86-a39d-e04f3047936d admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:12.087978 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475853cf-9a13-4d86-a39d-e04f3047936d admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:12.088863 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475853cf-9a13-4d86-a39d-e04f3047936d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:12.091137 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475853cf-9a13-4d86-a39d-e04f3047936d admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:12.102646 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1029/2060] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:26:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:26:12.107541 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd22160-237a-4f3e-b1ae-4f8bea4c9a1c admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:12.117568 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd22160-237a-4f3e-b1ae-4f8bea4c9a1c admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:12.123111 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb6a5e5-27d1-49e0-a2ac-c36e88e43fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:12.123111 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6a5e5-27d1-49e0-a2ac-c36e88e43fce admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:12.123350 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6a5e5-27d1-49e0-a2ac-c36e88e43fce admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:12.123538 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6a5e5-27d1-49e0-a2ac-c36e88e43fce admin admin] PATH_INFO: `/v3/projects/9cdce3a44d9944d6a6a6107358fc59e0/users/067817c2d23a4bab8530a7f78790958b/roles/9371e5bbc55848949eb951a815f817f2` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:12.140114 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb6a5e5-27d1-49e0-a2ac-c36e88e43fce admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cdce3a44d9944d6a6a6107358fc59e0, user_id=067817c2d23a4bab8530a7f78790958b, role_id=9371e5bbc55848949eb951a815f817f2)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:12.143456 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb6a5e5-27d1-49e0-a2ac-c36e88e43fce admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:12.160345 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1032/2061] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:26:12 2022] PUT /identity/v3/projects/9cdce3a44d9944d6a6a6107358fc59e0/users/067817c2d23a4bab8530a7f78790958b/roles/9371e5bbc55848949eb951a815f817f2 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:26:12.166284 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fb885c-6270-4cf9-8c09-35b1ba6fef2f None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:12.166677 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fb885c-6270-4cf9-8c09-35b1ba6fef2f None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:12.166933 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fb885c-6270-4cf9-8c09-35b1ba6fef2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:12.199532 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-56fb885c-6270-4cf9-8c09-35b1ba6fef2f None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:26:12.200929 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-56fb885c-6270-4cf9-8c09-35b1ba6fef2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:26:12.234142 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb6a5e5-27d1-49e0-a2ac-c36e88e43fce admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:12.236604 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-4eb6a5e5-27d1-49e0-a2ac-c36e88e43fce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:26:12.265788 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1030/2062] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:26:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:26:12.275403 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fb885c-6270-4cf9-8c09-35b1ba6fef2f None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:12.276720 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-56fb885c-6270-4cf9-8c09-35b1ba6fef2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:26:12.305726 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb6a5e5-27d1-49e0-a2ac-c36e88e43fce admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:12.310449 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f0ab6b-f887-4669-ade1-0263b51116f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:12.311104 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f0ab6b-f887-4669-ade1-0263b51116f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:12.311380 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f0ab6b-f887-4669-ade1-0263b51116f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:12.311651 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f0ab6b-f887-4669-ade1-0263b51116f3 admin admin] PATH_INFO: `/v3/users/ffd63e95b5444aa985f9bbf4c470523b` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:12.312760 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f0ab6b-f887-4669-ade1-0263b51116f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffd63e95b5444aa985f9bbf4c470523b)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:12.314673 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f0ab6b-f887-4669-ade1-0263b51116f3 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:12.334538 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fb885c-6270-4cf9-8c09-35b1ba6fef2f None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:12.338304 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae8aeb9-011f-491e-a952-a61552f292a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:12.338935 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae8aeb9-011f-491e-a952-a61552f292a6 service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:12.339213 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae8aeb9-011f-491e-a952-a61552f292a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:12.339484 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae8aeb9-011f-491e-a952-a61552f292a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:12.349623 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae8aeb9-011f-491e-a952-a61552f292a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:12.351085 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae8aeb9-011f-491e-a952-a61552f292a6 service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:12.361873 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1031/2063] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:26:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 12:26:12.362970 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-37f0ab6b-f887-4669-ade1-0263b51116f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffd63e95b5444aa985f9bbf4c470523b'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:12.371004 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-37f0ab6b-f887-4669-ade1-0263b51116f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffd63e95b5444aa985f9bbf4c470523b'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:12.371685 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-37f0ab6b-f887-4669-ade1-0263b51116f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffd63e95b5444aa985f9bbf4c470523b'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:12.372273 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-37f0ab6b-f887-4669-ade1-0263b51116f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffd63e95b5444aa985f9bbf4c470523b'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:12.380074 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-37f0ab6b-f887-4669-ade1-0263b51116f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffd63e95b5444aa985f9bbf4c470523b'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:12.382160 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=84,keystone:DELETE=12,keystone:INSERT=4 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:26:12.401799 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1033/2064] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:26:12 2022] DELETE /identity/v3/users/ffd63e95b5444aa985f9bbf4c470523b => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:26:12.406902 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e7e8e-02eb-44de-86a2-8c3a27abd98c None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:12.407191 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e7e8e-02eb-44de-86a2-8c3a27abd98c None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:12.407493 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e7e8e-02eb-44de-86a2-8c3a27abd98c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:12.420729 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:26:12.427571 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-8d5e7e8e-02eb-44de-86a2-8c3a27abd98c None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:26:12.429238 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-8d5e7e8e-02eb-44de-86a2-8c3a27abd98c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:26:12.491926 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1032/2065] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:26:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:26:12.502141 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f0ab6b-f887-4669-ade1-0263b51116f3 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:12.503639 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-37f0ab6b-f887-4669-ade1-0263b51116f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:26:12.565074 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f0ab6b-f887-4669-ade1-0263b51116f3 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:12.568720 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aca05be-cad2-4b57-b43c-68b1fb5aa8d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:12.569323 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca05be-cad2-4b57-b43c-68b1fb5aa8d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:12.569600 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca05be-cad2-4b57-b43c-68b1fb5aa8d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:12.569869 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca05be-cad2-4b57-b43c-68b1fb5aa8d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:12.579741 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aca05be-cad2-4b57-b43c-68b1fb5aa8d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:12.581187 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aca05be-cad2-4b57-b43c-68b1fb5aa8d6 service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:12.593788 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1034/2066] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:26:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:26:12.958187 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5e7e8e-02eb-44de-86a2-8c3a27abd98c None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:12.960667 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-8d5e7e8e-02eb-44de-86a2-8c3a27abd98c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:26:12.983639 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5e7e8e-02eb-44de-86a2-8c3a27abd98c None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:12.990560 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d2c2f0-a0f3-40f7-8886-b5fb1dd6b013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:12.998839 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d2c2f0-a0f3-40f7-8886-b5fb1dd6b013 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:12.999738 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d2c2f0-a0f3-40f7-8886-b5fb1dd6b013 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:13.000487 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d2c2f0-a0f3-40f7-8886-b5fb1dd6b013 admin admin] PATH_INFO: `/v3/projects/21a1ca691409463b90c292a97388803c` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:13.003533 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d2c2f0-a0f3-40f7-8886-b5fb1dd6b013 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21a1ca691409463b90c292a97388803c)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:13.005567 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d2c2f0-a0f3-40f7-8886-b5fb1dd6b013 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:13.057280 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-e0d2c2f0-a0f3-40f7-8886-b5fb1dd6b013 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21a1ca691409463b90c292a97388803c', 'request_id': 'req-e0d2c2f0-a0f3-40f7-8886-b5fb1dd6b013'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:13.064402 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-e0d2c2f0-a0f3-40f7-8886-b5fb1dd6b013 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21a1ca691409463b90c292a97388803c', 'request_id': 'req-e0d2c2f0-a0f3-40f7-8886-b5fb1dd6b013'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:13.070465 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-e0d2c2f0-a0f3-40f7-8886-b5fb1dd6b013 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21a1ca691409463b90c292a97388803c', 'request_id': 'req-e0d2c2f0-a0f3-40f7-8886-b5fb1dd6b013'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:13.084660 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-e0d2c2f0-a0f3-40f7-8886-b5fb1dd6b013 admin admin] The token cache is being invalidate because project 21a1ca691409463b90c292a97388803c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:26:13.085107 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-e0d2c2f0-a0f3-40f7-8886-b5fb1dd6b013 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:13.085799 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-e0d2c2f0-a0f3-40f7-8886-b5fb1dd6b013 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:13.087332 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1033/2067] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:26:12 2022] DELETE /identity/v3/projects/21a1ca691409463b90c292a97388803c => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:26:13.091565 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aca05be-cad2-4b57-b43c-68b1fb5aa8d6 service neutron] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:13.101550 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aca05be-cad2-4b57-b43c-68b1fb5aa8d6 service neutron] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:13.166582 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534c875-0ff1-43ac-8ebc-780af8e2098d None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:13.166895 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534c875-0ff1-43ac-8ebc-780af8e2098d None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:13.167215 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534c875-0ff1-43ac-8ebc-780af8e2098d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:13.188666 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd55bfa2-835d-4ff0-b227-d0f75f99e368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:13.189435 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd55bfa2-835d-4ff0-b227-d0f75f99e368 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:13.189810 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd55bfa2-835d-4ff0-b227-d0f75f99e368 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:13.190180 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd55bfa2-835d-4ff0-b227-d0f75f99e368 admin admin] PATH_INFO: `/v3/users/fa0992dc4873438490a03d7ae51cd8e2` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:13.191487 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd55bfa2-835d-4ff0-b227-d0f75f99e368 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa0992dc4873438490a03d7ae51cd8e2)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:13.193519 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd55bfa2-835d-4ff0-b227-d0f75f99e368 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:13.214612 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-1534c875-0ff1-43ac-8ebc-780af8e2098d None None] MFA Rules not processed for user `067817c2d23a4bab8530a7f78790958b`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:26:13.217018 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-1534c875-0ff1-43ac-8ebc-780af8e2098d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:26:13.256611 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-cd55bfa2-835d-4ff0-b227-d0f75f99e368 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa0992dc4873438490a03d7ae51cd8e2'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:13.268237 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-cd55bfa2-835d-4ff0-b227-d0f75f99e368 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa0992dc4873438490a03d7ae51cd8e2'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:13.269369 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-cd55bfa2-835d-4ff0-b227-d0f75f99e368 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa0992dc4873438490a03d7ae51cd8e2'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:13.270237 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-cd55bfa2-835d-4ff0-b227-d0f75f99e368 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa0992dc4873438490a03d7ae51cd8e2'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:13.296713 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1034/2068] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:26:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:26:13.299176 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-cd55bfa2-835d-4ff0-b227-d0f75f99e368 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa0992dc4873438490a03d7ae51cd8e2'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:13.311925 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1534c875-0ff1-43ac-8ebc-780af8e2098d None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:13.314324 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-1534c875-0ff1-43ac-8ebc-780af8e2098d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:26:13.327095 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1035/2069] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:26:13 2022] DELETE /identity/v3/users/fa0992dc4873438490a03d7ae51cd8e2 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:26:13.345836 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:26:13.405588 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1534c875-0ff1-43ac-8ebc-780af8e2098d None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:13.471271 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244180b0-c83e-4e40-b892-8e2225b0968d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceafc5e4283841528053f01931f10293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:13.471958 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244180b0-c83e-4e40-b892-8e2225b0968d service cinder] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:13.472242 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244180b0-c83e-4e40-b892-8e2225b0968d service cinder] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:13.472514 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244180b0-c83e-4e40-b892-8e2225b0968d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:13.541927 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244180b0-c83e-4e40-b892-8e2225b0968d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:13.543473 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244180b0-c83e-4e40-b892-8e2225b0968d service cinder] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:13.552955 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1035/2070] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:26:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 12:26:13.625670 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd55bfa2-835d-4ff0-b227-d0f75f99e368 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:13.627517 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-cd55bfa2-835d-4ff0-b227-d0f75f99e368 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:26:13.634716 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:26:13.706334 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd55bfa2-835d-4ff0-b227-d0f75f99e368 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:13.711583 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da75967-b861-4d7d-82c0-18750c60f973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:13.712299 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da75967-b861-4d7d-82c0-18750c60f973 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:13.712573 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da75967-b861-4d7d-82c0-18750c60f973 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:13.712889 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da75967-b861-4d7d-82c0-18750c60f973 admin admin] PATH_INFO: `/v3/projects/5e7fd89ae99b486bb66ebb3c26d818df` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:13.714127 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da75967-b861-4d7d-82c0-18750c60f973 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e7fd89ae99b486bb66ebb3c26d818df)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:13.716607 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da75967-b861-4d7d-82c0-18750c60f973 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:13.772888 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-6da75967-b861-4d7d-82c0-18750c60f973 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e7fd89ae99b486bb66ebb3c26d818df', 'request_id': 'req-6da75967-b861-4d7d-82c0-18750c60f973'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:13.781800 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-6da75967-b861-4d7d-82c0-18750c60f973 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e7fd89ae99b486bb66ebb3c26d818df', 'request_id': 'req-6da75967-b861-4d7d-82c0-18750c60f973'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:13.790358 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-6da75967-b861-4d7d-82c0-18750c60f973 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e7fd89ae99b486bb66ebb3c26d818df', 'request_id': 'req-6da75967-b861-4d7d-82c0-18750c60f973'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:13.805301 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-6da75967-b861-4d7d-82c0-18750c60f973 admin admin] The token cache is being invalidate because project 5e7fd89ae99b486bb66ebb3c26d818df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:26:13.805660 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-6da75967-b861-4d7d-82c0-18750c60f973 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:13.806393 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-6da75967-b861-4d7d-82c0-18750c60f973 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:13.810740 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1036/2071] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:26:13 2022] DELETE /identity/v3/projects/5e7fd89ae99b486bb66ebb3c26d818df => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:26:13.817236 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a430782-0b25-45db-970d-be7ced0bea14 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:13.817519 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a430782-0b25-45db-970d-be7ced0bea14 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:13.817790 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a430782-0b25-45db-970d-be7ced0bea14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:13.847419 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-7a430782-0b25-45db-970d-be7ced0bea14 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:26:13.848862 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-7a430782-0b25-45db-970d-be7ced0bea14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:26:13.926640 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1036/2072] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:26:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:26:13.934918 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4685951-442d-47cc-8a3b-2fefde85ebb9 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:13.935275 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4685951-442d-47cc-8a3b-2fefde85ebb9 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:13.935592 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4685951-442d-47cc-8a3b-2fefde85ebb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:13.956640 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-f4685951-442d-47cc-8a3b-2fefde85ebb9 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:26:13.957841 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-f4685951-442d-47cc-8a3b-2fefde85ebb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:26:13.968485 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1037/2073] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:26:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:26:13.972717 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a430782-0b25-45db-970d-be7ced0bea14 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:13.983718 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a430782-0b25-45db-970d-be7ced0bea14 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:13.988333 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d4abab-f3dc-401f-97fd-4eeb07c6ab51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:13.988931 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4abab-f3dc-401f-97fd-4eeb07c6ab51 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:13.989207 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4abab-f3dc-401f-97fd-4eeb07c6ab51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:13.989475 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4abab-f3dc-401f-97fd-4eeb07c6ab51 admin admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:13.990120 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d4abab-f3dc-401f-97fd-4eeb07c6ab51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:26:13.990423 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d4abab-f3dc-401f-97fd-4eeb07c6ab51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:13.992075 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d4abab-f3dc-401f-97fd-4eeb07c6ab51 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:14.006713 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1037/2074] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 15 12:26:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:26:14.008436 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4685951-442d-47cc-8a3b-2fefde85ebb9 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:14.018229 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4685951-442d-47cc-8a3b-2fefde85ebb9 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:14.024581 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3ca1e0-a2c3-46ef-88fb-3e25e7dccf59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:14.025196 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ca1e0-a2c3-46ef-88fb-3e25e7dccf59 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:14.025477 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ca1e0-a2c3-46ef-88fb-3e25e7dccf59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:14.025750 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ca1e0-a2c3-46ef-88fb-3e25e7dccf59 admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:14.026413 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3ca1e0-a2c3-46ef-88fb-3e25e7dccf59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:14.029022 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3ca1e0-a2c3-46ef-88fb-3e25e7dccf59 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:14.059200 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1038/2075] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:26:14 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:26:14.060304 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d4abab-f3dc-401f-97fd-4eeb07c6ab51 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:14.070523 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d4abab-f3dc-401f-97fd-4eeb07c6ab51 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:14.083456 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:26:14.127692 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee6c0f-ab3e-4544-b9b3-4a913fe480e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:14.128219 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee6c0f-ab3e-4544-b9b3-4a913fe480e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:14.128500 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee6c0f-ab3e-4544-b9b3-4a913fe480e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:14.128770 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee6c0f-ab3e-4544-b9b3-4a913fe480e0 admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:14.129391 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ee6c0f-ab3e-4544-b9b3-4a913fe480e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:14.131331 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ee6c0f-ab3e-4544-b9b3-4a913fe480e0 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:14.153736 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1038/2076] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:26:14 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 12:26:14.158483 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3ca1e0-a2c3-46ef-88fb-3e25e7dccf59 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:14.169425 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3ca1e0-a2c3-46ef-88fb-3e25e7dccf59 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:14.174122 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a61ea9-c65a-4b8a-80fa-3b7055b1cf5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:14.174744 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a61ea9-c65a-4b8a-80fa-3b7055b1cf5e admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:14.175028 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a61ea9-c65a-4b8a-80fa-3b7055b1cf5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:14.175303 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a61ea9-c65a-4b8a-80fa-3b7055b1cf5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:14.175945 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a61ea9-c65a-4b8a-80fa-3b7055b1cf5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:14.177562 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a61ea9-c65a-4b8a-80fa-3b7055b1cf5e admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:14.187432 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1039/2077] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:26:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:26:14.191378 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee6c0f-ab3e-4544-b9b3-4a913fe480e0 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:14.201864 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee6c0f-ab3e-4544-b9b3-4a913fe480e0 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:14.208459 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7b28a2-716b-4807-bc1c-8710845404fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:14.209060 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b28a2-716b-4807-bc1c-8710845404fb admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:14.209339 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b28a2-716b-4807-bc1c-8710845404fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:14.209798 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b28a2-716b-4807-bc1c-8710845404fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:14.210788 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7b28a2-716b-4807-bc1c-8710845404fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:14.212448 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7b28a2-716b-4807-bc1c-8710845404fb admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:14.224500 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1039/2078] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:26:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:26:14.228619 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a61ea9-c65a-4b8a-80fa-3b7055b1cf5e admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:14.243233 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a61ea9-c65a-4b8a-80fa-3b7055b1cf5e admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:14.248787 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b45dc61-9166-46a1-bcbb-4d2a7a1276e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:14.249447 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b45dc61-9166-46a1-bcbb-4d2a7a1276e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:14.249726 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b45dc61-9166-46a1-bcbb-4d2a7a1276e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:14.249998 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b45dc61-9166-46a1-bcbb-4d2a7a1276e8 admin admin] PATH_INFO: `/v3/projects/a541d4f4d78f48cba5c0541dd91cee11/users/94177fe4056e4f05928f9793ef632f78/roles/9371e5bbc55848949eb951a815f817f2` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:14.266082 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b45dc61-9166-46a1-bcbb-4d2a7a1276e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a541d4f4d78f48cba5c0541dd91cee11, user_id=94177fe4056e4f05928f9793ef632f78, role_id=9371e5bbc55848949eb951a815f817f2)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:14.268918 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b45dc61-9166-46a1-bcbb-4d2a7a1276e8 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:14.282478 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1040/2079] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:26:14 2022] PUT /identity/v3/projects/a541d4f4d78f48cba5c0541dd91cee11/users/94177fe4056e4f05928f9793ef632f78/roles/9371e5bbc55848949eb951a815f817f2 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:26:14.293675 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971f63b9-84d8-4d04-89ae-031d14bdee96 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:14.293964 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971f63b9-84d8-4d04-89ae-031d14bdee96 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:14.294244 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971f63b9-84d8-4d04-89ae-031d14bdee96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:14.322477 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-971f63b9-84d8-4d04-89ae-031d14bdee96 None None] MFA Rules not processed for user `94177fe4056e4f05928f9793ef632f78`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:26:14.323730 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-971f63b9-84d8-4d04-89ae-031d14bdee96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:26:14.390012 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1040/2080] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:26:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:26:14.401373 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b45dc61-9166-46a1-bcbb-4d2a7a1276e8 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:14.403098 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-3b45dc61-9166-46a1-bcbb-4d2a7a1276e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:26:14.438098 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:26:14.465383 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b45dc61-9166-46a1-bcbb-4d2a7a1276e8 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:14.469109 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada03399-79db-41f4-a64e-bda5e2ac8b80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceafc5e4283841528053f01931f10293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:14.469806 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada03399-79db-41f4-a64e-bda5e2ac8b80 service cinder] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:14.470091 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada03399-79db-41f4-a64e-bda5e2ac8b80 service cinder] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:14.470364 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada03399-79db-41f4-a64e-bda5e2ac8b80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:14.478997 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada03399-79db-41f4-a64e-bda5e2ac8b80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:14.480436 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada03399-79db-41f4-a64e-bda5e2ac8b80 service cinder] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:14.489289 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1041/2081] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:26:14 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:26:14.511483 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971f63b9-84d8-4d04-89ae-031d14bdee96 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:14.589395 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971f63b9-84d8-4d04-89ae-031d14bdee96 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:14.594919 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b445dbe8-3cf5-4a1c-aa90-b22417214b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:14.595555 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445dbe8-3cf5-4a1c-aa90-b22417214b65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:14.595839 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445dbe8-3cf5-4a1c-aa90-b22417214b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:14.596118 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445dbe8-3cf5-4a1c-aa90-b22417214b65 admin admin] PATH_INFO: `/v3/users/94177fe4056e4f05928f9793ef632f78` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:14.597738 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b445dbe8-3cf5-4a1c-aa90-b22417214b65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94177fe4056e4f05928f9793ef632f78)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:14.600446 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b445dbe8-3cf5-4a1c-aa90-b22417214b65 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:14.633622 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:26:14.657006 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-b445dbe8-3cf5-4a1c-aa90-b22417214b65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94177fe4056e4f05928f9793ef632f78'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:14.665279 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-b445dbe8-3cf5-4a1c-aa90-b22417214b65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94177fe4056e4f05928f9793ef632f78'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:14.665950 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-b445dbe8-3cf5-4a1c-aa90-b22417214b65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94177fe4056e4f05928f9793ef632f78'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:14.666592 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-b445dbe8-3cf5-4a1c-aa90-b22417214b65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94177fe4056e4f05928f9793ef632f78'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:14.678713 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-b445dbe8-3cf5-4a1c-aa90-b22417214b65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94177fe4056e4f05928f9793ef632f78'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:14.696189 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1041/2082] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:26:14 2022] DELETE /identity/v3/users/94177fe4056e4f05928f9793ef632f78 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:26:14.700535 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff39c59-89fc-42a3-bc16-3ef8de83f163 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:14.700985 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff39c59-89fc-42a3-bc16-3ef8de83f163 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:14.701099 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff39c59-89fc-42a3-bc16-3ef8de83f163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:14.720425 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-9ff39c59-89fc-42a3-bc16-3ef8de83f163 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:26:14.721735 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-9ff39c59-89fc-42a3-bc16-3ef8de83f163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:26:14.780801 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1042/2083] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:26:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:26:14.790511 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b445dbe8-3cf5-4a1c-aa90-b22417214b65 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:14.791933 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-b445dbe8-3cf5-4a1c-aa90-b22417214b65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:26:14.848842 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b445dbe8-3cf5-4a1c-aa90-b22417214b65 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:14.852455 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccbd70e-e0e9-4f98-8beb-aa16b6d1e5fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:14.853049 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccbd70e-e0e9-4f98-8beb-aa16b6d1e5fc service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:14.853328 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccbd70e-e0e9-4f98-8beb-aa16b6d1e5fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:14.853598 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccbd70e-e0e9-4f98-8beb-aa16b6d1e5fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:14.863033 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccbd70e-e0e9-4f98-8beb-aa16b6d1e5fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:14.864481 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccbd70e-e0e9-4f98-8beb-aa16b6d1e5fc service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:14.874540 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1042/2084] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:26:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:26:14.954373 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f025deab-aa04-4aeb-8a49-dc3c43e49252 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:14.954880 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f025deab-aa04-4aeb-8a49-dc3c43e49252 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:14.955252 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f025deab-aa04-4aeb-8a49-dc3c43e49252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:14.979975 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-f025deab-aa04-4aeb-8a49-dc3c43e49252 None None] MFA Rules not processed for user `067817c2d23a4bab8530a7f78790958b`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:26:14.981974 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-f025deab-aa04-4aeb-8a49-dc3c43e49252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:26:15.039935 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1043/2085] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:26:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:26:15.162581 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccbd70e-e0e9-4f98-8beb-aa16b6d1e5fc service neutron] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:15.164122 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-bccbd70e-e0e9-4f98-8beb-aa16b6d1e5fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:26:15.179589 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccbd70e-e0e9-4f98-8beb-aa16b6d1e5fc service neutron] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:15.187024 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7052ed4-0de2-4438-bdc0-2321d9935ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:15.187661 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7052ed4-0de2-4438-bdc0-2321d9935ec8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:15.187942 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7052ed4-0de2-4438-bdc0-2321d9935ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:15.188219 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7052ed4-0de2-4438-bdc0-2321d9935ec8 admin admin] PATH_INFO: `/v3/projects/a541d4f4d78f48cba5c0541dd91cee11` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:15.189384 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7052ed4-0de2-4438-bdc0-2321d9935ec8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a541d4f4d78f48cba5c0541dd91cee11)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:15.191336 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7052ed4-0de2-4438-bdc0-2321d9935ec8 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:15.242964 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-c7052ed4-0de2-4438-bdc0-2321d9935ec8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a541d4f4d78f48cba5c0541dd91cee11', 'request_id': 'req-c7052ed4-0de2-4438-bdc0-2321d9935ec8'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:15.249629 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-c7052ed4-0de2-4438-bdc0-2321d9935ec8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a541d4f4d78f48cba5c0541dd91cee11', 'request_id': 'req-c7052ed4-0de2-4438-bdc0-2321d9935ec8'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:15.259154 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-c7052ed4-0de2-4438-bdc0-2321d9935ec8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a541d4f4d78f48cba5c0541dd91cee11', 'request_id': 'req-c7052ed4-0de2-4438-bdc0-2321d9935ec8'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:15.272941 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-c7052ed4-0de2-4438-bdc0-2321d9935ec8 admin admin] The token cache is being invalidate because project a541d4f4d78f48cba5c0541dd91cee11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:26:15.273383 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-c7052ed4-0de2-4438-bdc0-2321d9935ec8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:15.274213 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-c7052ed4-0de2-4438-bdc0-2321d9935ec8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:15.276603 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1043/2086] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:26:15 2022] DELETE /identity/v3/projects/a541d4f4d78f48cba5c0541dd91cee11 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:26:15.284157 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d2503-cc3e-49a1-8b1f-daeb44821055 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:15.284445 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d2503-cc3e-49a1-8b1f-daeb44821055 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:15.284754 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d2503-cc3e-49a1-8b1f-daeb44821055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:15.311165 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-079d2503-cc3e-49a1-8b1f-daeb44821055 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:26:15.312362 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-079d2503-cc3e-49a1-8b1f-daeb44821055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:26:15.374597 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1044/2087] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:26:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:26:15.382528 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7554d2d-125a-4f31-b896-4db39bffaec3 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:15.382845 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7554d2d-125a-4f31-b896-4db39bffaec3 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:15.383131 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7554d2d-125a-4f31-b896-4db39bffaec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:15.405692 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-a7554d2d-125a-4f31-b896-4db39bffaec3 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:26:15.406853 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-a7554d2d-125a-4f31-b896-4db39bffaec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:26:15.414668 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1044/2088] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:26:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:26:15.418890 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079d2503-cc3e-49a1-8b1f-daeb44821055 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:15.428271 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079d2503-cc3e-49a1-8b1f-daeb44821055 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:15.432865 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c722aaa-5457-49fe-9f22-ff230fd07228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:15.433461 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c722aaa-5457-49fe-9f22-ff230fd07228 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:15.433737 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c722aaa-5457-49fe-9f22-ff230fd07228 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:15.434003 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c722aaa-5457-49fe-9f22-ff230fd07228 admin admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:15.434639 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c722aaa-5457-49fe-9f22-ff230fd07228 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:26:15.434968 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c722aaa-5457-49fe-9f22-ff230fd07228 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:15.436545 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c722aaa-5457-49fe-9f22-ff230fd07228 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:15.448456 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1045/2089] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 15 12:26:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:26:15.453245 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7554d2d-125a-4f31-b896-4db39bffaec3 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:15.462494 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7554d2d-125a-4f31-b896-4db39bffaec3 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:15.467857 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e69a84-ddf1-4ee1-a2dd-0b0304815e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:15.468483 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e69a84-ddf1-4ee1-a2dd-0b0304815e0d admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:15.468763 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e69a84-ddf1-4ee1-a2dd-0b0304815e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:15.469030 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e69a84-ddf1-4ee1-a2dd-0b0304815e0d admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:15.469668 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e69a84-ddf1-4ee1-a2dd-0b0304815e0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:15.471596 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e69a84-ddf1-4ee1-a2dd-0b0304815e0d admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:15.502048 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1045/2090] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:26:15 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:26:15.506080 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c722aaa-5457-49fe-9f22-ff230fd07228 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:15.516571 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c722aaa-5457-49fe-9f22-ff230fd07228 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:15.520197 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:26:15.598069 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81582d4d-3e00-4310-a8a0-30659c38138c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:15.599195 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81582d4d-3e00-4310-a8a0-30659c38138c admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:15.599672 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81582d4d-3e00-4310-a8a0-30659c38138c admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:15.600127 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81582d4d-3e00-4310-a8a0-30659c38138c admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:15.601429 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81582d4d-3e00-4310-a8a0-30659c38138c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:15.604236 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81582d4d-3e00-4310-a8a0-30659c38138c admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:15.637347 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1046/2091] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:26:15 2022] POST /identity/v3/users => generated 289 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:26:15.640965 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e69a84-ddf1-4ee1-a2dd-0b0304815e0d admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:15.649395 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:26:15.656321 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e69a84-ddf1-4ee1-a2dd-0b0304815e0d admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:15.662140 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80162e4-c5df-4d4a-95cc-df28f753d573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:15.662857 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80162e4-c5df-4d4a-95cc-df28f753d573 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:15.663283 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80162e4-c5df-4d4a-95cc-df28f753d573 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:15.663676 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80162e4-c5df-4d4a-95cc-df28f753d573 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:15.664406 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80162e4-c5df-4d4a-95cc-df28f753d573 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:15.666052 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80162e4-c5df-4d4a-95cc-df28f753d573 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:15.681223 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1046/2092] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:26:15 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:26:15.684381 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81582d4d-3e00-4310-a8a0-30659c38138c admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:15.695831 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81582d4d-3e00-4310-a8a0-30659c38138c admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:15.702601 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7ab6d0-14e8-4341-bd47-b02e48b4b81c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:15.704266 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ab6d0-14e8-4341-bd47-b02e48b4b81c admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:15.704691 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ab6d0-14e8-4341-bd47-b02e48b4b81c admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:15.705120 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ab6d0-14e8-4341-bd47-b02e48b4b81c admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:15.706361 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7ab6d0-14e8-4341-bd47-b02e48b4b81c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:15.708589 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7ab6d0-14e8-4341-bd47-b02e48b4b81c admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:15.739345 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1047/2093] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:26:15 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:26:15.740920 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80162e4-c5df-4d4a-95cc-df28f753d573 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:15.763836 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80162e4-c5df-4d4a-95cc-df28f753d573 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:15.772912 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294575a9-b92b-453f-827c-19670943ebec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:15.773827 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294575a9-b92b-453f-827c-19670943ebec admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:15.774265 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294575a9-b92b-453f-827c-19670943ebec admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:15.774672 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294575a9-b92b-453f-827c-19670943ebec admin admin] PATH_INFO: `/v3/projects/dcb558936d554997bf596901bdd456bf/users/bc33eec47b0847bfa9265efe66863b4b/roles/9371e5bbc55848949eb951a815f817f2` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:15.793961 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294575a9-b92b-453f-827c-19670943ebec admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcb558936d554997bf596901bdd456bf, user_id=bc33eec47b0847bfa9265efe66863b4b, role_id=9371e5bbc55848949eb951a815f817f2)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:15.796920 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294575a9-b92b-453f-827c-19670943ebec admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:15.814515 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1047/2094] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:26:15 2022] PUT /identity/v3/projects/dcb558936d554997bf596901bdd456bf/users/bc33eec47b0847bfa9265efe66863b4b/roles/9371e5bbc55848949eb951a815f817f2 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:26:15.824586 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a75ba9a-06f3-4238-ac1e-9e0f4d795e3a None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:15.825676 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a75ba9a-06f3-4238-ac1e-9e0f4d795e3a None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:15.826077 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a75ba9a-06f3-4238-ac1e-9e0f4d795e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:15.854644 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-1a75ba9a-06f3-4238-ac1e-9e0f4d795e3a None None] MFA Rules not processed for user `bc33eec47b0847bfa9265efe66863b4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:26:15.856516 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-1a75ba9a-06f3-4238-ac1e-9e0f4d795e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:26:15.929203 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1048/2095] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:26:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:26:15.937966 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294575a9-b92b-453f-827c-19670943ebec admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:15.941046 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-294575a9-b92b-453f-827c-19670943ebec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:26:16.022829 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294575a9-b92b-453f-827c-19670943ebec admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:16.027145 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63701a98-4a5e-4474-ac8d-a28cce22113b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceafc5e4283841528053f01931f10293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:16.028287 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63701a98-4a5e-4474-ac8d-a28cce22113b service cinder] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:16.028566 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63701a98-4a5e-4474-ac8d-a28cce22113b service cinder] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:16.028839 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63701a98-4a5e-4474-ac8d-a28cce22113b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:16.038406 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63701a98-4a5e-4474-ac8d-a28cce22113b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:16.040139 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63701a98-4a5e-4474-ac8d-a28cce22113b service cinder] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:16.050444 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1048/2096] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:26:15 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:26:18.006167 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a75ba9a-06f3-4238-ac1e-9e0f4d795e3a None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:18.007631 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-1a75ba9a-06f3-4238-ac1e-9e0f4d795e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:26:18.088027 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a75ba9a-06f3-4238-ac1e-9e0f4d795e3a None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:18.093392 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5995bc41-ac60-4073-84ac-37f1355b5dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:18.094339 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5995bc41-ac60-4073-84ac-37f1355b5dec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:18.094778 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5995bc41-ac60-4073-84ac-37f1355b5dec admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:18.095068 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5995bc41-ac60-4073-84ac-37f1355b5dec admin admin] PATH_INFO: `/v3/users/3d15cf3c29ee4f1d818e0252633d118b` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:18.096150 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5995bc41-ac60-4073-84ac-37f1355b5dec admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d15cf3c29ee4f1d818e0252633d118b)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:18.098055 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5995bc41-ac60-4073-84ac-37f1355b5dec admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:18.122745 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:26:18.165840 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-5995bc41-ac60-4073-84ac-37f1355b5dec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d15cf3c29ee4f1d818e0252633d118b'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:18.180295 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-5995bc41-ac60-4073-84ac-37f1355b5dec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d15cf3c29ee4f1d818e0252633d118b'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:18.182668 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-5995bc41-ac60-4073-84ac-37f1355b5dec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d15cf3c29ee4f1d818e0252633d118b'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:18.183075 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-5995bc41-ac60-4073-84ac-37f1355b5dec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d15cf3c29ee4f1d818e0252633d118b'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:18.192496 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-5995bc41-ac60-4073-84ac-37f1355b5dec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d15cf3c29ee4f1d818e0252633d118b'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:18.227847 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1049/2097] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:26:18 2022] DELETE /identity/v3/users/3d15cf3c29ee4f1d818e0252633d118b => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:26:18.232403 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f895f-455f-4086-9c25-28dd87dab7b8 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:18.232905 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f895f-455f-4086-9c25-28dd87dab7b8 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:18.233715 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f895f-455f-4086-9c25-28dd87dab7b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:18.253625 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-d29f895f-455f-4086-9c25-28dd87dab7b8 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:26:18.254934 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-d29f895f-455f-4086-9c25-28dd87dab7b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:26:18.322388 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1049/2098] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:26:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:26:18.332699 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5995bc41-ac60-4073-84ac-37f1355b5dec admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:18.334118 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-5995bc41-ac60-4073-84ac-37f1355b5dec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:26:18.395734 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5995bc41-ac60-4073-84ac-37f1355b5dec admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:18.399557 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3596d56d-e45f-443f-a221-e2c864e65dae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:18.400207 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3596d56d-e45f-443f-a221-e2c864e65dae service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:18.400468 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3596d56d-e45f-443f-a221-e2c864e65dae service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:18.400731 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3596d56d-e45f-443f-a221-e2c864e65dae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:18.409765 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3596d56d-e45f-443f-a221-e2c864e65dae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:18.411241 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3596d56d-e45f-443f-a221-e2c864e65dae service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:18.420975 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1050/2099] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:26:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:26:18.705060 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29f895f-455f-4086-9c25-28dd87dab7b8 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:18.707195 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-d29f895f-455f-4086-9c25-28dd87dab7b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:26:18.724078 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29f895f-455f-4086-9c25-28dd87dab7b8 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:18.730886 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d11005-b185-46a6-8d12-9898f505f16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:18.731566 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d11005-b185-46a6-8d12-9898f505f16d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:18.732458 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d11005-b185-46a6-8d12-9898f505f16d admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:18.732744 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d11005-b185-46a6-8d12-9898f505f16d admin admin] PATH_INFO: `/v3/projects/f521bff7b33342eb9d2cd7e4a0924de9` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:18.734053 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d11005-b185-46a6-8d12-9898f505f16d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f521bff7b33342eb9d2cd7e4a0924de9)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:18.736385 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d11005-b185-46a6-8d12-9898f505f16d admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:18.794005 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-a9d11005-b185-46a6-8d12-9898f505f16d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f521bff7b33342eb9d2cd7e4a0924de9', 'request_id': 'req-a9d11005-b185-46a6-8d12-9898f505f16d'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:18.800550 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-a9d11005-b185-46a6-8d12-9898f505f16d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f521bff7b33342eb9d2cd7e4a0924de9', 'request_id': 'req-a9d11005-b185-46a6-8d12-9898f505f16d'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:18.806708 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-a9d11005-b185-46a6-8d12-9898f505f16d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f521bff7b33342eb9d2cd7e4a0924de9', 'request_id': 'req-a9d11005-b185-46a6-8d12-9898f505f16d'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:18.810034 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:26:18.824473 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-a9d11005-b185-46a6-8d12-9898f505f16d admin admin] The token cache is being invalidate because project f521bff7b33342eb9d2cd7e4a0924de9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:26:18.825215 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-a9d11005-b185-46a6-8d12-9898f505f16d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:18.841873 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-a9d11005-b185-46a6-8d12-9898f505f16d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:18.843788 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1050/2100] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:26:18 2022] DELETE /identity/v3/projects/f521bff7b33342eb9d2cd7e4a0924de9 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:26:18.848361 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa674305-4c15-4694-b09f-cb68ccfd4144 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:18.848847 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa674305-4c15-4694-b09f-cb68ccfd4144 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:18.849121 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa674305-4c15-4694-b09f-cb68ccfd4144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:18.872681 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-aa674305-4c15-4694-b09f-cb68ccfd4144 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:26:18.873896 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-aa674305-4c15-4694-b09f-cb68ccfd4144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:26:18.938345 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1051/2101] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:26:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:26:18.946255 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1cd865-0f61-4071-add4-d3b6ec16da5c None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:18.946544 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1cd865-0f61-4071-add4-d3b6ec16da5c None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:18.946852 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1cd865-0f61-4071-add4-d3b6ec16da5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:18.969040 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-fb1cd865-0f61-4071-add4-d3b6ec16da5c None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:26:18.970573 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-fb1cd865-0f61-4071-add4-d3b6ec16da5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:26:18.985886 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1051/2102] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:26:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:26:18.987871 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa674305-4c15-4694-b09f-cb68ccfd4144 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:19.000131 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa674305-4c15-4694-b09f-cb68ccfd4144 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:19.005157 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beef1e58-6efe-41e8-b7de-5f7834956df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:19.005776 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beef1e58-6efe-41e8-b7de-5f7834956df8 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:19.006056 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beef1e58-6efe-41e8-b7de-5f7834956df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:19.006328 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beef1e58-6efe-41e8-b7de-5f7834956df8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:19.007067 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beef1e58-6efe-41e8-b7de-5f7834956df8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:26:19.007373 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beef1e58-6efe-41e8-b7de-5f7834956df8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:19.009154 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beef1e58-6efe-41e8-b7de-5f7834956df8 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:19.021749 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1052/2103] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 15 12:26:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:26:19.026170 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1cd865-0f61-4071-add4-d3b6ec16da5c None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:19.037605 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1cd865-0f61-4071-add4-d3b6ec16da5c None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:19.042293 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0abb44d-21e8-40b2-8bc6-54ab4c07acca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:19.043587 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0abb44d-21e8-40b2-8bc6-54ab4c07acca admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:19.043953 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0abb44d-21e8-40b2-8bc6-54ab4c07acca admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:19.044293 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0abb44d-21e8-40b2-8bc6-54ab4c07acca admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:19.044989 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0abb44d-21e8-40b2-8bc6-54ab4c07acca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:19.046956 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0abb44d-21e8-40b2-8bc6-54ab4c07acca admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:19.075747 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1052/2104] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:26:19 2022] POST /identity/v3/projects => generated 391 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 12:26:19.079852 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beef1e58-6efe-41e8-b7de-5f7834956df8 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:19.093137 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beef1e58-6efe-41e8-b7de-5f7834956df8 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:19.113815 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:26:19.154297 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ff89b-bafe-4204-9eb3-de388574e704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:19.154964 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ff89b-bafe-4204-9eb3-de388574e704 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:19.155244 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ff89b-bafe-4204-9eb3-de388574e704 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:19.155515 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ff89b-bafe-4204-9eb3-de388574e704 admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:19.156152 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336ff89b-bafe-4204-9eb3-de388574e704 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:19.158052 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336ff89b-bafe-4204-9eb3-de388574e704 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:19.179650 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1053/2105] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:26:19 2022] POST /identity/v3/users => generated 296 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 12:26:19.184497 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0abb44d-21e8-40b2-8bc6-54ab4c07acca admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:19.195064 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0abb44d-21e8-40b2-8bc6-54ab4c07acca admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:19.199652 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5642d29a-3496-4b0e-93ae-b3f187e2429d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:19.200272 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5642d29a-3496-4b0e-93ae-b3f187e2429d admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:19.200553 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5642d29a-3496-4b0e-93ae-b3f187e2429d admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:19.200833 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5642d29a-3496-4b0e-93ae-b3f187e2429d admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:19.201477 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5642d29a-3496-4b0e-93ae-b3f187e2429d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:19.203127 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5642d29a-3496-4b0e-93ae-b3f187e2429d admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:19.213071 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1053/2106] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:26:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:26:19.216923 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ff89b-bafe-4204-9eb3-de388574e704 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:19.226590 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ff89b-bafe-4204-9eb3-de388574e704 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:19.231649 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12f8d09-6a9e-4d1b-9e68-8b6c4bf7239f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:19.232228 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f8d09-6a9e-4d1b-9e68-8b6c4bf7239f admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:19.232507 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f8d09-6a9e-4d1b-9e68-8b6c4bf7239f admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:19.232776 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f8d09-6a9e-4d1b-9e68-8b6c4bf7239f admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:19.233405 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12f8d09-6a9e-4d1b-9e68-8b6c4bf7239f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:19.235050 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12f8d09-6a9e-4d1b-9e68-8b6c4bf7239f admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:19.244625 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1054/2107] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:26:19 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:26:19.249175 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5642d29a-3496-4b0e-93ae-b3f187e2429d admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:19.259215 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5642d29a-3496-4b0e-93ae-b3f187e2429d admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:19.263801 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e47dd-4a67-4828-be99-fbae499df7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:19.264428 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e47dd-4a67-4828-be99-fbae499df7b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:19.264709 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e47dd-4a67-4828-be99-fbae499df7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:19.264982 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e47dd-4a67-4828-be99-fbae499df7b0 admin admin] PATH_INFO: `/v3/projects/9692df4337314150bc4d6f312332a171/users/1f00df5fcb28478ab1cbd6d5c53073c5/roles/9371e5bbc55848949eb951a815f817f2` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:19.279138 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746e47dd-4a67-4828-be99-fbae499df7b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9692df4337314150bc4d6f312332a171, user_id=1f00df5fcb28478ab1cbd6d5c53073c5, role_id=9371e5bbc55848949eb951a815f817f2)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:19.281780 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746e47dd-4a67-4828-be99-fbae499df7b0 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:19.294859 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1054/2108] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:26:19 2022] PUT /identity/v3/projects/9692df4337314150bc4d6f312332a171/users/1f00df5fcb28478ab1cbd6d5c53073c5/roles/9371e5bbc55848949eb951a815f817f2 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:26:19.304851 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc7f10a-6341-4454-b9dd-81b1ea62553b None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:19.305188 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc7f10a-6341-4454-b9dd-81b1ea62553b None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:19.305463 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc7f10a-6341-4454-b9dd-81b1ea62553b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:19.335929 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-abc7f10a-6341-4454-b9dd-81b1ea62553b None None] MFA Rules not processed for user `1f00df5fcb28478ab1cbd6d5c53073c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:26:19.337353 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-abc7f10a-6341-4454-b9dd-81b1ea62553b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:26:19.406547 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1055/2109] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:26:19 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:26:19.417978 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e47dd-4a67-4828-be99-fbae499df7b0 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:19.419674 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-746e47dd-4a67-4828-be99-fbae499df7b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:26:19.481847 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e47dd-4a67-4828-be99-fbae499df7b0 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:19.485401 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db167bcd-c54d-4542-a056-143b1a5c80a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceafc5e4283841528053f01931f10293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:19.486002 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db167bcd-c54d-4542-a056-143b1a5c80a7 service cinder] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:19.486276 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db167bcd-c54d-4542-a056-143b1a5c80a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:19.486563 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db167bcd-c54d-4542-a056-143b1a5c80a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:19.494570 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db167bcd-c54d-4542-a056-143b1a5c80a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:19.496526 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db167bcd-c54d-4542-a056-143b1a5c80a7 service cinder] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:19.505392 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1055/2110] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:26:19 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:26:24.672572 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d96164-865d-4da4-a33b-45ee9bcbc300 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:24.673055 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d96164-865d-4da4-a33b-45ee9bcbc300 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:24.673142 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d96164-865d-4da4-a33b-45ee9bcbc300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:24.693481 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-16d96164-865d-4da4-a33b-45ee9bcbc300 None None] MFA Rules not processed for user `fc120edcf30a4775a502c8e31811da4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:26:24.694665 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-16d96164-865d-4da4-a33b-45ee9bcbc300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:26:24.768711 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1056/2111] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:26:24 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:26:29.501198 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:DELETE=1,keystone:SELECT=55,keystone:INSERT=2 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:26:29.741341 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db167bcd-c54d-4542-a056-143b1a5c80a7 service cinder] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:29.809896 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db167bcd-c54d-4542-a056-143b1a5c80a7 service cinder] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:29.814245 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585be9aa-6109-460e-8d3a-bb8b9b52c9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:29.814921 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585be9aa-6109-460e-8d3a-bb8b9b52c9b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:29.815204 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585be9aa-6109-460e-8d3a-bb8b9b52c9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:29.815475 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585be9aa-6109-460e-8d3a-bb8b9b52c9b5 admin admin] PATH_INFO: `/v3/users/1f00df5fcb28478ab1cbd6d5c53073c5` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:29.816765 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585be9aa-6109-460e-8d3a-bb8b9b52c9b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f00df5fcb28478ab1cbd6d5c53073c5)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:29.818702 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585be9aa-6109-460e-8d3a-bb8b9b52c9b5 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:29.864675 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-585be9aa-6109-460e-8d3a-bb8b9b52c9b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f00df5fcb28478ab1cbd6d5c53073c5'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:29.872392 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-585be9aa-6109-460e-8d3a-bb8b9b52c9b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f00df5fcb28478ab1cbd6d5c53073c5'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:29.873122 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-585be9aa-6109-460e-8d3a-bb8b9b52c9b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f00df5fcb28478ab1cbd6d5c53073c5'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:29.873741 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-585be9aa-6109-460e-8d3a-bb8b9b52c9b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f00df5fcb28478ab1cbd6d5c53073c5'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:29.881288 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-585be9aa-6109-460e-8d3a-bb8b9b52c9b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f00df5fcb28478ab1cbd6d5c53073c5'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:29.900117 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1056/2112] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:26:29 2022] DELETE /identity/v3/users/1f00df5fcb28478ab1cbd6d5c53073c5 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:26:29.904540 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d017d-7f3e-4c37-9295-824d3c68a8f0 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:29.905043 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d017d-7f3e-4c37-9295-824d3c68a8f0 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:29.905148 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d017d-7f3e-4c37-9295-824d3c68a8f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:29.924429 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-196d017d-7f3e-4c37-9295-824d3c68a8f0 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:26:29.925621 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-196d017d-7f3e-4c37-9295-824d3c68a8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:26:29.957371 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:26:29.986731 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1057/2113] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:26:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:26:29.997180 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585be9aa-6109-460e-8d3a-bb8b9b52c9b5 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:29.998989 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-585be9aa-6109-460e-8d3a-bb8b9b52c9b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:26:30.061701 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585be9aa-6109-460e-8d3a-bb8b9b52c9b5 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:30.065567 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b317ce2a-ec89-4457-8a9e-1b56471a17ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:30.066241 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b317ce2a-ec89-4457-8a9e-1b56471a17ad service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:30.067677 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b317ce2a-ec89-4457-8a9e-1b56471a17ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:30.067988 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b317ce2a-ec89-4457-8a9e-1b56471a17ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:30.081711 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b317ce2a-ec89-4457-8a9e-1b56471a17ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:30.083186 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b317ce2a-ec89-4457-8a9e-1b56471a17ad service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:30.094085 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1057/2114] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:26:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:26:30.435726 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196d017d-7f3e-4c37-9295-824d3c68a8f0 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:30.437536 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-196d017d-7f3e-4c37-9295-824d3c68a8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:26:30.455139 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196d017d-7f3e-4c37-9295-824d3c68a8f0 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:30.459895 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9cfc9e-fd61-4f0e-af02-3fdb4b83292b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:30.460519 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9cfc9e-fd61-4f0e-af02-3fdb4b83292b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:30.460793 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9cfc9e-fd61-4f0e-af02-3fdb4b83292b admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:30.461058 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9cfc9e-fd61-4f0e-af02-3fdb4b83292b admin admin] PATH_INFO: `/v3/projects/9692df4337314150bc4d6f312332a171` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:30.462339 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9cfc9e-fd61-4f0e-af02-3fdb4b83292b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9692df4337314150bc4d6f312332a171)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:30.464394 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9cfc9e-fd61-4f0e-af02-3fdb4b83292b admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:30.513664 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-9b9cfc9e-fd61-4f0e-af02-3fdb4b83292b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9692df4337314150bc4d6f312332a171', 'request_id': 'req-9b9cfc9e-fd61-4f0e-af02-3fdb4b83292b'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:30.519336 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-9b9cfc9e-fd61-4f0e-af02-3fdb4b83292b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9692df4337314150bc4d6f312332a171', 'request_id': 'req-9b9cfc9e-fd61-4f0e-af02-3fdb4b83292b'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:30.527577 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-9b9cfc9e-fd61-4f0e-af02-3fdb4b83292b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9692df4337314150bc4d6f312332a171', 'request_id': 'req-9b9cfc9e-fd61-4f0e-af02-3fdb4b83292b'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:30.538497 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-9b9cfc9e-fd61-4f0e-af02-3fdb4b83292b admin admin] The token cache is being invalidate because project 9692df4337314150bc4d6f312332a171 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:26:30.538833 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-9b9cfc9e-fd61-4f0e-af02-3fdb4b83292b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:30.539445 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-9b9cfc9e-fd61-4f0e-af02-3fdb4b83292b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:30.540895 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1058/2115] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:26:30 2022] DELETE /identity/v3/projects/9692df4337314150bc4d6f312332a171 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:26:30.546358 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430cc49e-ad8e-463c-9eee-df9b3deb1a81 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:30.546872 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430cc49e-ad8e-463c-9eee-df9b3deb1a81 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:30.546967 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430cc49e-ad8e-463c-9eee-df9b3deb1a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:30.566716 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-430cc49e-ad8e-463c-9eee-df9b3deb1a81 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:26:30.567919 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-430cc49e-ad8e-463c-9eee-df9b3deb1a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:26:30.584179 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:26:30.629249 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1058/2116] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:26:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:26:30.637317 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0169f18c-c297-4d83-9712-b42582e1b28c None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:30.637600 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0169f18c-c297-4d83-9712-b42582e1b28c None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:30.637873 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0169f18c-c297-4d83-9712-b42582e1b28c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:30.657453 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-0169f18c-c297-4d83-9712-b42582e1b28c None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:26:30.658650 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-0169f18c-c297-4d83-9712-b42582e1b28c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:26:30.666729 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1059/2117] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:26:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:26:30.671233 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430cc49e-ad8e-463c-9eee-df9b3deb1a81 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:30.680828 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430cc49e-ad8e-463c-9eee-df9b3deb1a81 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:30.685894 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c307747-195b-4f6c-832d-9056b2e3c01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:30.686483 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c307747-195b-4f6c-832d-9056b2e3c01c admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:30.686799 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c307747-195b-4f6c-832d-9056b2e3c01c admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:30.687069 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c307747-195b-4f6c-832d-9056b2e3c01c admin admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:30.687733 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c307747-195b-4f6c-832d-9056b2e3c01c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:26:30.688032 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c307747-195b-4f6c-832d-9056b2e3c01c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:30.689608 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c307747-195b-4f6c-832d-9056b2e3c01c admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:30.701023 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1059/2118] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 15 12:26:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:26:30.705154 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0169f18c-c297-4d83-9712-b42582e1b28c None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:30.716147 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0169f18c-c297-4d83-9712-b42582e1b28c None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:30.723278 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd96f18-a562-4800-a084-954b95e11270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:30.724960 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd96f18-a562-4800-a084-954b95e11270 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:30.724960 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd96f18-a562-4800-a084-954b95e11270 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:30.724960 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd96f18-a562-4800-a084-954b95e11270 admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:30.725271 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd96f18-a562-4800-a084-954b95e11270 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:30.728078 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd96f18-a562-4800-a084-954b95e11270 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:30.773547 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1060/2119] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:26:30 2022] POST /identity/v3/projects => generated 397 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:26:30.778027 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c307747-195b-4f6c-832d-9056b2e3c01c admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:30.791211 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c307747-195b-4f6c-832d-9056b2e3c01c admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:30.856681 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ecc3e9-d1de-4a2b-9a0a-782a8339bc8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:30.857173 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ecc3e9-d1de-4a2b-9a0a-782a8339bc8e admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:30.857452 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ecc3e9-d1de-4a2b-9a0a-782a8339bc8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:30.857726 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ecc3e9-d1de-4a2b-9a0a-782a8339bc8e admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:30.858350 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ecc3e9-d1de-4a2b-9a0a-782a8339bc8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:30.860282 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ecc3e9-d1de-4a2b-9a0a-782a8339bc8e admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:30.873639 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd96f18-a562-4800-a084-954b95e11270 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:30.875554 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-cbd96f18-a562-4800-a084-954b95e11270 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:26:30.886039 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1060/2120] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:26:30 2022] POST /identity/v3/users => generated 299 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:26:30.887210 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ecc3e9-d1de-4a2b-9a0a-782a8339bc8e admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:30.889689 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd96f18-a562-4800-a084-954b95e11270 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:30.894438 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c33592-e199-4440-9b08-c05ba50829af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:30.895100 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c33592-e199-4440-9b08-c05ba50829af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:30.895377 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c33592-e199-4440-9b08-c05ba50829af admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:30.895648 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c33592-e199-4440-9b08-c05ba50829af admin admin] PATH_INFO: `/v3/users/bc33eec47b0847bfa9265efe66863b4b` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:30.896644 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ecc3e9-d1de-4a2b-9a0a-782a8339bc8e admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:30.896774 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c33592-e199-4440-9b08-c05ba50829af admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc33eec47b0847bfa9265efe66863b4b)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:30.898708 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c33592-e199-4440-9b08-c05ba50829af admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:30.901357 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07f3f86-f307-4a08-914d-0069f466cdd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:30.901929 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07f3f86-f307-4a08-914d-0069f466cdd2 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:30.902211 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07f3f86-f307-4a08-914d-0069f466cdd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:30.903033 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07f3f86-f307-4a08-914d-0069f466cdd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:30.903661 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07f3f86-f307-4a08-914d-0069f466cdd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:30.905356 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07f3f86-f307-4a08-914d-0069f466cdd2 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:30.918764 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1061/2121] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:26:30.920754 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07f3f86-f307-4a08-914d-0069f466cdd2 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:30.931024 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07f3f86-f307-4a08-914d-0069f466cdd2 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:30.936541 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48754e8b-ea0d-40a8-be3e-f27c46761c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:30.937127 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48754e8b-ea0d-40a8-be3e-f27c46761c34 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:30.937406 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48754e8b-ea0d-40a8-be3e-f27c46761c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:30.937676 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48754e8b-ea0d-40a8-be3e-f27c46761c34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:30.938302 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48754e8b-ea0d-40a8-be3e-f27c46761c34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:30.939918 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48754e8b-ea0d-40a8-be3e-f27c46761c34 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:30.947106 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-42c33592-e199-4440-9b08-c05ba50829af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc33eec47b0847bfa9265efe66863b4b'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:30.950025 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1062/2122] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 12:26:30.954209 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48754e8b-ea0d-40a8-be3e-f27c46761c34 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:30.955785 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-42c33592-e199-4440-9b08-c05ba50829af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc33eec47b0847bfa9265efe66863b4b'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:30.956489 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-42c33592-e199-4440-9b08-c05ba50829af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc33eec47b0847bfa9265efe66863b4b'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:30.957108 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-42c33592-e199-4440-9b08-c05ba50829af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc33eec47b0847bfa9265efe66863b4b'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:30.963900 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48754e8b-ea0d-40a8-be3e-f27c46761c34 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:30.969055 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dcc99c-97aa-4f7e-9659-d602908091ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:30.969696 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dcc99c-97aa-4f7e-9659-d602908091ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:30.969819 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-42c33592-e199-4440-9b08-c05ba50829af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc33eec47b0847bfa9265efe66863b4b'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:30.970068 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dcc99c-97aa-4f7e-9659-d602908091ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:30.970347 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dcc99c-97aa-4f7e-9659-d602908091ef admin admin] PATH_INFO: `/v3/projects/a09787d442c648cd991dd8986218823a/users/0b02812fa8dd4b9bb51aed6c445cf2df/roles/9371e5bbc55848949eb951a815f817f2` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:30.986306 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dcc99c-97aa-4f7e-9659-d602908091ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=a09787d442c648cd991dd8986218823a, user_id=0b02812fa8dd4b9bb51aed6c445cf2df, role_id=9371e5bbc55848949eb951a815f817f2)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:30.989189 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dcc99c-97aa-4f7e-9659-d602908091ef admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:30.995941 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1061/2123] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:26:30 2022] DELETE /identity/v3/users/bc33eec47b0847bfa9265efe66863b4b => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:26:31.000560 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69695c01-2915-4aa0-b3be-e414a2e204e4 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:31.000851 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69695c01-2915-4aa0-b3be-e414a2e204e4 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:31.001129 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69695c01-2915-4aa0-b3be-e414a2e204e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:31.005715 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1063/2124] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:26:30 2022] PUT /identity/v3/projects/a09787d442c648cd991dd8986218823a/users/0b02812fa8dd4b9bb51aed6c445cf2df/roles/9371e5bbc55848949eb951a815f817f2 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:26:31.010100 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:26:31.016085 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2d04f-64b3-457e-a1a0-94ec4a008c9f None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:31.016495 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2d04f-64b3-457e-a1a0-94ec4a008c9f None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:31.016815 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2d04f-64b3-457e-a1a0-94ec4a008c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:31.022382 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-69695c01-2915-4aa0-b3be-e414a2e204e4 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:26:31.024007 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-69695c01-2915-4aa0-b3be-e414a2e204e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:26:31.049942 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-b1c2d04f-64b3-457e-a1a0-94ec4a008c9f None None] MFA Rules not processed for user `0b02812fa8dd4b9bb51aed6c445cf2df`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:26:31.051202 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-b1c2d04f-64b3-457e-a1a0-94ec4a008c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:26:31.095441 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:26:31.104995 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1062/2125] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:26:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:26:31.115475 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69695c01-2915-4aa0-b3be-e414a2e204e4 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:31.116884 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-69695c01-2915-4aa0-b3be-e414a2e204e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:26:31.119838 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1064/2126] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:26:31 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:26:31.131504 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c2d04f-64b3-457e-a1a0-94ec4a008c9f None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:31.132860 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-b1c2d04f-64b3-457e-a1a0-94ec4a008c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:26:31.174487 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69695c01-2915-4aa0-b3be-e414a2e204e4 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:31.178182 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a8dcbf-9d4b-413d-b072-d2ce5ebafd2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:31.178820 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a8dcbf-9d4b-413d-b072-d2ce5ebafd2a service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:31.179100 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a8dcbf-9d4b-413d-b072-d2ce5ebafd2a service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:31.179380 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a8dcbf-9d4b-413d-b072-d2ce5ebafd2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:31.188488 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a8dcbf-9d4b-413d-b072-d2ce5ebafd2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:31.189890 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c2d04f-64b3-457e-a1a0-94ec4a008c9f None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:31.190580 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a8dcbf-9d4b-413d-b072-d2ce5ebafd2a service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:31.193518 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0099aae-30e5-4bd8-accf-c0a29569f488 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceafc5e4283841528053f01931f10293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:31.194117 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0099aae-30e5-4bd8-accf-c0a29569f488 service cinder] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:31.194400 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0099aae-30e5-4bd8-accf-c0a29569f488 service cinder] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:31.194678 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0099aae-30e5-4bd8-accf-c0a29569f488 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:31.200621 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1063/2127] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:26:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 12:26:31.203544 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0099aae-30e5-4bd8-accf-c0a29569f488 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:31.204972 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0099aae-30e5-4bd8-accf-c0a29569f488 service cinder] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:31.213964 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1065/2128] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:26:31 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 12:26:31.526776 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a8dcbf-9d4b-413d-b072-d2ce5ebafd2a service neutron] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:31.528864 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-53a8dcbf-9d4b-413d-b072-d2ce5ebafd2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:26:31.549340 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a8dcbf-9d4b-413d-b072-d2ce5ebafd2a service neutron] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:31.554653 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8661a9b-d656-4d72-8cb7-d7f9d38d458e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:31.555577 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8661a9b-d656-4d72-8cb7-d7f9d38d458e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:31.556431 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8661a9b-d656-4d72-8cb7-d7f9d38d458e admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:31.556431 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8661a9b-d656-4d72-8cb7-d7f9d38d458e admin admin] PATH_INFO: `/v3/projects/dcb558936d554997bf596901bdd456bf` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:31.557582 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8661a9b-d656-4d72-8cb7-d7f9d38d458e admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcb558936d554997bf596901bdd456bf)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:31.560069 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8661a9b-d656-4d72-8cb7-d7f9d38d458e admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:31.614144 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-c8661a9b-d656-4d72-8cb7-d7f9d38d458e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcb558936d554997bf596901bdd456bf', 'request_id': 'req-c8661a9b-d656-4d72-8cb7-d7f9d38d458e'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:31.620308 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-c8661a9b-d656-4d72-8cb7-d7f9d38d458e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcb558936d554997bf596901bdd456bf', 'request_id': 'req-c8661a9b-d656-4d72-8cb7-d7f9d38d458e'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:31.632563 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-c8661a9b-d656-4d72-8cb7-d7f9d38d458e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcb558936d554997bf596901bdd456bf', 'request_id': 'req-c8661a9b-d656-4d72-8cb7-d7f9d38d458e'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:31.645646 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-c8661a9b-d656-4d72-8cb7-d7f9d38d458e admin admin] The token cache is being invalidate because project dcb558936d554997bf596901bdd456bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:26:31.645869 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-c8661a9b-d656-4d72-8cb7-d7f9d38d458e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:31.646521 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-c8661a9b-d656-4d72-8cb7-d7f9d38d458e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:31.648078 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1064/2129] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:26:31 2022] DELETE /identity/v3/projects/dcb558936d554997bf596901bdd456bf => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:26:31.655508 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0948061-0146-41fb-86eb-cadc4791132e None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:31.655990 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0948061-0146-41fb-86eb-cadc4791132e None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:31.656088 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0948061-0146-41fb-86eb-cadc4791132e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:31.678077 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-c0948061-0146-41fb-86eb-cadc4791132e None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:26:31.680190 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-c0948061-0146-41fb-86eb-cadc4791132e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:26:31.761008 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1066/2130] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:26:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:26:31.768593 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5313ad-7173-43e0-a554-d4a846d1a971 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:31.768918 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5313ad-7173-43e0-a554-d4a846d1a971 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:31.769206 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5313ad-7173-43e0-a554-d4a846d1a971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:31.789743 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-5c5313ad-7173-43e0-a554-d4a846d1a971 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:26:31.791100 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-5c5313ad-7173-43e0-a554-d4a846d1a971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:26:31.799604 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1065/2131] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:26:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:26:31.803764 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0948061-0146-41fb-86eb-cadc4791132e None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:31.813132 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0948061-0146-41fb-86eb-cadc4791132e None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:31.817631 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f8f721-3d56-45e1-a148-331774c4b401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:31.818218 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8f721-3d56-45e1-a148-331774c4b401 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:31.818491 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8f721-3d56-45e1-a148-331774c4b401 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:31.818795 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8f721-3d56-45e1-a148-331774c4b401 admin admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:31.819429 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f8f721-3d56-45e1-a148-331774c4b401 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:26:31.819726 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f8f721-3d56-45e1-a148-331774c4b401 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:31.821294 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f8f721-3d56-45e1-a148-331774c4b401 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:31.833025 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1067/2132] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 15 12:26:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:26:31.837176 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5313ad-7173-43e0-a554-d4a846d1a971 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:31.846906 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5313ad-7173-43e0-a554-d4a846d1a971 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:31.851605 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488bf3cc-eeb0-48b8-92f8-c2b47e3e4484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:31.852122 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488bf3cc-eeb0-48b8-92f8-c2b47e3e4484 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:31.852399 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488bf3cc-eeb0-48b8-92f8-c2b47e3e4484 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:31.852670 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488bf3cc-eeb0-48b8-92f8-c2b47e3e4484 admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:31.853295 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488bf3cc-eeb0-48b8-92f8-c2b47e3e4484 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:31.855227 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488bf3cc-eeb0-48b8-92f8-c2b47e3e4484 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:31.882584 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1066/2133] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:26:31 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:26:31.887353 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f8f721-3d56-45e1-a148-331774c4b401 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:31.897597 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f8f721-3d56-45e1-a148-331774c4b401 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:31.951893 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e217cb07-1a74-4330-b8ac-3844bdcdb15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:31.952486 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e217cb07-1a74-4330-b8ac-3844bdcdb15c admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:31.952761 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e217cb07-1a74-4330-b8ac-3844bdcdb15c admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:31.953031 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e217cb07-1a74-4330-b8ac-3844bdcdb15c admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:31.953651 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e217cb07-1a74-4330-b8ac-3844bdcdb15c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:31.955563 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e217cb07-1a74-4330-b8ac-3844bdcdb15c admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:31.980302 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1068/2134] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:26:31 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:26:31.984389 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488bf3cc-eeb0-48b8-92f8-c2b47e3e4484 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:31.990181 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:26:31.998108 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488bf3cc-eeb0-48b8-92f8-c2b47e3e4484 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:32.004676 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5f893d-75c7-4877-a418-e29d099ae6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:32.005303 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f893d-75c7-4877-a418-e29d099ae6d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:32.005585 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f893d-75c7-4877-a418-e29d099ae6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:32.005906 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f893d-75c7-4877-a418-e29d099ae6d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:32.006712 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5f893d-75c7-4877-a418-e29d099ae6d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:32.008318 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5f893d-75c7-4877-a418-e29d099ae6d7 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:32.021731 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1067/2135] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:26:31 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:26:32.026231 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e217cb07-1a74-4330-b8ac-3844bdcdb15c admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:32.037935 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:26:32.042128 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e217cb07-1a74-4330-b8ac-3844bdcdb15c admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:32.049530 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8983e2e1-16ad-4973-8208-20bc534c1df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:32.050722 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8983e2e1-16ad-4973-8208-20bc534c1df9 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:32.051152 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8983e2e1-16ad-4973-8208-20bc534c1df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:32.051651 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8983e2e1-16ad-4973-8208-20bc534c1df9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:32.052623 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8983e2e1-16ad-4973-8208-20bc534c1df9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:32.054660 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8983e2e1-16ad-4973-8208-20bc534c1df9 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:32.069397 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1069/2136] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:26:32 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:26:32.070584 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5f893d-75c7-4877-a418-e29d099ae6d7 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:32.081459 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5f893d-75c7-4877-a418-e29d099ae6d7 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:32.086037 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca27977-c759-4782-a0a5-631246f5d07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:32.086718 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca27977-c759-4782-a0a5-631246f5d07a admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:32.087001 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca27977-c759-4782-a0a5-631246f5d07a admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:32.087276 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca27977-c759-4782-a0a5-631246f5d07a admin admin] PATH_INFO: `/v3/projects/ccd18dd4d4af46c3a150daf059df6155/users/d3aff44ddd584045b2580cd872705911/roles/9371e5bbc55848949eb951a815f817f2` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:32.103274 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca27977-c759-4782-a0a5-631246f5d07a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccd18dd4d4af46c3a150daf059df6155, user_id=d3aff44ddd584045b2580cd872705911, role_id=9371e5bbc55848949eb951a815f817f2)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:32.105921 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca27977-c759-4782-a0a5-631246f5d07a admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:32.120792 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1068/2137] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:26:32 2022] PUT /identity/v3/projects/ccd18dd4d4af46c3a150daf059df6155/users/d3aff44ddd584045b2580cd872705911/roles/9371e5bbc55848949eb951a815f817f2 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:26:32.131316 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12002dbf-a6a0-42aa-9e0a-64e9b6f9cd47 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:32.131671 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12002dbf-a6a0-42aa-9e0a-64e9b6f9cd47 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:32.132013 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12002dbf-a6a0-42aa-9e0a-64e9b6f9cd47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:32.160426 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-12002dbf-a6a0-42aa-9e0a-64e9b6f9cd47 None None] MFA Rules not processed for user `d3aff44ddd584045b2580cd872705911`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:26:32.161724 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-12002dbf-a6a0-42aa-9e0a-64e9b6f9cd47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:26:32.228448 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1070/2138] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:26:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:26:32.233519 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca27977-c759-4782-a0a5-631246f5d07a admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:32.297683 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca27977-c759-4782-a0a5-631246f5d07a admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:32.302322 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c7b62e-bced-452c-b18a-acd73e6e6759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:32.303018 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c7b62e-bced-452c-b18a-acd73e6e6759 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:32.303297 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c7b62e-bced-452c-b18a-acd73e6e6759 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:32.303567 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c7b62e-bced-452c-b18a-acd73e6e6759 admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:32.304191 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c7b62e-bced-452c-b18a-acd73e6e6759 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:32.306093 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c7b62e-bced-452c-b18a-acd73e6e6759 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:32.333211 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1069/2139] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:26:32 2022] POST /identity/v3/projects => generated 377 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:26:32.337285 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12002dbf-a6a0-42aa-9e0a-64e9b6f9cd47 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:32.347936 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12002dbf-a6a0-42aa-9e0a-64e9b6f9cd47 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:32.405046 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97466597-831d-4503-8144-52bb4507221b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:32.405557 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97466597-831d-4503-8144-52bb4507221b admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:32.405836 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97466597-831d-4503-8144-52bb4507221b admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:32.406107 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97466597-831d-4503-8144-52bb4507221b admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:32.406762 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97466597-831d-4503-8144-52bb4507221b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:32.408666 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97466597-831d-4503-8144-52bb4507221b admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:32.428900 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1071/2140] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:26:32 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:26:32.432720 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c7b62e-bced-452c-b18a-acd73e6e6759 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:32.443905 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c7b62e-bced-452c-b18a-acd73e6e6759 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:32.449067 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b239e54a-3af6-4273-9522-4a6f7a04f197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:32.450305 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b239e54a-3af6-4273-9522-4a6f7a04f197 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:32.450650 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b239e54a-3af6-4273-9522-4a6f7a04f197 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:32.451022 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b239e54a-3af6-4273-9522-4a6f7a04f197 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:32.451762 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b239e54a-3af6-4273-9522-4a6f7a04f197 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:32.453458 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b239e54a-3af6-4273-9522-4a6f7a04f197 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:32.465489 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1070/2141] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:26:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:26:32.469507 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97466597-831d-4503-8144-52bb4507221b admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:32.480538 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97466597-831d-4503-8144-52bb4507221b admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:32.490771 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20339084-2566-4c3d-8c89-c6af02ae91a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:32.491599 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20339084-2566-4c3d-8c89-c6af02ae91a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:32.491879 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20339084-2566-4c3d-8c89-c6af02ae91a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:32.492177 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20339084-2566-4c3d-8c89-c6af02ae91a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:32.492830 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20339084-2566-4c3d-8c89-c6af02ae91a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:32.494625 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20339084-2566-4c3d-8c89-c6af02ae91a0 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:32.505932 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1072/2142] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:26:32 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:26:32.510233 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b239e54a-3af6-4273-9522-4a6f7a04f197 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:32.520847 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b239e54a-3af6-4273-9522-4a6f7a04f197 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:32.525536 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e6e0e9-96b8-493d-8034-b96f5c7a6e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:32.526191 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e6e0e9-96b8-493d-8034-b96f5c7a6e60 admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:32.526472 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e6e0e9-96b8-493d-8034-b96f5c7a6e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:32.526770 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e6e0e9-96b8-493d-8034-b96f5c7a6e60 admin admin] PATH_INFO: `/v3/projects/93c3980daeb046b2a8312df66d3807c9/users/37c3ee0350f543a18acd22bd06fd4310/roles/9371e5bbc55848949eb951a815f817f2` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:32.541617 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e6e0e9-96b8-493d-8034-b96f5c7a6e60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93c3980daeb046b2a8312df66d3807c9, user_id=37c3ee0350f543a18acd22bd06fd4310, role_id=9371e5bbc55848949eb951a815f817f2)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:32.544349 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e6e0e9-96b8-493d-8034-b96f5c7a6e60 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:32.557953 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1071/2143] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:26:32 2022] PUT /identity/v3/projects/93c3980daeb046b2a8312df66d3807c9/users/37c3ee0350f543a18acd22bd06fd4310/roles/9371e5bbc55848949eb951a815f817f2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:26:32.570141 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9905c7a9-744f-48be-85cb-1e325488b620 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:32.570431 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9905c7a9-744f-48be-85cb-1e325488b620 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:32.570731 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9905c7a9-744f-48be-85cb-1e325488b620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:32.599540 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-9905c7a9-744f-48be-85cb-1e325488b620 None None] MFA Rules not processed for user `37c3ee0350f543a18acd22bd06fd4310`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:26:32.600745 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-9905c7a9-744f-48be-85cb-1e325488b620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:26:32.648290 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:26:32.666437 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1073/2144] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:26:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:26:32.671402 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e6e0e9-96b8-493d-8034-b96f5c7a6e60 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:32.738075 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e6e0e9-96b8-493d-8034-b96f5c7a6e60 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:32.750019 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba836184-a00f-446b-a55c-06b7fc226d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:32.750962 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba836184-a00f-446b-a55c-06b7fc226d73 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:32.751405 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba836184-a00f-446b-a55c-06b7fc226d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:32.752228 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba836184-a00f-446b-a55c-06b7fc226d73 admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:32.753515 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba836184-a00f-446b-a55c-06b7fc226d73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:32.755896 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba836184-a00f-446b-a55c-06b7fc226d73 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:32.798199 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1072/2145] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:26:32 2022] POST /identity/v3/projects => generated 377 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:26:32.803373 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9905c7a9-744f-48be-85cb-1e325488b620 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:32.817791 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9905c7a9-744f-48be-85cb-1e325488b620 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:32.895736 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1c0dbd-ba60-4c01-930c-0bf0f6536a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:32.896483 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c0dbd-ba60-4c01-930c-0bf0f6536a1b admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:32.896776 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c0dbd-ba60-4c01-930c-0bf0f6536a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:32.897045 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c0dbd-ba60-4c01-930c-0bf0f6536a1b admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:32.897676 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1c0dbd-ba60-4c01-930c-0bf0f6536a1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:32.899908 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1c0dbd-ba60-4c01-930c-0bf0f6536a1b admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:32.923765 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1074/2146] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:26:32 2022] POST /identity/v3/users => generated 295 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:26:32.927615 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba836184-a00f-446b-a55c-06b7fc226d73 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:32.934981 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:26:32.939353 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba836184-a00f-446b-a55c-06b7fc226d73 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:32.945816 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7ce43f-7c68-4655-a614-d012528bd63e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:32.946497 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7ce43f-7c68-4655-a614-d012528bd63e admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:32.946830 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7ce43f-7c68-4655-a614-d012528bd63e admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:32.947108 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7ce43f-7c68-4655-a614-d012528bd63e admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:32.947802 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7ce43f-7c68-4655-a614-d012528bd63e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:32.949435 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7ce43f-7c68-4655-a614-d012528bd63e admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:32.960914 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1073/2147] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:26:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:26:32.965079 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1c0dbd-ba60-4c01-930c-0bf0f6536a1b admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:32.981958 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1c0dbd-ba60-4c01-930c-0bf0f6536a1b admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:32.987272 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e4b86f-180e-46e7-af48-ecadb46aea55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:32.988030 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e4b86f-180e-46e7-af48-ecadb46aea55 admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:32.988450 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e4b86f-180e-46e7-af48-ecadb46aea55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:32.988734 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e4b86f-180e-46e7-af48-ecadb46aea55 admin admin] PATH_INFO: `/v3/projects/87b437a49af4450c93a9a2920abc30cf/users/d40f87f667644acfa6dd4873a03c3383/roles/7f53f1c823b746529ba5057bf21b2477` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:33.006004 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e4b86f-180e-46e7-af48-ecadb46aea55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87b437a49af4450c93a9a2920abc30cf, user_id=d40f87f667644acfa6dd4873a03c3383, role_id=7f53f1c823b746529ba5057bf21b2477)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:33.008685 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e4b86f-180e-46e7-af48-ecadb46aea55 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:33.021242 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1075/2148] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:26:32 2022] PUT /identity/v3/projects/87b437a49af4450c93a9a2920abc30cf/users/d40f87f667644acfa6dd4873a03c3383/roles/7f53f1c823b746529ba5057bf21b2477 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:26:33.025150 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7ce43f-7c68-4655-a614-d012528bd63e admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:33.035687 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7ce43f-7c68-4655-a614-d012528bd63e admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:33.091389 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58705811-3ccf-498e-b1ef-194756c39574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:33.091995 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58705811-3ccf-498e-b1ef-194756c39574 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:33.092276 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58705811-3ccf-498e-b1ef-194756c39574 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:33.092550 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58705811-3ccf-498e-b1ef-194756c39574 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:33.093208 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58705811-3ccf-498e-b1ef-194756c39574 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:33.094948 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58705811-3ccf-498e-b1ef-194756c39574 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:33.107351 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1074/2149] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:26:33.111532 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e4b86f-180e-46e7-af48-ecadb46aea55 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:33.121653 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e4b86f-180e-46e7-af48-ecadb46aea55 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:33.126194 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975a5043-d72d-4511-97f6-08760969ef38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:33.127117 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975a5043-d72d-4511-97f6-08760969ef38 admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:33.127398 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975a5043-d72d-4511-97f6-08760969ef38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:33.127669 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975a5043-d72d-4511-97f6-08760969ef38 admin admin] PATH_INFO: `/v3/projects/87b437a49af4450c93a9a2920abc30cf/users/d40f87f667644acfa6dd4873a03c3383/roles/7f53f1c823b746529ba5057bf21b2477` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:33.129546 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975a5043-d72d-4511-97f6-08760969ef38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87b437a49af4450c93a9a2920abc30cf, user_id=d40f87f667644acfa6dd4873a03c3383, role_id=7f53f1c823b746529ba5057bf21b2477)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:33.132196 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975a5043-d72d-4511-97f6-08760969ef38 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:33.142139 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1076/2150] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:26:33 2022] PUT /identity/v3/projects/87b437a49af4450c93a9a2920abc30cf/users/d40f87f667644acfa6dd4873a03c3383/roles/7f53f1c823b746529ba5057bf21b2477 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:26:33.151964 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec3b0ab-051e-4c5f-b7c3-7dd5c1cb749b None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:33.152770 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec3b0ab-051e-4c5f-b7c3-7dd5c1cb749b None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:33.153050 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec3b0ab-051e-4c5f-b7c3-7dd5c1cb749b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:33.181196 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-eec3b0ab-051e-4c5f-b7c3-7dd5c1cb749b None None] MFA Rules not processed for user `d40f87f667644acfa6dd4873a03c3383`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:26:33.182339 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-eec3b0ab-051e-4c5f-b7c3-7dd5c1cb749b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:26:33.248269 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1075/2151] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:26:33 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:26:33.260510 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975a5043-d72d-4511-97f6-08760969ef38 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:33.262292 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-975a5043-d72d-4511-97f6-08760969ef38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:26:33.318496 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975a5043-d72d-4511-97f6-08760969ef38 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:33.322115 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e0ddff-2be2-4247-bd12-62a840e109fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceafc5e4283841528053f01931f10293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:33.322739 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e0ddff-2be2-4247-bd12-62a840e109fb service cinder] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:33.323020 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e0ddff-2be2-4247-bd12-62a840e109fb service cinder] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:33.323289 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e0ddff-2be2-4247-bd12-62a840e109fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:33.380217 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:26:33.382794 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e0ddff-2be2-4247-bd12-62a840e109fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:33.384316 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e0ddff-2be2-4247-bd12-62a840e109fb service cinder] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:33.395975 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1077/2152] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:26:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:26:34.938442 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec3b0ab-051e-4c5f-b7c3-7dd5c1cb749b None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:34.939898 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-eec3b0ab-051e-4c5f-b7c3-7dd5c1cb749b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:26:34.953862 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec3b0ab-051e-4c5f-b7c3-7dd5c1cb749b None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:34.957531 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16b7882-a202-4872-bb88-ddef7bf15816 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceafc5e4283841528053f01931f10293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:34.958259 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b7882-a202-4872-bb88-ddef7bf15816 service cinder] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:34.958821 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b7882-a202-4872-bb88-ddef7bf15816 service cinder] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:34.959207 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b7882-a202-4872-bb88-ddef7bf15816 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:35.039837 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16b7882-a202-4872-bb88-ddef7bf15816 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:35.039837 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16b7882-a202-4872-bb88-ddef7bf15816 service cinder] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:35.048477 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1076/2153] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:26:34 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:26:35.674948 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e0ddff-2be2-4247-bd12-62a840e109fb service cinder] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:35.685978 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e0ddff-2be2-4247-bd12-62a840e109fb service cinder] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:35.690628 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839064d7-5ac3-4a76-b62b-1394517f80f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceafc5e4283841528053f01931f10293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:35.691332 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839064d7-5ac3-4a76-b62b-1394517f80f9 service cinder] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:35.691683 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839064d7-5ac3-4a76-b62b-1394517f80f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:35.692022 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839064d7-5ac3-4a76-b62b-1394517f80f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:35.703245 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839064d7-5ac3-4a76-b62b-1394517f80f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:35.704398 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839064d7-5ac3-4a76-b62b-1394517f80f9 service cinder] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:35.714767 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1078/2154] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:26:35 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:26:36.570060 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16b7882-a202-4872-bb88-ddef7bf15816 service cinder] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:36.571463 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-f16b7882-a202-4872-bb88-ddef7bf15816 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:26:36.584992 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:26:36.636085 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16b7882-a202-4872-bb88-ddef7bf15816 service cinder] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:36.641103 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618b5624-6cf8-4db1-877f-4312fab26a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:36.641722 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b5624-6cf8-4db1-877f-4312fab26a45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:36.641998 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b5624-6cf8-4db1-877f-4312fab26a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:36.642268 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b5624-6cf8-4db1-877f-4312fab26a45 admin admin] PATH_INFO: `/v3/users/0b02812fa8dd4b9bb51aed6c445cf2df` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:36.643396 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618b5624-6cf8-4db1-877f-4312fab26a45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b02812fa8dd4b9bb51aed6c445cf2df)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:36.645293 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618b5624-6cf8-4db1-877f-4312fab26a45 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:36.688853 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-618b5624-6cf8-4db1-877f-4312fab26a45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b02812fa8dd4b9bb51aed6c445cf2df'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:36.695908 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-618b5624-6cf8-4db1-877f-4312fab26a45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b02812fa8dd4b9bb51aed6c445cf2df'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:36.696525 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-618b5624-6cf8-4db1-877f-4312fab26a45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b02812fa8dd4b9bb51aed6c445cf2df'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:36.697185 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-618b5624-6cf8-4db1-877f-4312fab26a45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b02812fa8dd4b9bb51aed6c445cf2df'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:36.704700 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-618b5624-6cf8-4db1-877f-4312fab26a45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b02812fa8dd4b9bb51aed6c445cf2df'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:36.723782 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1077/2155] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:26:36 2022] DELETE /identity/v3/users/0b02812fa8dd4b9bb51aed6c445cf2df => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:26:36.728213 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3690bf-b185-4053-8b48-93203880577d None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:36.728662 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3690bf-b185-4053-8b48-93203880577d None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:36.728751 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3690bf-b185-4053-8b48-93203880577d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:36.747998 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-6a3690bf-b185-4053-8b48-93203880577d None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:26:36.749202 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-6a3690bf-b185-4053-8b48-93203880577d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:26:36.806665 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1079/2156] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:26:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:26:36.816847 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618b5624-6cf8-4db1-877f-4312fab26a45 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:36.818252 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-618b5624-6cf8-4db1-877f-4312fab26a45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:26:36.877520 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618b5624-6cf8-4db1-877f-4312fab26a45 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:36.881267 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2422b0c-a0f4-495d-a86b-c2b1c14b43dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:36.881889 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2422b0c-a0f4-495d-a86b-c2b1c14b43dd service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:36.882168 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2422b0c-a0f4-495d-a86b-c2b1c14b43dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:36.882501 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2422b0c-a0f4-495d-a86b-c2b1c14b43dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:36.893733 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2422b0c-a0f4-495d-a86b-c2b1c14b43dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:36.895313 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2422b0c-a0f4-495d-a86b-c2b1c14b43dd service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:36.906493 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1078/2157] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:26:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:26:37.278532 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3690bf-b185-4053-8b48-93203880577d None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:37.280003 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-6a3690bf-b185-4053-8b48-93203880577d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:26:37.302848 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3690bf-b185-4053-8b48-93203880577d None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:37.309926 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d94b32c-432e-40d2-a208-cdea82c99d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:37.310525 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d94b32c-432e-40d2-a208-cdea82c99d41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:37.310740 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d94b32c-432e-40d2-a208-cdea82c99d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:37.311015 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d94b32c-432e-40d2-a208-cdea82c99d41 admin admin] PATH_INFO: `/v3/projects/a09787d442c648cd991dd8986218823a` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:37.312136 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d94b32c-432e-40d2-a208-cdea82c99d41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a09787d442c648cd991dd8986218823a)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:37.314221 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d94b32c-432e-40d2-a208-cdea82c99d41 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:37.365840 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-9d94b32c-432e-40d2-a208-cdea82c99d41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a09787d442c648cd991dd8986218823a', 'request_id': 'req-9d94b32c-432e-40d2-a208-cdea82c99d41'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:37.372523 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-9d94b32c-432e-40d2-a208-cdea82c99d41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a09787d442c648cd991dd8986218823a', 'request_id': 'req-9d94b32c-432e-40d2-a208-cdea82c99d41'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:37.378487 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-9d94b32c-432e-40d2-a208-cdea82c99d41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a09787d442c648cd991dd8986218823a', 'request_id': 'req-9d94b32c-432e-40d2-a208-cdea82c99d41'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:37.390735 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-9d94b32c-432e-40d2-a208-cdea82c99d41 admin admin] The token cache is being invalidate because project a09787d442c648cd991dd8986218823a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:26:37.391039 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-9d94b32c-432e-40d2-a208-cdea82c99d41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:37.391665 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-9d94b32c-432e-40d2-a208-cdea82c99d41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:37.393151 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1080/2158] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:26:37 2022] DELETE /identity/v3/projects/a09787d442c648cd991dd8986218823a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:26:39.755064 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2422b0c-a0f4-495d-a86b-c2b1c14b43dd service neutron] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:39.756990 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-f2422b0c-a0f4-495d-a86b-c2b1c14b43dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:26:39.769543 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2422b0c-a0f4-495d-a86b-c2b1c14b43dd service neutron] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:39.799744 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:26:39.829085 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4fa7f4-6581-4e5d-81d0-36e0e08a207d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:39.829719 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4fa7f4-6581-4e5d-81d0-36e0e08a207d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:39.830148 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4fa7f4-6581-4e5d-81d0-36e0e08a207d admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:39.830437 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4fa7f4-6581-4e5d-81d0-36e0e08a207d admin admin] PATH_INFO: `/v3/users/d3aff44ddd584045b2580cd872705911` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:39.831596 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4fa7f4-6581-4e5d-81d0-36e0e08a207d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3aff44ddd584045b2580cd872705911)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:39.833554 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4fa7f4-6581-4e5d-81d0-36e0e08a207d admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:39.882917 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-3f4fa7f4-6581-4e5d-81d0-36e0e08a207d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3aff44ddd584045b2580cd872705911'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:39.891198 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-3f4fa7f4-6581-4e5d-81d0-36e0e08a207d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3aff44ddd584045b2580cd872705911'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:39.891946 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-3f4fa7f4-6581-4e5d-81d0-36e0e08a207d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3aff44ddd584045b2580cd872705911'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:39.892548 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-3f4fa7f4-6581-4e5d-81d0-36e0e08a207d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3aff44ddd584045b2580cd872705911'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:39.900330 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-3f4fa7f4-6581-4e5d-81d0-36e0e08a207d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3aff44ddd584045b2580cd872705911'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:39.922389 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1079/2159] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:26:39 2022] DELETE /identity/v3/users/d3aff44ddd584045b2580cd872705911 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:26:39.926922 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e7f3d-41d1-42db-ab3a-98de018541b0 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:39.927381 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e7f3d-41d1-42db-ab3a-98de018541b0 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:39.927612 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e7f3d-41d1-42db-ab3a-98de018541b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:39.946794 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-184e7f3d-41d1-42db-ab3a-98de018541b0 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:26:39.947987 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-184e7f3d-41d1-42db-ab3a-98de018541b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:26:40.012264 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1081/2160] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:26:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:26:40.021677 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4fa7f4-6581-4e5d-81d0-36e0e08a207d admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:40.023142 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-3f4fa7f4-6581-4e5d-81d0-36e0e08a207d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:26:40.092999 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4fa7f4-6581-4e5d-81d0-36e0e08a207d admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:40.096948 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fec804-b6ae-4882-9371-0f0d78dfd58b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:40.097573 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fec804-b6ae-4882-9371-0f0d78dfd58b service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:40.097846 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fec804-b6ae-4882-9371-0f0d78dfd58b service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:40.098116 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fec804-b6ae-4882-9371-0f0d78dfd58b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:40.119422 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fec804-b6ae-4882-9371-0f0d78dfd58b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:40.120969 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fec804-b6ae-4882-9371-0f0d78dfd58b service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:40.131654 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1080/2161] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:26:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:26:40.978159 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184e7f3d-41d1-42db-ab3a-98de018541b0 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:40.980158 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-184e7f3d-41d1-42db-ab3a-98de018541b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:26:40.999444 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184e7f3d-41d1-42db-ab3a-98de018541b0 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:41.004543 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ac3227-3886-48ad-8cd2-ac00a9810f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:41.005175 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ac3227-3886-48ad-8cd2-ac00a9810f6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:41.005604 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ac3227-3886-48ad-8cd2-ac00a9810f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:41.006104 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ac3227-3886-48ad-8cd2-ac00a9810f6a admin admin] PATH_INFO: `/v3/projects/ccd18dd4d4af46c3a150daf059df6155` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:41.007773 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ac3227-3886-48ad-8cd2-ac00a9810f6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccd18dd4d4af46c3a150daf059df6155)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:41.011410 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ac3227-3886-48ad-8cd2-ac00a9810f6a admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:41.013771 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:26:41.060920 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-f7ac3227-3886-48ad-8cd2-ac00a9810f6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccd18dd4d4af46c3a150daf059df6155', 'request_id': 'req-f7ac3227-3886-48ad-8cd2-ac00a9810f6a'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:41.067303 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-f7ac3227-3886-48ad-8cd2-ac00a9810f6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccd18dd4d4af46c3a150daf059df6155', 'request_id': 'req-f7ac3227-3886-48ad-8cd2-ac00a9810f6a'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:41.073189 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-f7ac3227-3886-48ad-8cd2-ac00a9810f6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccd18dd4d4af46c3a150daf059df6155', 'request_id': 'req-f7ac3227-3886-48ad-8cd2-ac00a9810f6a'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:41.085542 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-f7ac3227-3886-48ad-8cd2-ac00a9810f6a admin admin] The token cache is being invalidate because project ccd18dd4d4af46c3a150daf059df6155 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:26:41.085831 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-f7ac3227-3886-48ad-8cd2-ac00a9810f6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:41.086446 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-f7ac3227-3886-48ad-8cd2-ac00a9810f6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:41.087953 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1082/2162] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:26:40 2022] DELETE /identity/v3/projects/ccd18dd4d4af46c3a150daf059df6155 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:26:41.091909 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fec804-b6ae-4882-9371-0f0d78dfd58b service neutron] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:41.101760 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fec804-b6ae-4882-9371-0f0d78dfd58b service neutron] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:41.152166 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:26:41.159637 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7076ae3-da4f-4cd6-b53a-95a503a7f932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:41.160460 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7076ae3-da4f-4cd6-b53a-95a503a7f932 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:41.160870 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7076ae3-da4f-4cd6-b53a-95a503a7f932 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:41.161578 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7076ae3-da4f-4cd6-b53a-95a503a7f932 admin admin] PATH_INFO: `/v3/users/37c3ee0350f543a18acd22bd06fd4310` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:41.162778 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7076ae3-da4f-4cd6-b53a-95a503a7f932 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37c3ee0350f543a18acd22bd06fd4310)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:41.165263 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7076ae3-da4f-4cd6-b53a-95a503a7f932 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:41.212006 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-b7076ae3-da4f-4cd6-b53a-95a503a7f932 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37c3ee0350f543a18acd22bd06fd4310'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:41.219219 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-b7076ae3-da4f-4cd6-b53a-95a503a7f932 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37c3ee0350f543a18acd22bd06fd4310'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:41.219836 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-b7076ae3-da4f-4cd6-b53a-95a503a7f932 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37c3ee0350f543a18acd22bd06fd4310'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:41.220444 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-b7076ae3-da4f-4cd6-b53a-95a503a7f932 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37c3ee0350f543a18acd22bd06fd4310'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:41.227511 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-b7076ae3-da4f-4cd6-b53a-95a503a7f932 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37c3ee0350f543a18acd22bd06fd4310'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:41.244594 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1081/2163] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:26:41 2022] DELETE /identity/v3/users/37c3ee0350f543a18acd22bd06fd4310 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:26:41.655156 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5661804e-dae4-4ba4-9b5e-6cb9418c3277 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:41.655960 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5661804e-dae4-4ba4-9b5e-6cb9418c3277 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:41.656328 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5661804e-dae4-4ba4-9b5e-6cb9418c3277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:41.669017 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7076ae3-da4f-4cd6-b53a-95a503a7f932 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:41.671490 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-b7076ae3-da4f-4cd6-b53a-95a503a7f932 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:26:41.690890 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-5661804e-dae4-4ba4-9b5e-6cb9418c3277 None None] MFA Rules not processed for user `067817c2d23a4bab8530a7f78790958b`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:26:41.692097 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-5661804e-dae4-4ba4-9b5e-6cb9418c3277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:26:41.743916 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7076ae3-da4f-4cd6-b53a-95a503a7f932 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:41.749090 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0a01f3-c27a-4859-98f3-1894bc2dff4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:41.749893 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0a01f3-c27a-4859-98f3-1894bc2dff4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:41.750185 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0a01f3-c27a-4859-98f3-1894bc2dff4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:41.750462 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0a01f3-c27a-4859-98f3-1894bc2dff4c admin admin] PATH_INFO: `/v3/projects/93c3980daeb046b2a8312df66d3807c9` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:41.751923 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0a01f3-c27a-4859-98f3-1894bc2dff4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=93c3980daeb046b2a8312df66d3807c9)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:41.753832 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0a01f3-c27a-4859-98f3-1894bc2dff4c admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:41.790132 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1083/2164] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:26:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:26:41.813400 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-5d0a01f3-c27a-4859-98f3-1894bc2dff4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93c3980daeb046b2a8312df66d3807c9', 'request_id': 'req-5d0a01f3-c27a-4859-98f3-1894bc2dff4c'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:41.821998 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-5d0a01f3-c27a-4859-98f3-1894bc2dff4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93c3980daeb046b2a8312df66d3807c9', 'request_id': 'req-5d0a01f3-c27a-4859-98f3-1894bc2dff4c'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:41.831833 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-5d0a01f3-c27a-4859-98f3-1894bc2dff4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93c3980daeb046b2a8312df66d3807c9', 'request_id': 'req-5d0a01f3-c27a-4859-98f3-1894bc2dff4c'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:41.849388 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-5d0a01f3-c27a-4859-98f3-1894bc2dff4c admin admin] The token cache is being invalidate because project 93c3980daeb046b2a8312df66d3807c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:26:41.849843 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-5d0a01f3-c27a-4859-98f3-1894bc2dff4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:41.850800 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-5d0a01f3-c27a-4859-98f3-1894bc2dff4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:41.858789 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1082/2165] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:26:41 2022] DELETE /identity/v3/projects/93c3980daeb046b2a8312df66d3807c9 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:26:41.860825 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5661804e-dae4-4ba4-9b5e-6cb9418c3277 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:41.874943 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5661804e-dae4-4ba4-9b5e-6cb9418c3277 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:41.940024 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37da6a8f-a2fe-461c-b382-25aae955f21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:41.940781 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da6a8f-a2fe-461c-b382-25aae955f21c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:41.941123 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da6a8f-a2fe-461c-b382-25aae955f21c admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:41.941461 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da6a8f-a2fe-461c-b382-25aae955f21c admin admin] PATH_INFO: `/v3/users/d40f87f667644acfa6dd4873a03c3383` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:41.942773 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37da6a8f-a2fe-461c-b382-25aae955f21c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d40f87f667644acfa6dd4873a03c3383)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:41.946624 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37da6a8f-a2fe-461c-b382-25aae955f21c admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:42.022049 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:26:42.035727 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-37da6a8f-a2fe-461c-b382-25aae955f21c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd40f87f667644acfa6dd4873a03c3383'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:42.048940 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-37da6a8f-a2fe-461c-b382-25aae955f21c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd40f87f667644acfa6dd4873a03c3383'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:42.049723 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-37da6a8f-a2fe-461c-b382-25aae955f21c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd40f87f667644acfa6dd4873a03c3383'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:42.050545 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-37da6a8f-a2fe-461c-b382-25aae955f21c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd40f87f667644acfa6dd4873a03c3383'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:42.062244 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-37da6a8f-a2fe-461c-b382-25aae955f21c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd40f87f667644acfa6dd4873a03c3383'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:42.088545 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1084/2166] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:26:41 2022] DELETE /identity/v3/users/d40f87f667644acfa6dd4873a03c3383 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:26:42.668273 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0a01f3-c27a-4859-98f3-1894bc2dff4c admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:42.670443 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-5d0a01f3-c27a-4859-98f3-1894bc2dff4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:26:42.686743 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:26:42.691776 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0a01f3-c27a-4859-98f3-1894bc2dff4c admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:42.779049 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd723e29-9b16-46a2-b1a0-c25fd5589aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:42.779762 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd723e29-9b16-46a2-b1a0-c25fd5589aab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:42.780056 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd723e29-9b16-46a2-b1a0-c25fd5589aab admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:42.780326 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd723e29-9b16-46a2-b1a0-c25fd5589aab admin admin] PATH_INFO: `/v3/projects/87b437a49af4450c93a9a2920abc30cf` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:42.781668 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd723e29-9b16-46a2-b1a0-c25fd5589aab admin admin] RBAC: Authorizing `identity:delete_project(project_id=87b437a49af4450c93a9a2920abc30cf)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:42.783831 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd723e29-9b16-46a2-b1a0-c25fd5589aab admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:42.866182 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-fd723e29-9b16-46a2-b1a0-c25fd5589aab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87b437a49af4450c93a9a2920abc30cf', 'request_id': 'req-fd723e29-9b16-46a2-b1a0-c25fd5589aab'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:42.881123 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-fd723e29-9b16-46a2-b1a0-c25fd5589aab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87b437a49af4450c93a9a2920abc30cf', 'request_id': 'req-fd723e29-9b16-46a2-b1a0-c25fd5589aab'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:42.908273 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-fd723e29-9b16-46a2-b1a0-c25fd5589aab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87b437a49af4450c93a9a2920abc30cf', 'request_id': 'req-fd723e29-9b16-46a2-b1a0-c25fd5589aab'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:42.939206 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-fd723e29-9b16-46a2-b1a0-c25fd5589aab admin admin] The token cache is being invalidate because project 87b437a49af4450c93a9a2920abc30cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:26:42.939754 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-fd723e29-9b16-46a2-b1a0-c25fd5589aab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:42.940665 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-fd723e29-9b16-46a2-b1a0-c25fd5589aab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:42.942986 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1083/2167] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:26:42 2022] DELETE /identity/v3/projects/87b437a49af4450c93a9a2920abc30cf => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:26:42.949469 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d9c52-d967-462f-8f95-81a3557b9714 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:42.949965 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d9c52-d967-462f-8f95-81a3557b9714 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:42.950390 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d9c52-d967-462f-8f95-81a3557b9714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:42.984136 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-e22d9c52-d967-462f-8f95-81a3557b9714 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:26:42.986356 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-e22d9c52-d967-462f-8f95-81a3557b9714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:26:43.065035 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1085/2168] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:26:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:26:43.073046 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5833d7b-1278-4597-98ae-77ca715ecb16 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:43.073337 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5833d7b-1278-4597-98ae-77ca715ecb16 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:43.073611 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5833d7b-1278-4597-98ae-77ca715ecb16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:43.094470 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-a5833d7b-1278-4597-98ae-77ca715ecb16 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:26:43.095697 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-a5833d7b-1278-4597-98ae-77ca715ecb16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:26:43.103583 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1084/2169] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:26:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:26:43.108601 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22d9c52-d967-462f-8f95-81a3557b9714 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:43.118924 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22d9c52-d967-462f-8f95-81a3557b9714 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:43.124268 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05edf32-2e5a-4c26-9e52-5b38e17ff8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:43.126432 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05edf32-2e5a-4c26-9e52-5b38e17ff8e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:43.126432 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05edf32-2e5a-4c26-9e52-5b38e17ff8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:43.126432 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05edf32-2e5a-4c26-9e52-5b38e17ff8e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:43.126432 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05edf32-2e5a-4c26-9e52-5b38e17ff8e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:26:43.126432 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05edf32-2e5a-4c26-9e52-5b38e17ff8e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:43.128424 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05edf32-2e5a-4c26-9e52-5b38e17ff8e6 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:43.143232 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1086/2170] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 15 12:26:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:26:43.148297 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5833d7b-1278-4597-98ae-77ca715ecb16 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:43.158415 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5833d7b-1278-4597-98ae-77ca715ecb16 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:43.163272 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f05394-dbfd-41ae-8440-5825a1d48661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:43.164186 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f05394-dbfd-41ae-8440-5825a1d48661 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:43.164420 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f05394-dbfd-41ae-8440-5825a1d48661 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:43.164613 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f05394-dbfd-41ae-8440-5825a1d48661 admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:43.165245 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f05394-dbfd-41ae-8440-5825a1d48661 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:43.167425 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f05394-dbfd-41ae-8440-5825a1d48661 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:43.203010 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1085/2171] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:26:43 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:26:43.203786 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05edf32-2e5a-4c26-9e52-5b38e17ff8e6 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:43.215989 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05edf32-2e5a-4c26-9e52-5b38e17ff8e6 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:43.276168 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef43f766-0a18-486d-a237-7a513b9ba30c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:43.276807 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef43f766-0a18-486d-a237-7a513b9ba30c admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:43.277144 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef43f766-0a18-486d-a237-7a513b9ba30c admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:43.277923 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef43f766-0a18-486d-a237-7a513b9ba30c admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:43.278554 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef43f766-0a18-486d-a237-7a513b9ba30c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:43.280730 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef43f766-0a18-486d-a237-7a513b9ba30c admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:43.301756 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1087/2172] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:26:43 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:26:43.305739 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f05394-dbfd-41ae-8440-5825a1d48661 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:43.316486 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f05394-dbfd-41ae-8440-5825a1d48661 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:43.321435 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638dda14-e5b9-494d-b76b-3bcdb5f1f443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:43.322085 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638dda14-e5b9-494d-b76b-3bcdb5f1f443 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:43.322365 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638dda14-e5b9-494d-b76b-3bcdb5f1f443 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:43.322917 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638dda14-e5b9-494d-b76b-3bcdb5f1f443 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:43.323568 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638dda14-e5b9-494d-b76b-3bcdb5f1f443 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:43.325681 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638dda14-e5b9-494d-b76b-3bcdb5f1f443 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:43.335879 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1086/2173] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:26:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:26:43.340602 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef43f766-0a18-486d-a237-7a513b9ba30c admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:43.351762 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef43f766-0a18-486d-a237-7a513b9ba30c admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:43.356414 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b9dda0-c932-444d-a8de-e02951df2f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:43.357010 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9dda0-c932-444d-a8de-e02951df2f39 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:43.357285 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9dda0-c932-444d-a8de-e02951df2f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:43.357554 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9dda0-c932-444d-a8de-e02951df2f39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:43.358191 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b9dda0-c932-444d-a8de-e02951df2f39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:43.359789 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b9dda0-c932-444d-a8de-e02951df2f39 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:43.374439 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1088/2174] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:26:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:26:43.375703 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638dda14-e5b9-494d-b76b-3bcdb5f1f443 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:43.386066 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638dda14-e5b9-494d-b76b-3bcdb5f1f443 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:43.391522 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3362f917-49dd-4a56-a1a8-93f4f80b8862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:43.392173 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362f917-49dd-4a56-a1a8-93f4f80b8862 admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:43.392484 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362f917-49dd-4a56-a1a8-93f4f80b8862 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:43.392759 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362f917-49dd-4a56-a1a8-93f4f80b8862 admin admin] PATH_INFO: `/v3/projects/598bf168084444ffb7221916834ec065/users/18378174caf7437298e41fb3075a6aa6/roles/9371e5bbc55848949eb951a815f817f2` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:43.408763 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3362f917-49dd-4a56-a1a8-93f4f80b8862 admin admin] RBAC: Authorizing `identity:create_grant(project_id=598bf168084444ffb7221916834ec065, user_id=18378174caf7437298e41fb3075a6aa6, role_id=9371e5bbc55848949eb951a815f817f2)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:43.411475 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3362f917-49dd-4a56-a1a8-93f4f80b8862 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:43.424409 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1087/2175] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:26:43 2022] PUT /identity/v3/projects/598bf168084444ffb7221916834ec065/users/18378174caf7437298e41fb3075a6aa6/roles/9371e5bbc55848949eb951a815f817f2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:26:43.435442 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbdd4f3-7ade-4b98-8f27-0aa43cad6cea None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:43.435729 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbdd4f3-7ade-4b98-8f27-0aa43cad6cea None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:43.436008 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbdd4f3-7ade-4b98-8f27-0aa43cad6cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:43.465300 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-0cbdd4f3-7ade-4b98-8f27-0aa43cad6cea None None] MFA Rules not processed for user `18378174caf7437298e41fb3075a6aa6`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:26:43.466520 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-0cbdd4f3-7ade-4b98-8f27-0aa43cad6cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:26:43.474594 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:26:43.535536 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1089/2176] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:26:43 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:26:43.546610 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3362f917-49dd-4a56-a1a8-93f4f80b8862 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:43.548304 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-3362f917-49dd-4a56-a1a8-93f4f80b8862 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:26:43.588688 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:26:43.612715 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3362f917-49dd-4a56-a1a8-93f4f80b8862 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:43.616252 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad313d2f-016d-412b-9be9-da5aa70cc69f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceafc5e4283841528053f01931f10293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:43.616849 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad313d2f-016d-412b-9be9-da5aa70cc69f service cinder] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:43.617124 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad313d2f-016d-412b-9be9-da5aa70cc69f service cinder] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:43.617388 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad313d2f-016d-412b-9be9-da5aa70cc69f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:43.625780 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad313d2f-016d-412b-9be9-da5aa70cc69f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:43.627468 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad313d2f-016d-412b-9be9-da5aa70cc69f service cinder] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:43.636249 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1088/2177] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:26:43 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:26:46.184993 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbdd4f3-7ade-4b98-8f27-0aa43cad6cea None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:46.266101 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbdd4f3-7ade-4b98-8f27-0aa43cad6cea None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:46.271795 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020e19d9-4fd1-4fc4-a90b-e4d2acdeaa63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:46.272421 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020e19d9-4fd1-4fc4-a90b-e4d2acdeaa63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:46.272696 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020e19d9-4fd1-4fc4-a90b-e4d2acdeaa63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:46.272962 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020e19d9-4fd1-4fc4-a90b-e4d2acdeaa63 admin admin] PATH_INFO: `/v3/users/18378174caf7437298e41fb3075a6aa6` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:46.274080 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020e19d9-4fd1-4fc4-a90b-e4d2acdeaa63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18378174caf7437298e41fb3075a6aa6)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:46.276015 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020e19d9-4fd1-4fc4-a90b-e4d2acdeaa63 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:46.322634 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-020e19d9-4fd1-4fc4-a90b-e4d2acdeaa63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18378174caf7437298e41fb3075a6aa6'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:46.331412 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-020e19d9-4fd1-4fc4-a90b-e4d2acdeaa63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18378174caf7437298e41fb3075a6aa6'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:46.332069 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-020e19d9-4fd1-4fc4-a90b-e4d2acdeaa63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18378174caf7437298e41fb3075a6aa6'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:46.332671 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-020e19d9-4fd1-4fc4-a90b-e4d2acdeaa63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18378174caf7437298e41fb3075a6aa6'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:46.340421 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-020e19d9-4fd1-4fc4-a90b-e4d2acdeaa63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18378174caf7437298e41fb3075a6aa6'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:46.357431 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1090/2178] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:26:46 2022] DELETE /identity/v3/users/18378174caf7437298e41fb3075a6aa6 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:26:46.361872 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b14a2c-4a92-460b-b6f4-aedc9dd0f6ac None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:46.362357 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b14a2c-4a92-460b-b6f4-aedc9dd0f6ac None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:46.362447 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b14a2c-4a92-460b-b6f4-aedc9dd0f6ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:46.383628 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-92b14a2c-4a92-460b-b6f4-aedc9dd0f6ac None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:26:46.384838 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-92b14a2c-4a92-460b-b6f4-aedc9dd0f6ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:26:46.442587 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1089/2179] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:26:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:26:46.452770 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020e19d9-4fd1-4fc4-a90b-e4d2acdeaa63 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:46.454247 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-020e19d9-4fd1-4fc4-a90b-e4d2acdeaa63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:26:46.486409 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:26:46.513919 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020e19d9-4fd1-4fc4-a90b-e4d2acdeaa63 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:46.517545 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab058dc5-bb7f-4c74-b96b-fa44c8419020 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:46.518148 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab058dc5-bb7f-4c74-b96b-fa44c8419020 service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:46.518432 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab058dc5-bb7f-4c74-b96b-fa44c8419020 service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:46.518738 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab058dc5-bb7f-4c74-b96b-fa44c8419020 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:46.527782 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab058dc5-bb7f-4c74-b96b-fa44c8419020 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:46.530266 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab058dc5-bb7f-4c74-b96b-fa44c8419020 service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:46.541163 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1091/2180] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:26:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:26:46.833144 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b14a2c-4a92-460b-b6f4-aedc9dd0f6ac None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:26:46.834711 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-92b14a2c-4a92-460b-b6f4-aedc9dd0f6ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:26:46.846994 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b14a2c-4a92-460b-b6f4-aedc9dd0f6ac None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:26:46.851768 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4211e8-1ecc-40e7-a88b-967c8063bdbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:26:46.852505 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4211e8-1ecc-40e7-a88b-967c8063bdbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:26:46.852879 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4211e8-1ecc-40e7-a88b-967c8063bdbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:26:46.853266 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4211e8-1ecc-40e7-a88b-967c8063bdbe admin admin] PATH_INFO: `/v3/projects/598bf168084444ffb7221916834ec065` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:26:46.854491 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4211e8-1ecc-40e7-a88b-967c8063bdbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=598bf168084444ffb7221916834ec065)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:26:46.857436 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4211e8-1ecc-40e7-a88b-967c8063bdbe admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:26:46.920395 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-5d4211e8-1ecc-40e7-a88b-967c8063bdbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '598bf168084444ffb7221916834ec065', 'request_id': 'req-5d4211e8-1ecc-40e7-a88b-967c8063bdbe'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:46.927367 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-5d4211e8-1ecc-40e7-a88b-967c8063bdbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '598bf168084444ffb7221916834ec065', 'request_id': 'req-5d4211e8-1ecc-40e7-a88b-967c8063bdbe'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:46.937979 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-5d4211e8-1ecc-40e7-a88b-967c8063bdbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '598bf168084444ffb7221916834ec065', 'request_id': 'req-5d4211e8-1ecc-40e7-a88b-967c8063bdbe'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:46.950774 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-5d4211e8-1ecc-40e7-a88b-967c8063bdbe admin admin] The token cache is being invalidate because project 598bf168084444ffb7221916834ec065 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:26:46.951134 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-5d4211e8-1ecc-40e7-a88b-967c8063bdbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:46.951818 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-5d4211e8-1ecc-40e7-a88b-967c8063bdbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:26:46.953431 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1090/2181] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:26:46 2022] DELETE /identity/v3/projects/598bf168084444ffb7221916834ec065 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:26:56.536752 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=13 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:26:56.947050 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=66,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:27:02.399740 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7c9e1b-9d89-4ad4-af79-978b58c6d244 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:27:02.400238 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7c9e1b-9d89-4ad4-af79-978b58c6d244 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:27:02.400341 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7c9e1b-9d89-4ad4-af79-978b58c6d244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:27:02.420459 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-ea7c9e1b-9d89-4ad4-af79-978b58c6d244 None None] MFA Rules not processed for user `b4614bede59c47ea813a73fcc0840a2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:27:02.422307 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-ea7c9e1b-9d89-4ad4-af79-978b58c6d244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:27:02.478864 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1092/2182] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Sep 15 12:27:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:27:02.519976 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4211e8-1ecc-40e7-a88b-967c8063bdbe admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:27:02.521364 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-5d4211e8-1ecc-40e7-a88b-967c8063bdbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:27:02.607985 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4211e8-1ecc-40e7-a88b-967c8063bdbe admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:27:02.613199 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94edfab5-821b-4883-ad3a-0ba6c301f626 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee33b730d0ec428ca2cd3af4ebf723e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:27:02.613859 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94edfab5-821b-4883-ad3a-0ba6c301f626 service swift] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:27:02.614169 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94edfab5-821b-4883-ad3a-0ba6c301f626 service swift] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:27:02.614475 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94edfab5-821b-4883-ad3a-0ba6c301f626 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:27:02.622778 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94edfab5-821b-4883-ad3a-0ba6c301f626 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:27:02.624446 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94edfab5-821b-4883-ad3a-0ba6c301f626 service swift] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:27:02.634140 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1091/2183] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Sep 15 12:27:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 12:27:12.471880 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=25 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:27:12.630824 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=32 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:27:18.897218 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad417155-54d2-40aa-9a96-d6f5d4aab56f None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:27:18.897707 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad417155-54d2-40aa-9a96-d6f5d4aab56f None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:27:18.897805 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad417155-54d2-40aa-9a96-d6f5d4aab56f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:27:18.918859 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-ad417155-54d2-40aa-9a96-d6f5d4aab56f None None] MFA Rules not processed for user `b4614bede59c47ea813a73fcc0840a2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:27:18.920107 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-ad417155-54d2-40aa-9a96-d6f5d4aab56f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:27:18.928500 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1093/2184] 10.222.0.16 () {58 vars in 967 bytes} [Thu Sep 15 12:27:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:27:18.944022 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94edfab5-821b-4883-ad3a-0ba6c301f626 service swift] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:27:18.962090 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94edfab5-821b-4883-ad3a-0ba6c301f626 service swift] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:27:18.972087 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d85b282-ee3e-41ad-a2e1-f51860b53bb1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee33b730d0ec428ca2cd3af4ebf723e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:27:18.972322 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d85b282-ee3e-41ad-a2e1-f51860b53bb1 service swift] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:27:18.973195 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d85b282-ee3e-41ad-a2e1-f51860b53bb1 service swift] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:27:18.973195 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d85b282-ee3e-41ad-a2e1-f51860b53bb1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:27:18.981969 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d85b282-ee3e-41ad-a2e1-f51860b53bb1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:27:18.983778 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d85b282-ee3e-41ad-a2e1-f51860b53bb1 service swift] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:27:18.993701 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1092/2185] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Sep 15 12:27:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 12:27:20.967134 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad417155-54d2-40aa-9a96-d6f5d4aab56f None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:27:20.968644 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-ad417155-54d2-40aa-9a96-d6f5d4aab56f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:27:21.040671 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad417155-54d2-40aa-9a96-d6f5d4aab56f None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:27:21.045235 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448a4ea0-d35e-4f3c-9e57-87e8cf35c30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:27:21.045858 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a4ea0-d35e-4f3c-9e57-87e8cf35c30d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:27:21.046139 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a4ea0-d35e-4f3c-9e57-87e8cf35c30d admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:27:21.046404 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a4ea0-d35e-4f3c-9e57-87e8cf35c30d admin admin] PATH_INFO: `/v3/users/067817c2d23a4bab8530a7f78790958b` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:27:21.047557 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448a4ea0-d35e-4f3c-9e57-87e8cf35c30d admin admin] RBAC: Authorizing `identity:delete_user(user_id=067817c2d23a4bab8530a7f78790958b)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:27:21.050261 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448a4ea0-d35e-4f3c-9e57-87e8cf35c30d admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:27:21.098344 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-448a4ea0-d35e-4f3c-9e57-87e8cf35c30d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '067817c2d23a4bab8530a7f78790958b'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:27:21.106427 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-448a4ea0-d35e-4f3c-9e57-87e8cf35c30d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '067817c2d23a4bab8530a7f78790958b'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:27:21.107110 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-448a4ea0-d35e-4f3c-9e57-87e8cf35c30d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '067817c2d23a4bab8530a7f78790958b'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:27:21.107853 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-448a4ea0-d35e-4f3c-9e57-87e8cf35c30d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '067817c2d23a4bab8530a7f78790958b'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:27:21.116608 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-448a4ea0-d35e-4f3c-9e57-87e8cf35c30d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '067817c2d23a4bab8530a7f78790958b'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:27:21.134512 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1094/2186] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:27:20 2022] DELETE /identity/v3/users/067817c2d23a4bab8530a7f78790958b => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:27:21.312248 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d85b282-ee3e-41ad-a2e1-f51860b53bb1 service swift] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:27:21.324184 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d85b282-ee3e-41ad-a2e1-f51860b53bb1 service swift] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:27:21.383265 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28fc7b5-1d71-4560-9508-648893a4bbb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:27:21.383897 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28fc7b5-1d71-4560-9508-648893a4bbb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:27:21.384179 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28fc7b5-1d71-4560-9508-648893a4bbb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:27:21.384450 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28fc7b5-1d71-4560-9508-648893a4bbb8 admin admin] PATH_INFO: `/v3/projects/9cdce3a44d9944d6a6a6107358fc59e0` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:27:21.385574 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28fc7b5-1d71-4560-9508-648893a4bbb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cdce3a44d9944d6a6a6107358fc59e0)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:27:21.387498 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28fc7b5-1d71-4560-9508-648893a4bbb8 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:27:21.435031 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-d28fc7b5-1d71-4560-9508-648893a4bbb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cdce3a44d9944d6a6a6107358fc59e0', 'request_id': 'req-d28fc7b5-1d71-4560-9508-648893a4bbb8'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:27:21.441201 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-d28fc7b5-1d71-4560-9508-648893a4bbb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cdce3a44d9944d6a6a6107358fc59e0', 'request_id': 'req-d28fc7b5-1d71-4560-9508-648893a4bbb8'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:27:21.448824 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-d28fc7b5-1d71-4560-9508-648893a4bbb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cdce3a44d9944d6a6a6107358fc59e0', 'request_id': 'req-d28fc7b5-1d71-4560-9508-648893a4bbb8'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:27:21.460318 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-d28fc7b5-1d71-4560-9508-648893a4bbb8 admin admin] The token cache is being invalidate because project 9cdce3a44d9944d6a6a6107358fc59e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:27:21.460605 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-d28fc7b5-1d71-4560-9508-648893a4bbb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:27:21.461239 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-d28fc7b5-1d71-4560-9508-648893a4bbb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:27:21.462724 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1093/2187] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:27:21 2022] DELETE /identity/v3/projects/9cdce3a44d9944d6a6a6107358fc59e0 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:27:21.467636 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f957ccc-0643-43f7-9d71-8996b99b1f63 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:27:21.467917 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f957ccc-0643-43f7-9d71-8996b99b1f63 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:27:21.468185 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f957ccc-0643-43f7-9d71-8996b99b1f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:27:21.488621 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-5f957ccc-0643-43f7-9d71-8996b99b1f63 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:27:21.489801 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-5f957ccc-0643-43f7-9d71-8996b99b1f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:27:21.548856 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1095/2188] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:27:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:27:21.557151 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3449034-dfab-464c-ba10-1b4a527f1df0 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:27:21.557368 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3449034-dfab-464c-ba10-1b4a527f1df0 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:27:21.557644 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3449034-dfab-464c-ba10-1b4a527f1df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:27:21.577336 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-d3449034-dfab-464c-ba10-1b4a527f1df0 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:27:21.578506 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-d3449034-dfab-464c-ba10-1b4a527f1df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:27:21.586751 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1094/2189] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:27:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:27:21.590801 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f957ccc-0643-43f7-9d71-8996b99b1f63 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:27:21.600328 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f957ccc-0643-43f7-9d71-8996b99b1f63 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:27:21.604929 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c39ebe-8950-4637-ba39-e86ee180f130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:27:21.605520 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c39ebe-8950-4637-ba39-e86ee180f130 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:27:21.605794 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c39ebe-8950-4637-ba39-e86ee180f130 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:27:21.606062 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c39ebe-8950-4637-ba39-e86ee180f130 admin admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:27:21.606717 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c39ebe-8950-4637-ba39-e86ee180f130 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:27:21.607026 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c39ebe-8950-4637-ba39-e86ee180f130 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:27:21.608624 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c39ebe-8950-4637-ba39-e86ee180f130 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:27:21.617135 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:27:21.621526 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1096/2190] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 15 12:27:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:27:21.625190 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3449034-dfab-464c-ba10-1b4a527f1df0 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:27:21.635081 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3449034-dfab-464c-ba10-1b4a527f1df0 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:27:21.639685 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8e3da1-877b-4ea9-9ca0-52db6072e3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:27:21.640298 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e3da1-877b-4ea9-9ca0-52db6072e3ba admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:27:21.640578 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e3da1-877b-4ea9-9ca0-52db6072e3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:27:21.640898 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e3da1-877b-4ea9-9ca0-52db6072e3ba admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:27:21.641526 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8e3da1-877b-4ea9-9ca0-52db6072e3ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:27:21.644003 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8e3da1-877b-4ea9-9ca0-52db6072e3ba admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:27:21.670667 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1095/2191] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:27:21 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:27:21.674517 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c39ebe-8950-4637-ba39-e86ee180f130 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:27:21.684367 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c39ebe-8950-4637-ba39-e86ee180f130 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:27:21.740161 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ada4ab9-74d7-4a65-925a-652e5921db10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:27:21.740801 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada4ab9-74d7-4a65-925a-652e5921db10 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:27:21.741087 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada4ab9-74d7-4a65-925a-652e5921db10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:27:21.741366 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada4ab9-74d7-4a65-925a-652e5921db10 admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:27:21.742049 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ada4ab9-74d7-4a65-925a-652e5921db10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:27:21.744091 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ada4ab9-74d7-4a65-925a-652e5921db10 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:27:21.764916 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1097/2192] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:27:21 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:27:21.769470 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8e3da1-877b-4ea9-9ca0-52db6072e3ba admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:27:21.779681 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8e3da1-877b-4ea9-9ca0-52db6072e3ba admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:27:21.784449 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb7aa1c-9c21-4c46-8723-4802e4a87c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:27:21.785048 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb7aa1c-9c21-4c46-8723-4802e4a87c0e admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:27:21.785327 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb7aa1c-9c21-4c46-8723-4802e4a87c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:27:21.785597 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb7aa1c-9c21-4c46-8723-4802e4a87c0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:27:21.786239 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb7aa1c-9c21-4c46-8723-4802e4a87c0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:27:21.787852 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb7aa1c-9c21-4c46-8723-4802e4a87c0e admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:27:21.797750 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1096/2193] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:27:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:27:21.801288 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ada4ab9-74d7-4a65-925a-652e5921db10 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:27:21.811096 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ada4ab9-74d7-4a65-925a-652e5921db10 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:27:21.816096 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66355666-82db-44a1-956e-2ae009c0b033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:27:21.816680 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66355666-82db-44a1-956e-2ae009c0b033 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:27:21.816961 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66355666-82db-44a1-956e-2ae009c0b033 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:27:21.817236 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66355666-82db-44a1-956e-2ae009c0b033 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:27:21.817874 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66355666-82db-44a1-956e-2ae009c0b033 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:27:21.819481 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66355666-82db-44a1-956e-2ae009c0b033 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:27:21.830469 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1098/2194] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:27:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 12:27:21.834223 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb7aa1c-9c21-4c46-8723-4802e4a87c0e admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:27:21.843872 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb7aa1c-9c21-4c46-8723-4802e4a87c0e admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:27:21.848528 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51442385-1db2-4772-ad62-c7387a789f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:27:21.849169 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51442385-1db2-4772-ad62-c7387a789f11 admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:27:21.849566 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51442385-1db2-4772-ad62-c7387a789f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:27:21.849702 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51442385-1db2-4772-ad62-c7387a789f11 admin admin] PATH_INFO: `/v3/projects/5a06224cfaba4e6e98449b63d0217427/users/2c884ffc47044cd7bc431e718cb2727e/roles/9371e5bbc55848949eb951a815f817f2` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:27:21.865440 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51442385-1db2-4772-ad62-c7387a789f11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a06224cfaba4e6e98449b63d0217427, user_id=2c884ffc47044cd7bc431e718cb2727e, role_id=9371e5bbc55848949eb951a815f817f2)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:27:21.868588 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51442385-1db2-4772-ad62-c7387a789f11 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:27:21.881583 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1097/2195] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:27:21 2022] PUT /identity/v3/projects/5a06224cfaba4e6e98449b63d0217427/users/2c884ffc47044cd7bc431e718cb2727e/roles/9371e5bbc55848949eb951a815f817f2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:27:21.892315 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557dd637-250c-40b5-b21a-9d62914f843c None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:27:21.892604 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557dd637-250c-40b5-b21a-9d62914f843c None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:27:21.892875 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557dd637-250c-40b5-b21a-9d62914f843c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:27:21.919948 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-557dd637-250c-40b5-b21a-9d62914f843c None None] MFA Rules not processed for user `2c884ffc47044cd7bc431e718cb2727e`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:27:21.921131 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-557dd637-250c-40b5-b21a-9d62914f843c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:27:21.984455 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1099/2196] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:27:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:27:21.995968 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51442385-1db2-4772-ad62-c7387a789f11 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:27:21.997660 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-51442385-1db2-4772-ad62-c7387a789f11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:27:22.012549 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:27:22.056274 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51442385-1db2-4772-ad62-c7387a789f11 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:27:22.059939 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e40688-981f-455a-a09a-02b4a7de2c0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceafc5e4283841528053f01931f10293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:27:22.060538 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e40688-981f-455a-a09a-02b4a7de2c0c service cinder] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:27:22.060821 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e40688-981f-455a-a09a-02b4a7de2c0c service cinder] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:27:22.061092 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e40688-981f-455a-a09a-02b4a7de2c0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:27:22.069698 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e40688-981f-455a-a09a-02b4a7de2c0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:27:22.071108 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e40688-981f-455a-a09a-02b4a7de2c0c service cinder] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:27:22.080374 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1098/2197] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:27:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:27:22.104481 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557dd637-250c-40b5-b21a-9d62914f843c None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:27:22.167211 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557dd637-250c-40b5-b21a-9d62914f843c None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:27:22.171691 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaef42b-ea77-41a4-9322-714931e81d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:27:22.172308 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaef42b-ea77-41a4-9322-714931e81d31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:27:22.172584 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaef42b-ea77-41a4-9322-714931e81d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:27:22.173349 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaef42b-ea77-41a4-9322-714931e81d31 admin admin] PATH_INFO: `/v3/users/2c884ffc47044cd7bc431e718cb2727e` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:27:22.174465 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaef42b-ea77-41a4-9322-714931e81d31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c884ffc47044cd7bc431e718cb2727e)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:27:22.176386 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaef42b-ea77-41a4-9322-714931e81d31 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:27:22.186537 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:27:22.221935 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-ecaef42b-ea77-41a4-9322-714931e81d31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c884ffc47044cd7bc431e718cb2727e'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:27:22.229407 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-ecaef42b-ea77-41a4-9322-714931e81d31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c884ffc47044cd7bc431e718cb2727e'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:27:22.230071 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-ecaef42b-ea77-41a4-9322-714931e81d31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c884ffc47044cd7bc431e718cb2727e'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:27:22.230700 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-ecaef42b-ea77-41a4-9322-714931e81d31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c884ffc47044cd7bc431e718cb2727e'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:27:22.238110 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-ecaef42b-ea77-41a4-9322-714931e81d31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c884ffc47044cd7bc431e718cb2727e'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:27:22.255704 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1100/2198] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:27:22 2022] DELETE /identity/v3/users/2c884ffc47044cd7bc431e718cb2727e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:27:22.260120 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dabd6a-c43d-4d07-a36e-e56e4911872a None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:27:22.260476 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dabd6a-c43d-4d07-a36e-e56e4911872a None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:27:22.260836 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dabd6a-c43d-4d07-a36e-e56e4911872a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:27:22.280007 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-57dabd6a-c43d-4d07-a36e-e56e4911872a None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:27:22.281191 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-57dabd6a-c43d-4d07-a36e-e56e4911872a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:27:22.337816 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1099/2199] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:27:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:27:22.347707 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaef42b-ea77-41a4-9322-714931e81d31 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:27:22.349095 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-ecaef42b-ea77-41a4-9322-714931e81d31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:27:22.404967 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaef42b-ea77-41a4-9322-714931e81d31 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:27:22.409074 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c1b02e-509e-4585-acac-2504c6b0843c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:27:22.409692 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c1b02e-509e-4585-acac-2504c6b0843c service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:27:22.409971 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c1b02e-509e-4585-acac-2504c6b0843c service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:27:22.410239 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c1b02e-509e-4585-acac-2504c6b0843c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:27:22.418992 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c1b02e-509e-4585-acac-2504c6b0843c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:27:22.420400 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c1b02e-509e-4585-acac-2504c6b0843c service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:27:22.430203 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1101/2200] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:27:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:27:22.702152 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dabd6a-c43d-4d07-a36e-e56e4911872a None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:27:22.703660 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-57dabd6a-c43d-4d07-a36e-e56e4911872a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:27:22.722418 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dabd6a-c43d-4d07-a36e-e56e4911872a None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:27:22.727168 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df15c53-e683-4527-87a2-43b0ff7d8425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:27:22.727877 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df15c53-e683-4527-87a2-43b0ff7d8425 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:27:22.728066 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df15c53-e683-4527-87a2-43b0ff7d8425 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:27:22.728391 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df15c53-e683-4527-87a2-43b0ff7d8425 admin admin] PATH_INFO: `/v3/projects/5a06224cfaba4e6e98449b63d0217427` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:27:22.729439 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df15c53-e683-4527-87a2-43b0ff7d8425 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a06224cfaba4e6e98449b63d0217427)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:27:22.731416 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df15c53-e683-4527-87a2-43b0ff7d8425 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:27:22.779143 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-2df15c53-e683-4527-87a2-43b0ff7d8425 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a06224cfaba4e6e98449b63d0217427', 'request_id': 'req-2df15c53-e683-4527-87a2-43b0ff7d8425'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:27:22.785218 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-2df15c53-e683-4527-87a2-43b0ff7d8425 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a06224cfaba4e6e98449b63d0217427', 'request_id': 'req-2df15c53-e683-4527-87a2-43b0ff7d8425'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:27:22.792442 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-2df15c53-e683-4527-87a2-43b0ff7d8425 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a06224cfaba4e6e98449b63d0217427', 'request_id': 'req-2df15c53-e683-4527-87a2-43b0ff7d8425'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:27:22.803211 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-2df15c53-e683-4527-87a2-43b0ff7d8425 admin admin] The token cache is being invalidate because project 5a06224cfaba4e6e98449b63d0217427 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:27:22.803491 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-2df15c53-e683-4527-87a2-43b0ff7d8425 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:27:22.804099 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-2df15c53-e683-4527-87a2-43b0ff7d8425 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:27:22.805583 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1100/2201] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:27:22 2022] DELETE /identity/v3/projects/5a06224cfaba4e6e98449b63d0217427 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:27:22.810380 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509dee3-7999-4b84-bd3d-aea497e6af78 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:27:22.810715 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509dee3-7999-4b84-bd3d-aea497e6af78 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:27:22.810991 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509dee3-7999-4b84-bd3d-aea497e6af78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:27:22.831114 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-0509dee3-7999-4b84-bd3d-aea497e6af78 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:27:22.832313 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-0509dee3-7999-4b84-bd3d-aea497e6af78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:27:22.889794 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1102/2202] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:27:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:27:22.897934 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e179c-4645-400a-be1a-504096cab846 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:27:22.898214 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e179c-4645-400a-be1a-504096cab846 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:27:22.898482 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e179c-4645-400a-be1a-504096cab846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:27:22.917574 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-074e179c-4645-400a-be1a-504096cab846 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:27:22.918801 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-074e179c-4645-400a-be1a-504096cab846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:27:22.927056 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1101/2203] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:27:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:27:22.931066 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0509dee3-7999-4b84-bd3d-aea497e6af78 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:27:22.941414 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0509dee3-7999-4b84-bd3d-aea497e6af78 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:27:22.945939 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ce2dc8-4a7c-4717-8c43-5a672ffe8449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:27:22.946529 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ce2dc8-4a7c-4717-8c43-5a672ffe8449 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:27:22.946850 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ce2dc8-4a7c-4717-8c43-5a672ffe8449 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:27:22.947126 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ce2dc8-4a7c-4717-8c43-5a672ffe8449 admin admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:27:22.947767 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ce2dc8-4a7c-4717-8c43-5a672ffe8449 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:27:22.948069 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ce2dc8-4a7c-4717-8c43-5a672ffe8449 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:27:22.949646 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ce2dc8-4a7c-4717-8c43-5a672ffe8449 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:27:22.961731 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1103/2204] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 15 12:27:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:27:22.970015 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074e179c-4645-400a-be1a-504096cab846 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:27:22.979498 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074e179c-4645-400a-be1a-504096cab846 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:27:22.984149 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4292d2f-d338-412c-886c-42dcaa6ee389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:27:22.984746 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4292d2f-d338-412c-886c-42dcaa6ee389 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:27:22.985021 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4292d2f-d338-412c-886c-42dcaa6ee389 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:27:22.985797 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4292d2f-d338-412c-886c-42dcaa6ee389 admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:27:22.986427 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4292d2f-d338-412c-886c-42dcaa6ee389 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:27:22.988353 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4292d2f-d338-412c-886c-42dcaa6ee389 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:27:23.015254 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1102/2205] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:27:22 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:27:23.019396 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ce2dc8-4a7c-4717-8c43-5a672ffe8449 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:27:23.029085 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ce2dc8-4a7c-4717-8c43-5a672ffe8449 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:27:23.041047 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:27:23.088241 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45ba48a-c759-4c78-b7b0-407e51ba350b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:27:23.088843 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ba48a-c759-4c78-b7b0-407e51ba350b admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:27:23.089123 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ba48a-c759-4c78-b7b0-407e51ba350b admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:27:23.089396 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ba48a-c759-4c78-b7b0-407e51ba350b admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:27:23.090029 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45ba48a-c759-4c78-b7b0-407e51ba350b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:27:23.092003 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45ba48a-c759-4c78-b7b0-407e51ba350b admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:27:23.112848 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1104/2206] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:27:23 2022] POST /identity/v3/users => generated 286 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:27:23.116888 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4292d2f-d338-412c-886c-42dcaa6ee389 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:27:23.127910 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4292d2f-d338-412c-886c-42dcaa6ee389 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:27:23.132441 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ce762f-7ece-4a07-8303-4a9a8dce3371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:27:23.133028 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce762f-7ece-4a07-8303-4a9a8dce3371 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:27:23.133314 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce762f-7ece-4a07-8303-4a9a8dce3371 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:27:23.133570 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce762f-7ece-4a07-8303-4a9a8dce3371 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:27:23.134222 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ce762f-7ece-4a07-8303-4a9a8dce3371 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:27:23.135823 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ce762f-7ece-4a07-8303-4a9a8dce3371 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:27:23.140894 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:27:23.149668 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1103/2207] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:27:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:27:23.150875 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45ba48a-c759-4c78-b7b0-407e51ba350b admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:27:23.162288 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45ba48a-c759-4c78-b7b0-407e51ba350b admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:27:23.166885 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa46184c-28ab-4f67-b7ec-c562a822ff4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:27:23.167476 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa46184c-28ab-4f67-b7ec-c562a822ff4a admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:27:23.167751 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa46184c-28ab-4f67-b7ec-c562a822ff4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:27:23.168020 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa46184c-28ab-4f67-b7ec-c562a822ff4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:27:23.168651 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa46184c-28ab-4f67-b7ec-c562a822ff4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:27:23.170246 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa46184c-28ab-4f67-b7ec-c562a822ff4a admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:27:23.180530 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1105/2208] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:27:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:27:23.185116 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ce762f-7ece-4a07-8303-4a9a8dce3371 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:27:23.195898 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ce762f-7ece-4a07-8303-4a9a8dce3371 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:27:23.200563 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590473a5-2e2a-4727-bfcf-d6d2862766e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:27:23.201253 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590473a5-2e2a-4727-bfcf-d6d2862766e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:27:23.201535 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590473a5-2e2a-4727-bfcf-d6d2862766e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:27:23.201810 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590473a5-2e2a-4727-bfcf-d6d2862766e8 admin admin] PATH_INFO: `/v3/projects/830bc1e318334a479442c78694657c56/users/8d56fbdc18d747d0be35d0ad8848a5d2/roles/9371e5bbc55848949eb951a815f817f2` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:27:23.216586 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590473a5-2e2a-4727-bfcf-d6d2862766e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=830bc1e318334a479442c78694657c56, user_id=8d56fbdc18d747d0be35d0ad8848a5d2, role_id=9371e5bbc55848949eb951a815f817f2)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:27:23.219269 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590473a5-2e2a-4727-bfcf-d6d2862766e8 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:27:23.231590 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1104/2209] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:27:23 2022] PUT /identity/v3/projects/830bc1e318334a479442c78694657c56/users/8d56fbdc18d747d0be35d0ad8848a5d2/roles/9371e5bbc55848949eb951a815f817f2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:27:23.242503 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b7926-7551-41bb-a463-faf4b8f4bbb0 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:27:23.242812 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b7926-7551-41bb-a463-faf4b8f4bbb0 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:27:23.243083 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b7926-7551-41bb-a463-faf4b8f4bbb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:27:23.272104 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-b45b7926-7551-41bb-a463-faf4b8f4bbb0 None None] MFA Rules not processed for user `8d56fbdc18d747d0be35d0ad8848a5d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:27:23.273292 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-b45b7926-7551-41bb-a463-faf4b8f4bbb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:27:23.334713 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1106/2210] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:27:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:27:23.345688 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590473a5-2e2a-4727-bfcf-d6d2862766e8 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:27:23.347544 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-590473a5-2e2a-4727-bfcf-d6d2862766e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:27:23.403356 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590473a5-2e2a-4727-bfcf-d6d2862766e8 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:27:23.406941 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd30875-26b8-45de-97e6-dc6f174a04a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceafc5e4283841528053f01931f10293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:27:23.407568 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd30875-26b8-45de-97e6-dc6f174a04a7 service cinder] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:27:23.407848 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd30875-26b8-45de-97e6-dc6f174a04a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:27:23.408120 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd30875-26b8-45de-97e6-dc6f174a04a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:27:23.416250 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd30875-26b8-45de-97e6-dc6f174a04a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:27:23.417670 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd30875-26b8-45de-97e6-dc6f174a04a7 service cinder] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:27:23.426326 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1105/2211] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:27:23 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:27:31.674074 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d24bc-137c-4c67-b99e-a243c316bfe1 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:27:31.674557 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d24bc-137c-4c67-b99e-a243c316bfe1 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:27:31.674717 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d24bc-137c-4c67-b99e-a243c316bfe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:27:31.693700 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-496d24bc-137c-4c67-b99e-a243c316bfe1 None None] MFA Rules not processed for user `983e501359234b31879e5cdfb34ea31a`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:27:31.694995 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-496d24bc-137c-4c67-b99e-a243c316bfe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:27:31.749979 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1107/2212] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:27:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:27:32.906315 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd30875-26b8-45de-97e6-dc6f174a04a7 service cinder] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:27:32.907730 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-0bd30875-26b8-45de-97e6-dc6f174a04a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:27:32.974352 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd30875-26b8-45de-97e6-dc6f174a04a7 service cinder] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:27:32.980193 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a4202d-a9b5-454d-b597-a8c82ef4b6b1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ff8a5ddf1e422ca97f92bd9d4e5fb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:27:32.980803 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a4202d-a9b5-454d-b597-a8c82ef4b6b1 service placement] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:27:32.981085 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a4202d-a9b5-454d-b597-a8c82ef4b6b1 service placement] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:27:32.981374 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a4202d-a9b5-454d-b597-a8c82ef4b6b1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:27:32.983114 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-28a4202d-a9b5-454d-b597-a8c82ef4b6b1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:27:32.994653 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a4202d-a9b5-454d-b597-a8c82ef4b6b1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:27:32.996187 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a4202d-a9b5-454d-b597-a8c82ef4b6b1 service placement] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:27:33.006603 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1106/2213] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:27:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:27:34.534470 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496d24bc-137c-4c67-b99e-a243c316bfe1 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:27:34.570457 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:27:34.603310 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496d24bc-137c-4c67-b99e-a243c316bfe1 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:27:34.608937 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7898b3bb-0820-4e27-9df5-919bce9bc071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:27:34.609649 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7898b3bb-0820-4e27-9df5-919bce9bc071 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:27:34.609994 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7898b3bb-0820-4e27-9df5-919bce9bc071 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:27:34.610551 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7898b3bb-0820-4e27-9df5-919bce9bc071 admin admin] PATH_INFO: `/v3/users/8d56fbdc18d747d0be35d0ad8848a5d2` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:27:34.611720 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7898b3bb-0820-4e27-9df5-919bce9bc071 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d56fbdc18d747d0be35d0ad8848a5d2)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:27:34.613719 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7898b3bb-0820-4e27-9df5-919bce9bc071 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:27:34.683046 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-7898b3bb-0820-4e27-9df5-919bce9bc071 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d56fbdc18d747d0be35d0ad8848a5d2'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:27:34.691880 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-7898b3bb-0820-4e27-9df5-919bce9bc071 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d56fbdc18d747d0be35d0ad8848a5d2'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:27:34.692558 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-7898b3bb-0820-4e27-9df5-919bce9bc071 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d56fbdc18d747d0be35d0ad8848a5d2'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:27:34.693335 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-7898b3bb-0820-4e27-9df5-919bce9bc071 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d56fbdc18d747d0be35d0ad8848a5d2'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:27:34.700894 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-7898b3bb-0820-4e27-9df5-919bce9bc071 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d56fbdc18d747d0be35d0ad8848a5d2'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:27:34.724322 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1108/2214] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:27:34 2022] DELETE /identity/v3/users/8d56fbdc18d747d0be35d0ad8848a5d2 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:27:34.728435 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867cedc-da91-45c3-a628-e03e8efd5a8b None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:27:34.728902 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867cedc-da91-45c3-a628-e03e8efd5a8b None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:27:34.729004 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867cedc-da91-45c3-a628-e03e8efd5a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:27:34.751377 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-6867cedc-da91-45c3-a628-e03e8efd5a8b None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:27:34.753631 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-6867cedc-da91-45c3-a628-e03e8efd5a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:27:34.845943 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1107/2215] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:27:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:27:34.858010 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7898b3bb-0820-4e27-9df5-919bce9bc071 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:27:34.860533 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-7898b3bb-0820-4e27-9df5-919bce9bc071 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:27:34.962730 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7898b3bb-0820-4e27-9df5-919bce9bc071 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:27:34.981061 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4b477c-e727-4106-95da-01e134a1d044 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:27:34.982468 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b477c-e727-4106-95da-01e134a1d044 service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:27:34.982887 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b477c-e727-4106-95da-01e134a1d044 service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:27:34.983345 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b477c-e727-4106-95da-01e134a1d044 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:27:35.010391 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4b477c-e727-4106-95da-01e134a1d044 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:27:35.013062 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4b477c-e727-4106-95da-01e134a1d044 service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:27:35.027628 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1109/2216] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:27:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 12:27:35.592710 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6867cedc-da91-45c3-a628-e03e8efd5a8b None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:27:35.594139 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-6867cedc-da91-45c3-a628-e03e8efd5a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:27:35.607256 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6867cedc-da91-45c3-a628-e03e8efd5a8b None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:27:35.613101 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e65c65f-3fa9-4b87-bf00-54914a54fae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:27:35.613672 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e65c65f-3fa9-4b87-bf00-54914a54fae4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:27:35.614009 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e65c65f-3fa9-4b87-bf00-54914a54fae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:27:35.614444 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e65c65f-3fa9-4b87-bf00-54914a54fae4 admin admin] PATH_INFO: `/v3/projects/830bc1e318334a479442c78694657c56` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:27:35.615605 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e65c65f-3fa9-4b87-bf00-54914a54fae4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=830bc1e318334a479442c78694657c56)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:27:35.617809 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e65c65f-3fa9-4b87-bf00-54914a54fae4 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:27:35.626350 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:27:35.693298 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-9e65c65f-3fa9-4b87-bf00-54914a54fae4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '830bc1e318334a479442c78694657c56', 'request_id': 'req-9e65c65f-3fa9-4b87-bf00-54914a54fae4'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:27:35.702407 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-9e65c65f-3fa9-4b87-bf00-54914a54fae4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '830bc1e318334a479442c78694657c56', 'request_id': 'req-9e65c65f-3fa9-4b87-bf00-54914a54fae4'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:27:35.711774 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-9e65c65f-3fa9-4b87-bf00-54914a54fae4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '830bc1e318334a479442c78694657c56', 'request_id': 'req-9e65c65f-3fa9-4b87-bf00-54914a54fae4'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:27:35.725835 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-9e65c65f-3fa9-4b87-bf00-54914a54fae4 admin admin] The token cache is being invalidate because project 830bc1e318334a479442c78694657c56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:27:35.726124 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-9e65c65f-3fa9-4b87-bf00-54914a54fae4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:27:35.726986 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-9e65c65f-3fa9-4b87-bf00-54914a54fae4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:27:35.728752 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1108/2217] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:27:35 2022] DELETE /identity/v3/projects/830bc1e318334a479442c78694657c56 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:27:35.733683 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f62fa2-aa5d-4d7d-948f-ce55c25a2e08 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:27:35.734117 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f62fa2-aa5d-4d7d-948f-ce55c25a2e08 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:27:35.734309 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f62fa2-aa5d-4d7d-948f-ce55c25a2e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:27:35.754646 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-07f62fa2-aa5d-4d7d-948f-ce55c25a2e08 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:27:35.755920 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-07f62fa2-aa5d-4d7d-948f-ce55c25a2e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:27:35.827563 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:27:35.841911 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1110/2218] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:27:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:27:35.850279 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7542fc92-5faa-4cf4-a8a3-016e17d5314b None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:27:35.850593 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7542fc92-5faa-4cf4-a8a3-016e17d5314b None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:27:35.850910 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7542fc92-5faa-4cf4-a8a3-016e17d5314b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:27:35.870978 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-7542fc92-5faa-4cf4-a8a3-016e17d5314b None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:27:35.872127 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-7542fc92-5faa-4cf4-a8a3-016e17d5314b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:27:35.881098 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1109/2219] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:27:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:27:35.885465 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f62fa2-aa5d-4d7d-948f-ce55c25a2e08 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:27:35.896627 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f62fa2-aa5d-4d7d-948f-ce55c25a2e08 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:27:35.910315 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4c36b2-01f1-40f3-81b0-7d9335279d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:27:35.915762 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c36b2-01f1-40f3-81b0-7d9335279d53 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:27:35.916054 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c36b2-01f1-40f3-81b0-7d9335279d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:27:35.916329 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c36b2-01f1-40f3-81b0-7d9335279d53 admin admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:27:35.917387 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4c36b2-01f1-40f3-81b0-7d9335279d53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:27:35.918000 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4c36b2-01f1-40f3-81b0-7d9335279d53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:27:35.921668 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4c36b2-01f1-40f3-81b0-7d9335279d53 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:27:35.940091 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1111/2220] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 15 12:27:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:27:35.941276 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7542fc92-5faa-4cf4-a8a3-016e17d5314b None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:27:35.950433 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7542fc92-5faa-4cf4-a8a3-016e17d5314b None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:27:35.955730 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ab3bdd-1a1c-4a03-a278-af03da648249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:27:35.956333 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab3bdd-1a1c-4a03-a278-af03da648249 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:27:35.956605 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab3bdd-1a1c-4a03-a278-af03da648249 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:27:35.956870 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab3bdd-1a1c-4a03-a278-af03da648249 admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:27:35.957642 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ab3bdd-1a1c-4a03-a278-af03da648249 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:27:35.959604 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ab3bdd-1a1c-4a03-a278-af03da648249 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:27:35.990340 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1110/2221] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:27:35 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:27:35.994450 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4c36b2-01f1-40f3-81b0-7d9335279d53 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:27:36.005275 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4c36b2-01f1-40f3-81b0-7d9335279d53 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:27:36.069191 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a34a27d-eff3-47c5-ac70-2558176de7f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:27:36.069815 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a34a27d-eff3-47c5-ac70-2558176de7f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:27:36.070099 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a34a27d-eff3-47c5-ac70-2558176de7f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:27:36.070377 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a34a27d-eff3-47c5-ac70-2558176de7f9 admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:27:36.071232 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a34a27d-eff3-47c5-ac70-2558176de7f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:27:36.073159 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a34a27d-eff3-47c5-ac70-2558176de7f9 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:27:36.102752 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1112/2222] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:27:35 2022] POST /identity/v3/users => generated 292 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:27:36.104520 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ab3bdd-1a1c-4a03-a278-af03da648249 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:27:36.117880 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ab3bdd-1a1c-4a03-a278-af03da648249 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:27:36.126311 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a343a815-5c30-4c70-8366-d93d96856fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:27:36.127390 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a343a815-5c30-4c70-8366-d93d96856fc8 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:27:36.128050 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a343a815-5c30-4c70-8366-d93d96856fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:27:36.128340 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a343a815-5c30-4c70-8366-d93d96856fc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:27:36.129003 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a343a815-5c30-4c70-8366-d93d96856fc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:27:36.131046 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a343a815-5c30-4c70-8366-d93d96856fc8 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:27:36.143708 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1111/2223] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:27:36 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:27:36.148039 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a34a27d-eff3-47c5-ac70-2558176de7f9 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:27:36.162830 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a34a27d-eff3-47c5-ac70-2558176de7f9 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:27:36.168332 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a48cf01-d490-4817-a5d3-59cb95cb54eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:27:36.168942 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48cf01-d490-4817-a5d3-59cb95cb54eb admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:27:36.169225 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48cf01-d490-4817-a5d3-59cb95cb54eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:27:36.169503 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48cf01-d490-4817-a5d3-59cb95cb54eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:27:36.170297 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a48cf01-d490-4817-a5d3-59cb95cb54eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:27:36.172448 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a48cf01-d490-4817-a5d3-59cb95cb54eb admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:27:36.197884 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1113/2224] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:27:36 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:27:36.199876 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a343a815-5c30-4c70-8366-d93d96856fc8 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:27:36.212596 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a343a815-5c30-4c70-8366-d93d96856fc8 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:27:36.218104 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0502c02a-bede-48df-8106-d8c01e480e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:27:36.218897 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0502c02a-bede-48df-8106-d8c01e480e69 admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:27:36.219231 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0502c02a-bede-48df-8106-d8c01e480e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:27:36.219517 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0502c02a-bede-48df-8106-d8c01e480e69 admin admin] PATH_INFO: `/v3/projects/08edd7bc35ec4123b17b3bbe0bc3c763/users/c497af3978444ea9a99023e8af121fa9/roles/9371e5bbc55848949eb951a815f817f2` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:27:36.237151 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0502c02a-bede-48df-8106-d8c01e480e69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08edd7bc35ec4123b17b3bbe0bc3c763, user_id=c497af3978444ea9a99023e8af121fa9, role_id=9371e5bbc55848949eb951a815f817f2)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:27:36.243637 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0502c02a-bede-48df-8106-d8c01e480e69 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:27:36.262217 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1112/2225] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:27:36 2022] PUT /identity/v3/projects/08edd7bc35ec4123b17b3bbe0bc3c763/users/c497af3978444ea9a99023e8af121fa9/roles/9371e5bbc55848949eb951a815f817f2 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:27:36.267722 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee01718c-9f2b-42c5-aced-7a7e3056adf8 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:27:36.268156 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee01718c-9f2b-42c5-aced-7a7e3056adf8 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:27:36.268621 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee01718c-9f2b-42c5-aced-7a7e3056adf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:27:36.296418 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-ee01718c-9f2b-42c5-aced-7a7e3056adf8 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:27:36.298637 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-ee01718c-9f2b-42c5-aced-7a7e3056adf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:27:36.367822 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1114/2226] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:27:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:27:36.378667 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0502c02a-bede-48df-8106-d8c01e480e69 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:27:36.380373 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-0502c02a-bede-48df-8106-d8c01e480e69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:27:36.437469 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0502c02a-bede-48df-8106-d8c01e480e69 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:27:36.441132 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a6ff4-acbb-40eb-9d55-f5522a59a8f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:27:36.441731 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a6ff4-acbb-40eb-9d55-f5522a59a8f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:27:36.442009 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a6ff4-acbb-40eb-9d55-f5522a59a8f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:27:36.442282 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a6ff4-acbb-40eb-9d55-f5522a59a8f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:27:36.451022 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6a6ff4-acbb-40eb-9d55-f5522a59a8f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:27:36.452443 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6a6ff4-acbb-40eb-9d55-f5522a59a8f6 service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:27:36.462130 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1113/2227] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:27:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:27:41.569530 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18683ba-2a02-48f6-9b7a-fec9a5e87be3 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:27:41.569530 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18683ba-2a02-48f6-9b7a-fec9a5e87be3 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:27:41.569530 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18683ba-2a02-48f6-9b7a-fec9a5e87be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:27:41.645097 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-f18683ba-2a02-48f6-9b7a-fec9a5e87be3 None None] MFA Rules not processed for user `c497af3978444ea9a99023e8af121fa9`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:27:41.647431 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-f18683ba-2a02-48f6-9b7a-fec9a5e87be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:27:41.717536 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:27:41.750759 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1115/2228] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:27:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:27:41.755527 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a6ff4-acbb-40eb-9d55-f5522a59a8f6 service neutron] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:27:41.767302 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a6ff4-acbb-40eb-9d55-f5522a59a8f6 service neutron] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:27:41.781369 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288a6dcf-1b47-4784-b232-ab75b13aac6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:27:41.782812 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288a6dcf-1b47-4784-b232-ab75b13aac6c admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:27:41.783108 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288a6dcf-1b47-4784-b232-ab75b13aac6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:27:41.783595 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288a6dcf-1b47-4784-b232-ab75b13aac6c admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:27:41.784420 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288a6dcf-1b47-4784-b232-ab75b13aac6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:27:41.787158 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288a6dcf-1b47-4784-b232-ab75b13aac6c admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:27:41.844978 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1114/2229] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:27:41 2022] POST /identity/v3/projects => generated 385 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:27:41.848917 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18683ba-2a02-48f6-9b7a-fec9a5e87be3 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:27:41.871210 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18683ba-2a02-48f6-9b7a-fec9a5e87be3 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:27:41.979792 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4379028b-e76e-493e-bded-c2cb9b715036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:27:41.980711 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4379028b-e76e-493e-bded-c2cb9b715036 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:27:41.980991 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4379028b-e76e-493e-bded-c2cb9b715036 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:27:41.981261 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4379028b-e76e-493e-bded-c2cb9b715036 admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:27:41.981913 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4379028b-e76e-493e-bded-c2cb9b715036 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:27:41.983905 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4379028b-e76e-493e-bded-c2cb9b715036 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:27:42.010411 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1116/2230] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:27:41 2022] POST /identity/v3/users => generated 299 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 12:27:42.014093 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288a6dcf-1b47-4784-b232-ab75b13aac6c admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:27:42.030810 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288a6dcf-1b47-4784-b232-ab75b13aac6c admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:27:42.037705 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970b3f8e-ca9f-46f4-9177-2a866cb5d1d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:27:42.038603 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b3f8e-ca9f-46f4-9177-2a866cb5d1d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:27:42.039423 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b3f8e-ca9f-46f4-9177-2a866cb5d1d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:27:42.039984 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b3f8e-ca9f-46f4-9177-2a866cb5d1d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:27:42.041143 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970b3f8e-ca9f-46f4-9177-2a866cb5d1d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:27:42.042794 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970b3f8e-ca9f-46f4-9177-2a866cb5d1d5 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:27:42.045734 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:27:42.060122 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1115/2231] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:27:42 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:27:42.065174 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4379028b-e76e-493e-bded-c2cb9b715036 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:27:42.076795 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4379028b-e76e-493e-bded-c2cb9b715036 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:27:42.083121 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42e928c-eb07-4b18-a9d6-f80376144b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:27:42.083799 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e928c-eb07-4b18-a9d6-f80376144b15 admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:27:42.084073 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e928c-eb07-4b18-a9d6-f80376144b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:27:42.084341 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e928c-eb07-4b18-a9d6-f80376144b15 admin admin] PATH_INFO: `/v3/projects/6c6a27e93f6546e8b23c1376857833a8/users/7e953821c50b4a79862d8edb18ac4476/roles/7f53f1c823b746529ba5057bf21b2477` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:27:42.100682 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42e928c-eb07-4b18-a9d6-f80376144b15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c6a27e93f6546e8b23c1376857833a8, user_id=7e953821c50b4a79862d8edb18ac4476, role_id=7f53f1c823b746529ba5057bf21b2477)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:27:42.103505 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42e928c-eb07-4b18-a9d6-f80376144b15 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:27:42.121531 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1117/2232] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:27:42 2022] PUT /identity/v3/projects/6c6a27e93f6546e8b23c1376857833a8/users/7e953821c50b4a79862d8edb18ac4476/roles/7f53f1c823b746529ba5057bf21b2477 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:27:42.122454 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970b3f8e-ca9f-46f4-9177-2a866cb5d1d5 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:27:42.157507 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970b3f8e-ca9f-46f4-9177-2a866cb5d1d5 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:27:42.220699 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db3e52a-068c-4e3b-894e-7daaf4cdb41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:27:42.221349 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db3e52a-068c-4e3b-894e-7daaf4cdb41d admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:27:42.221631 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db3e52a-068c-4e3b-894e-7daaf4cdb41d admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:27:42.221902 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db3e52a-068c-4e3b-894e-7daaf4cdb41d admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:27:42.222550 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db3e52a-068c-4e3b-894e-7daaf4cdb41d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:27:42.224285 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db3e52a-068c-4e3b-894e-7daaf4cdb41d admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:27:42.235443 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1116/2233] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:27:42 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 12:27:42.239738 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42e928c-eb07-4b18-a9d6-f80376144b15 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:27:42.250912 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42e928c-eb07-4b18-a9d6-f80376144b15 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:27:42.258486 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9813201-86d6-40ab-89fe-53e0755887d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:27:42.259264 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9813201-86d6-40ab-89fe-53e0755887d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:27:42.259613 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9813201-86d6-40ab-89fe-53e0755887d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:27:42.259893 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9813201-86d6-40ab-89fe-53e0755887d0 admin admin] PATH_INFO: `/v3/projects/6c6a27e93f6546e8b23c1376857833a8/users/7e953821c50b4a79862d8edb18ac4476/roles/7f53f1c823b746529ba5057bf21b2477` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:27:42.261829 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9813201-86d6-40ab-89fe-53e0755887d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c6a27e93f6546e8b23c1376857833a8, user_id=7e953821c50b4a79862d8edb18ac4476, role_id=7f53f1c823b746529ba5057bf21b2477)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:27:42.264507 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9813201-86d6-40ab-89fe-53e0755887d0 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:27:42.275792 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1118/2234] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:27:42 2022] PUT /identity/v3/projects/6c6a27e93f6546e8b23c1376857833a8/users/7e953821c50b4a79862d8edb18ac4476/roles/7f53f1c823b746529ba5057bf21b2477 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:27:44.691638 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eaf36f-d69e-4540-8259-c1028fb6ce20 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:27:44.692093 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eaf36f-d69e-4540-8259-c1028fb6ce20 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:27:44.692093 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eaf36f-d69e-4540-8259-c1028fb6ce20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:27:44.718929 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-46eaf36f-d69e-4540-8259-c1028fb6ce20 None None] MFA Rules not processed for user `b4614bede59c47ea813a73fcc0840a2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:27:44.721908 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-46eaf36f-d69e-4540-8259-c1028fb6ce20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:27:44.808667 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1117/2235] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Sep 15 12:27:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:27:44.822223 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9813201-86d6-40ab-89fe-53e0755887d0 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:27:44.827094 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-e9813201-86d6-40ab-89fe-53e0755887d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:27:44.958367 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9813201-86d6-40ab-89fe-53e0755887d0 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:27:44.970173 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7ad01d-107d-453d-bc47-8c2626d47cf3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee33b730d0ec428ca2cd3af4ebf723e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:27:44.970870 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ad01d-107d-453d-bc47-8c2626d47cf3 service swift] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:27:44.971147 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ad01d-107d-453d-bc47-8c2626d47cf3 service swift] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:27:44.971412 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ad01d-107d-453d-bc47-8c2626d47cf3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:27:44.982219 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7ad01d-107d-453d-bc47-8c2626d47cf3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:27:44.983903 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7ad01d-107d-453d-bc47-8c2626d47cf3 service swift] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:27:45.026556 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1119/2236] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Sep 15 12:27:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 12:27:48.683035 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960c775-bc9c-4107-8772-89ba94bf4ca2 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:27:48.683955 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960c775-bc9c-4107-8772-89ba94bf4ca2 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:27:48.684395 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960c775-bc9c-4107-8772-89ba94bf4ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:27:48.718302 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-8960c775-bc9c-4107-8772-89ba94bf4ca2 None None] MFA Rules not processed for user `7e953821c50b4a79862d8edb18ac4476`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:27:48.720247 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-8960c775-bc9c-4107-8772-89ba94bf4ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:27:48.873198 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1118/2237] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:27:48 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:27:48.881673 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7ad01d-107d-453d-bc47-8c2626d47cf3 service swift] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:27:48.883202 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-1d7ad01d-107d-453d-bc47-8c2626d47cf3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:27:48.958451 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:27:49.014888 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7ad01d-107d-453d-bc47-8c2626d47cf3 service swift] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:27:49.023201 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd71c68-3f45-4522-a2c1-7a41de9e86f1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd057b651769b4ae99c1d4f2b0fc31fb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:27:49.025316 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd71c68-3f45-4522-a2c1-7a41de9e86f1 service glance] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:27:49.026537 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd71c68-3f45-4522-a2c1-7a41de9e86f1 service glance] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:27:49.027569 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd71c68-3f45-4522-a2c1-7a41de9e86f1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:27:49.128961 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd71c68-3f45-4522-a2c1-7a41de9e86f1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:27:49.130600 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd71c68-3f45-4522-a2c1-7a41de9e86f1 service glance] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:27:49.147569 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1120/2238] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:27:48 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:27:49.337703 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95800908-ffe1-457d-9f89-89ff5ea90763 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:27:49.338303 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95800908-ffe1-457d-9f89-89ff5ea90763 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:27:49.338786 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95800908-ffe1-457d-9f89-89ff5ea90763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:27:49.380879 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-95800908-ffe1-457d-9f89-89ff5ea90763 None None] MFA Rules not processed for user `b4614bede59c47ea813a73fcc0840a2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:27:49.382209 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-95800908-ffe1-457d-9f89-89ff5ea90763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:27:49.396697 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1119/2239] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Sep 15 12:27:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:27:49.413271 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd71c68-3f45-4522-a2c1-7a41de9e86f1 service glance] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:27:49.426845 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd71c68-3f45-4522-a2c1-7a41de9e86f1 service glance] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:27:49.438237 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ec3f69-0440-4ec0-89f7-1011ba2ed049 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee33b730d0ec428ca2cd3af4ebf723e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:27:49.438907 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec3f69-0440-4ec0-89f7-1011ba2ed049 service swift] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:27:49.439191 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec3f69-0440-4ec0-89f7-1011ba2ed049 service swift] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:27:49.439471 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec3f69-0440-4ec0-89f7-1011ba2ed049 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:27:49.472080 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ec3f69-0440-4ec0-89f7-1011ba2ed049 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:27:49.474222 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ec3f69-0440-4ec0-89f7-1011ba2ed049 service swift] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:27:49.487646 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1121/2240] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Sep 15 12:27:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 12:27:59.363157 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=92 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:27:59.481777 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=40 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:28:02.602984 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54acec36-3285-44d6-ba22-6a91a5284b0d None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:28:02.603603 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54acec36-3285-44d6-ba22-6a91a5284b0d None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:28:02.603603 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54acec36-3285-44d6-ba22-6a91a5284b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:28:02.623478 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-54acec36-3285-44d6-ba22-6a91a5284b0d None None] MFA Rules not processed for user `c497af3978444ea9a99023e8af121fa9`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:28:02.624678 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-54acec36-3285-44d6-ba22-6a91a5284b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:28:02.632208 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1120/2241] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:28:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:28:04.445369 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6220405f-804e-42d3-8ee4-b3226db9947a None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:28:04.445912 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6220405f-804e-42d3-8ee4-b3226db9947a None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:28:04.445912 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6220405f-804e-42d3-8ee4-b3226db9947a None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:28:04.447293 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1122/2242] 10.222.0.16 () {54 vars in 921 bytes} [Thu Sep 15 12:28:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:28:04.454165 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22ab3e3-6376-4cbf-b69a-8fa803fd59c9 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:28:04.454624 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22ab3e3-6376-4cbf-b69a-8fa803fd59c9 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:28:04.454748 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22ab3e3-6376-4cbf-b69a-8fa803fd59c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:28:04.476725 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-a22ab3e3-6376-4cbf-b69a-8fa803fd59c9 None None] MFA Rules not processed for user `9d05c52570474820b4ba0e2cdad5c13f`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:28:04.477918 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-a22ab3e3-6376-4cbf-b69a-8fa803fd59c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:28:04.553597 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1121/2243] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Sep 15 12:28:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:28:04.568704 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6220405f-804e-42d3-8ee4-b3226db9947a None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:28:04.570673 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-6220405f-804e-42d3-8ee4-b3226db9947a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:28:04.593914 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6220405f-804e-42d3-8ee4-b3226db9947a None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:28:04.597475 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbcff55-f66f-4fc5-8356-a2880f7b8c62 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd057b651769b4ae99c1d4f2b0fc31fb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:28:04.598078 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbcff55-f66f-4fc5-8356-a2880f7b8c62 service glance] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:28:04.598353 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbcff55-f66f-4fc5-8356-a2880f7b8c62 service glance] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:28:04.598622 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbcff55-f66f-4fc5-8356-a2880f7b8c62 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:28:04.609806 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbcff55-f66f-4fc5-8356-a2880f7b8c62 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:28:04.611371 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbcff55-f66f-4fc5-8356-a2880f7b8c62 service glance] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:28:04.624171 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1123/2244] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:28:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:28:04.700076 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d86e577-bc5b-4445-9116-edbd18c92f33 None None] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:28:04.700366 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d86e577-bc5b-4445-9116-edbd18c92f33 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:28:04.700666 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d86e577-bc5b-4445-9116-edbd18c92f33 None None] PATH_INFO: `/` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:28:04.702234 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1122/2245] 10.222.0.16 () {54 vars in 921 bytes} [Thu Sep 15 12:28:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:28:04.707572 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd684683-5533-4034-9f3c-891c11a6bc9c None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:28:04.707881 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd684683-5533-4034-9f3c-891c11a6bc9c None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:28:04.708187 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd684683-5533-4034-9f3c-891c11a6bc9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:28:04.729660 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-dd684683-5533-4034-9f3c-891c11a6bc9c None None] MFA Rules not processed for user `4003dbcee8104aa4a7ce90251bab88a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:28:04.731294 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-dd684683-5533-4034-9f3c-891c11a6bc9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:28:04.806862 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1124/2246] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Sep 15 12:28:04 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:28:04.832943 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d86e577-bc5b-4445-9116-edbd18c92f33 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:28:04.835372 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-7d86e577-bc5b-4445-9116-edbd18c92f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:28:04.849343 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d86e577-bc5b-4445-9116-edbd18c92f33 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:28:04.853237 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a42399-8dea-4c57-a0ea-a2cec5aaf065 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:28:04.853864 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a42399-8dea-4c57-a0ea-a2cec5aaf065 service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:28:04.854141 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a42399-8dea-4c57-a0ea-a2cec5aaf065 service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:28:04.854409 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a42399-8dea-4c57-a0ea-a2cec5aaf065 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:28:04.862265 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a42399-8dea-4c57-a0ea-a2cec5aaf065 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:28:04.863776 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a42399-8dea-4c57-a0ea-a2cec5aaf065 service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:28:04.871624 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1123/2247] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:28:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 12:28:04.966060 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00b4b01-b078-4c55-b8a9-ebb4615c0666 None None] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:28:04.967043 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00b4b01-b078-4c55-b8a9-ebb4615c0666 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:28:04.967407 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00b4b01-b078-4c55-b8a9-ebb4615c0666 None None] PATH_INFO: `/` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:28:04.969687 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1125/2248] 10.222.0.16 () {54 vars in 921 bytes} [Thu Sep 15 12:28:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 12:28:04.977837 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed3482-e5f0-4d3e-8c3c-983f4c1402f1 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:28:04.978364 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed3482-e5f0-4d3e-8c3c-983f4c1402f1 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:28:04.978815 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed3482-e5f0-4d3e-8c3c-983f4c1402f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:28:04.998450 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53766ca2-7df6-421e-b14d-621cbaad40b2 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:28:04.998961 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53766ca2-7df6-421e-b14d-621cbaad40b2 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:28:04.999456 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53766ca2-7df6-421e-b14d-621cbaad40b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:28:05.003239 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-6eed3482-e5f0-4d3e-8c3c-983f4c1402f1 None None] MFA Rules not processed for user `9d05c52570474820b4ba0e2cdad5c13f`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:28:05.004486 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-6eed3482-e5f0-4d3e-8c3c-983f4c1402f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:28:05.015526 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1124/2249] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Sep 15 12:28:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:28:05.026269 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-53766ca2-7df6-421e-b14d-621cbaad40b2 None None] MFA Rules not processed for user `b4614bede59c47ea813a73fcc0840a2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:28:05.027332 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eed3482-e5f0-4d3e-8c3c-983f4c1402f1 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:28:05.027512 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-53766ca2-7df6-421e-b14d-621cbaad40b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:28:05.036556 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1126/2250] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Sep 15 12:28:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:28:05.037655 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eed3482-e5f0-4d3e-8c3c-983f4c1402f1 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:28:05.041542 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2a2fa0-a0cb-4623-a356-c2817ebca23d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:28:05.042860 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a2fa0-a0cb-4623-a356-c2817ebca23d service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:28:05.042860 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a2fa0-a0cb-4623-a356-c2817ebca23d service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:28:05.042860 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a2fa0-a0cb-4623-a356-c2817ebca23d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:28:05.054725 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53766ca2-7df6-421e-b14d-621cbaad40b2 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:28:05.054882 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2a2fa0-a0cb-4623-a356-c2817ebca23d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:28:05.056365 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2a2fa0-a0cb-4623-a356-c2817ebca23d service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:28:05.067789 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53766ca2-7df6-421e-b14d-621cbaad40b2 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:28:05.071009 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1125/2251] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:28:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 12:28:05.073741 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fb47a0-3ddf-474c-89c8-4c0c4c1675e0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee33b730d0ec428ca2cd3af4ebf723e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:28:05.074531 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb47a0-3ddf-474c-89c8-4c0c4c1675e0 service swift] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:28:05.074881 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb47a0-3ddf-474c-89c8-4c0c4c1675e0 service swift] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:28:05.075251 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb47a0-3ddf-474c-89c8-4c0c4c1675e0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:28:05.084992 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fb47a0-3ddf-474c-89c8-4c0c4c1675e0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:28:05.086722 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fb47a0-3ddf-474c-89c8-4c0c4c1675e0 service swift] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:28:05.096225 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1127/2252] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Sep 15 12:28:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 15 12:28:15.065221 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=49 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:28:15.091828 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=38 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:28:27.385557 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6407bd77-8dbf-4d93-8f31-cc87f6550cbe None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:28:27.386024 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6407bd77-8dbf-4d93-8f31-cc87f6550cbe None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:28:27.386126 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6407bd77-8dbf-4d93-8f31-cc87f6550cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:28:27.406408 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-6407bd77-8dbf-4d93-8f31-cc87f6550cbe None None] MFA Rules not processed for user `b4614bede59c47ea813a73fcc0840a2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:28:27.407742 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-6407bd77-8dbf-4d93-8f31-cc87f6550cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:28:27.415725 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1126/2253] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Sep 15 12:28:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:28:27.427850 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fb47a0-3ddf-474c-89c8-4c0c4c1675e0 service swift] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:28:27.438151 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fb47a0-3ddf-474c-89c8-4c0c4c1675e0 service swift] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:28:27.443711 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1647f4-cb2b-4393-862a-730068d2c669 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee33b730d0ec428ca2cd3af4ebf723e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:28:27.444414 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1647f4-cb2b-4393-862a-730068d2c669 service swift] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:28:27.444692 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1647f4-cb2b-4393-862a-730068d2c669 service swift] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:28:27.444959 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1647f4-cb2b-4393-862a-730068d2c669 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:28:27.453192 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1647f4-cb2b-4393-862a-730068d2c669 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:28:27.454801 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1647f4-cb2b-4393-862a-730068d2c669 service swift] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:28:27.464494 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1128/2254] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Sep 15 12:28:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 12:28:37.401394 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=3 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:28:37.460892 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=6 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:28:50.374480 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd55f35c-e987-4f25-abfe-39731b0d4774 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:28:50.375153 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd55f35c-e987-4f25-abfe-39731b0d4774 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:28:50.375153 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd55f35c-e987-4f25-abfe-39731b0d4774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:28:50.397517 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-dd55f35c-e987-4f25-abfe-39731b0d4774 None None] MFA Rules not processed for user `fc120edcf30a4775a502c8e31811da4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:28:50.398801 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-dd55f35c-e987-4f25-abfe-39731b0d4774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:28:50.457688 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1127/2255] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:28:50 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:28:52.402052 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abcabf6-25d3-47f1-8fbe-280286a06457 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:28:52.402587 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abcabf6-25d3-47f1-8fbe-280286a06457 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:28:52.402587 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abcabf6-25d3-47f1-8fbe-280286a06457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:28:52.422715 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-1abcabf6-25d3-47f1-8fbe-280286a06457 None None] MFA Rules not processed for user `b4614bede59c47ea813a73fcc0840a2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:28:52.423934 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-1abcabf6-25d3-47f1-8fbe-280286a06457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:28:52.431720 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1129/2256] 10.222.0.16 () {58 vars in 967 bytes} [Thu Sep 15 12:28:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:28:52.444994 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd55f35c-e987-4f25-abfe-39731b0d4774 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:28:52.455459 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd55f35c-e987-4f25-abfe-39731b0d4774 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:28:52.460398 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ad48d7-f82a-4f70-8cf1-754eef1d24f1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee33b730d0ec428ca2cd3af4ebf723e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:28:52.460998 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ad48d7-f82a-4f70-8cf1-754eef1d24f1 service swift] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:28:52.461276 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ad48d7-f82a-4f70-8cf1-754eef1d24f1 service swift] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:28:52.461548 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ad48d7-f82a-4f70-8cf1-754eef1d24f1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:28:52.470474 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ad48d7-f82a-4f70-8cf1-754eef1d24f1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:28:52.472107 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ad48d7-f82a-4f70-8cf1-754eef1d24f1 service swift] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:28:52.480447 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1128/2257] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Sep 15 12:28:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 12:28:55.823353 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abcabf6-25d3-47f1-8fbe-280286a06457 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:28:55.832564 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abcabf6-25d3-47f1-8fbe-280286a06457 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:28:55.836676 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9b0481-649f-4994-b06c-f2fcecf5124e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:28:55.837265 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b0481-649f-4994-b06c-f2fcecf5124e service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:28:55.837538 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b0481-649f-4994-b06c-f2fcecf5124e service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:28:55.837804 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b0481-649f-4994-b06c-f2fcecf5124e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:28:55.846415 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9b0481-649f-4994-b06c-f2fcecf5124e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:28:55.847857 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9b0481-649f-4994-b06c-f2fcecf5124e service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:28:55.856993 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1130/2258] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:28:55 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:29:02.477268 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=31 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:29:05.852944 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=9 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:29:23.532800 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ad48d7-f82a-4f70-8cf1-754eef1d24f1 service swift] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:29:23.549555 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ad48d7-f82a-4f70-8cf1-754eef1d24f1 service swift] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:29:23.553771 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ee1108-d353-4ab9-a23f-008225c59c77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:29:23.554474 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee1108-d353-4ab9-a23f-008225c59c77 service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:29:23.554829 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee1108-d353-4ab9-a23f-008225c59c77 service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:29:23.555321 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee1108-d353-4ab9-a23f-008225c59c77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:29:23.558141 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-85ee1108-d353-4ab9-a23f-008225c59c77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:29:23.577412 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ee1108-d353-4ab9-a23f-008225c59c77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:29:23.578957 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ee1108-d353-4ab9-a23f-008225c59c77 service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:29:23.590300 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1129/2259] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:29:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:29:24.029622 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9b0481-649f-4994-b06c-f2fcecf5124e service neutron] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:29:24.038402 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9b0481-649f-4994-b06c-f2fcecf5124e service neutron] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:29:24.042673 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7d5334-3481-4c9c-ab07-6f5b37075add service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:29:24.043295 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d5334-3481-4c9c-ab07-6f5b37075add service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:29:24.043590 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d5334-3481-4c9c-ab07-6f5b37075add service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:29:24.043888 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d5334-3481-4c9c-ab07-6f5b37075add service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:29:24.045602 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-1e7d5334-3481-4c9c-ab07-6f5b37075add service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:29:24.059800 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7d5334-3481-4c9c-ab07-6f5b37075add service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:29:24.061344 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7d5334-3481-4c9c-ab07-6f5b37075add service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:29:24.073327 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1131/2260] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:29:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:29:33.585304 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=6 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:29:34.067768 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=6 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:29:36.231478 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d82d0-8ad7-4362-b3ac-8d29c45abc43 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:29:36.231990 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d82d0-8ad7-4362-b3ac-8d29c45abc43 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:29:36.232083 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d82d0-8ad7-4362-b3ac-8d29c45abc43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:29:36.252717 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-071d82d0-8ad7-4362-b3ac-8d29c45abc43 None None] MFA Rules not processed for user `983e501359234b31879e5cdfb34ea31a`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:29:36.253944 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-071d82d0-8ad7-4362-b3ac-8d29c45abc43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:29:36.308774 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1130/2261] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:29:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:29:36.914041 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7d5334-3481-4c9c-ab07-6f5b37075add service neutron] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:29:36.915538 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-1e7d5334-3481-4c9c-ab07-6f5b37075add service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:29:36.929762 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7d5334-3481-4c9c-ab07-6f5b37075add service neutron] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:29:36.935528 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33d2879-da85-4064-8ca2-57e5f6d32f54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d05c52570474820b4ba0e2cdad5c13f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:29:36.936122 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d2879-da85-4064-8ca2-57e5f6d32f54 service nova] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:29:36.936401 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d2879-da85-4064-8ca2-57e5f6d32f54 service nova] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:29:36.936668 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d2879-da85-4064-8ca2-57e5f6d32f54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:29:36.939132 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-e33d2879-da85-4064-8ca2-57e5f6d32f54 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:29:36.950156 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33d2879-da85-4064-8ca2-57e5f6d32f54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:29:36.951769 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33d2879-da85-4064-8ca2-57e5f6d32f54 service nova] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:29:36.960711 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1132/2262] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:29:36 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:29:46.301419 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=25 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:29:46.956516 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=6 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:30:01.675498 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071d82d0-8ad7-4362-b3ac-8d29c45abc43 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:01.688581 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071d82d0-8ad7-4362-b3ac-8d29c45abc43 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:01.693931 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3971d66-9e13-4157-8c94-f79fa31ea44e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d05c52570474820b4ba0e2cdad5c13f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:01.694525 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3971d66-9e13-4157-8c94-f79fa31ea44e service nova] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:01.694839 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3971d66-9e13-4157-8c94-f79fa31ea44e service nova] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:01.695112 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3971d66-9e13-4157-8c94-f79fa31ea44e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:01.696827 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-a3971d66-9e13-4157-8c94-f79fa31ea44e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:30:01.754344 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3971d66-9e13-4157-8c94-f79fa31ea44e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:01.755943 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3971d66-9e13-4157-8c94-f79fa31ea44e service nova] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:01.765397 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1131/2263] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:30:01 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:30:05.865280 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33d2879-da85-4064-8ca2-57e5f6d32f54 service nova] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:05.866796 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-e33d2879-da85-4064-8ca2-57e5f6d32f54 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:30:05.924635 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33d2879-da85-4064-8ca2-57e5f6d32f54 service nova] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:05.928287 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e23512a-e8b1-410e-83bc-72bedc201626 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceafc5e4283841528053f01931f10293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:05.928890 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e23512a-e8b1-410e-83bc-72bedc201626 service cinder] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:05.929164 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e23512a-e8b1-410e-83bc-72bedc201626 service cinder] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:05.929439 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e23512a-e8b1-410e-83bc-72bedc201626 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:05.931161 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-1e23512a-e8b1-410e-83bc-72bedc201626 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:30:05.942843 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e23512a-e8b1-410e-83bc-72bedc201626 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:05.944276 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e23512a-e8b1-410e-83bc-72bedc201626 service cinder] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:05.953745 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1133/2264] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:30:05 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:30:06.702069 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3971d66-9e13-4157-8c94-f79fa31ea44e service nova] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:06.713008 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3971d66-9e13-4157-8c94-f79fa31ea44e service nova] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:06.719108 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d56ecc-cdcc-41ca-821a-4505525f7b94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d05c52570474820b4ba0e2cdad5c13f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:06.719713 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d56ecc-cdcc-41ca-821a-4505525f7b94 service nova] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:06.719995 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d56ecc-cdcc-41ca-821a-4505525f7b94 service nova] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:06.720289 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d56ecc-cdcc-41ca-821a-4505525f7b94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:06.722025 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-47d56ecc-cdcc-41ca-821a-4505525f7b94 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:30:06.735613 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d56ecc-cdcc-41ca-821a-4505525f7b94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:06.737353 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d56ecc-cdcc-41ca-821a-4505525f7b94 service nova] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:06.759169 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1132/2265] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:30:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:30:13.594441 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c749475-6f52-4bf1-9ce4-7737ec13a6a5 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:13.595065 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c749475-6f52-4bf1-9ce4-7737ec13a6a5 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:13.595065 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c749475-6f52-4bf1-9ce4-7737ec13a6a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:13.615398 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-0c749475-6f52-4bf1-9ce4-7737ec13a6a5 None None] MFA Rules not processed for user `2c5895375da54d2e9b51d59de4f98fe7`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:30:13.616611 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-0c749475-6f52-4bf1-9ce4-7737ec13a6a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:30:13.624604 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1134/2266] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:30:13 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:30:13.965249 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d56ecc-cdcc-41ca-821a-4505525f7b94 service nova] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:13.977515 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d56ecc-cdcc-41ca-821a-4505525f7b94 service nova] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:13.985059 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e199d9cc-0422-434a-a98f-a2e76c803c99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:13.985768 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e199d9cc-0422-434a-a98f-a2e76c803c99 service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:13.986290 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e199d9cc-0422-434a-a98f-a2e76c803c99 service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:13.986632 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e199d9cc-0422-434a-a98f-a2e76c803c99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:13.988781 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-e199d9cc-0422-434a-a98f-a2e76c803c99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:30:14.001041 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e199d9cc-0422-434a-a98f-a2e76c803c99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:14.004064 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e199d9cc-0422-434a-a98f-a2e76c803c99 service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:14.015185 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1133/2267] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:30:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:30:14.366778 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c749475-6f52-4bf1-9ce4-7737ec13a6a5 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:14.368205 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-0c749475-6f52-4bf1-9ce4-7737ec13a6a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:30:14.417879 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e199d9cc-0422-434a-a98f-a2e76c803c99 service neutron] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:14.432809 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e199d9cc-0422-434a-a98f-a2e76c803c99 service neutron] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:14.444072 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a35b5a-a36a-4d7e-a7ea-88aebce00274 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:14.445455 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a35b5a-a36a-4d7e-a7ea-88aebce00274 service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:14.445900 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a35b5a-a36a-4d7e-a7ea-88aebce00274 service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:14.446972 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a35b5a-a36a-4d7e-a7ea-88aebce00274 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:14.449220 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-09a35b5a-a36a-4d7e-a7ea-88aebce00274 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:30:14.453263 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c749475-6f52-4bf1-9ce4-7737ec13a6a5 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:14.459237 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53080b12-9977-4e57-b26c-b66a1106a62a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ff8a5ddf1e422ca97f92bd9d4e5fb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:14.459842 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53080b12-9977-4e57-b26c-b66a1106a62a service placement] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:14.460114 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53080b12-9977-4e57-b26c-b66a1106a62a service placement] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:14.460381 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53080b12-9977-4e57-b26c-b66a1106a62a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:14.461491 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a35b5a-a36a-4d7e-a7ea-88aebce00274 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:14.462894 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-53080b12-9977-4e57-b26c-b66a1106a62a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:30:14.463117 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a35b5a-a36a-4d7e-a7ea-88aebce00274 service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:14.473289 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1134/2268] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:30:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 12:30:14.476144 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53080b12-9977-4e57-b26c-b66a1106a62a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:14.477801 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53080b12-9977-4e57-b26c-b66a1106a62a service placement] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:14.489042 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1135/2269] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:30:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:30:23.103347 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a35b5a-a36a-4d7e-a7ea-88aebce00274 service neutron] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:23.119638 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a35b5a-a36a-4d7e-a7ea-88aebce00274 service neutron] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:23.131363 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd0372e-6077-4c93-9b87-a2c90afb4805 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d05c52570474820b4ba0e2cdad5c13f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:23.132347 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd0372e-6077-4c93-9b87-a2c90afb4805 service nova] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:23.132908 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd0372e-6077-4c93-9b87-a2c90afb4805 service nova] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:23.133253 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd0372e-6077-4c93-9b87-a2c90afb4805 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:23.136065 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-abd0372e-6077-4c93-9b87-a2c90afb4805 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:30:23.149449 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd0372e-6077-4c93-9b87-a2c90afb4805 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:23.151176 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd0372e-6077-4c93-9b87-a2c90afb4805 service nova] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:23.164555 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1135/2270] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:30:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:30:24.484416 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=61 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:30:25.299806 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53080b12-9977-4e57-b26c-b66a1106a62a service placement] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:25.301214 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-53080b12-9977-4e57-b26c-b66a1106a62a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:30:25.317668 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53080b12-9977-4e57-b26c-b66a1106a62a service placement] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:25.323322 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a647dc-99fe-48bd-8831-037798a1f3de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d05c52570474820b4ba0e2cdad5c13f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:25.323919 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a647dc-99fe-48bd-8831-037798a1f3de service nova] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:25.324202 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a647dc-99fe-48bd-8831-037798a1f3de service nova] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:25.324526 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a647dc-99fe-48bd-8831-037798a1f3de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:25.326379 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-d9a647dc-99fe-48bd-8831-037798a1f3de service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:30:25.338914 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a647dc-99fe-48bd-8831-037798a1f3de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:25.340497 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a647dc-99fe-48bd-8831-037798a1f3de service nova] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:25.351264 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1136/2271] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:30:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:30:30.746653 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd0372e-6077-4c93-9b87-a2c90afb4805 service nova] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:30.757951 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=53 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:30:30.764475 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd0372e-6077-4c93-9b87-a2c90afb4805 service nova] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:30.768168 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b85c32-3ab6-45a8-995a-351fbfa54476 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:30.768775 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b85c32-3ab6-45a8-995a-351fbfa54476 service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:30.769055 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b85c32-3ab6-45a8-995a-351fbfa54476 service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:30.769323 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b85c32-3ab6-45a8-995a-351fbfa54476 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:30.771096 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-48b85c32-3ab6-45a8-995a-351fbfa54476 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:30:30.835427 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b85c32-3ab6-45a8-995a-351fbfa54476 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:30.837020 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b85c32-3ab6-45a8-995a-351fbfa54476 service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:30.848688 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1136/2272] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:30:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:30:34.327113 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a647dc-99fe-48bd-8831-037798a1f3de service nova] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:34.328623 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-d9a647dc-99fe-48bd-8831-037798a1f3de service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:30:34.342945 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a647dc-99fe-48bd-8831-037798a1f3de service nova] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:34.347454 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd20ffe1-402b-4e4e-80ae-c9f1a7d89ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:34.348076 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd20ffe1-402b-4e4e-80ae-c9f1a7d89ecf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:34.348354 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd20ffe1-402b-4e4e-80ae-c9f1a7d89ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:34.348626 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd20ffe1-402b-4e4e-80ae-c9f1a7d89ecf admin admin] PATH_INFO: `/v3/users/fc120edcf30a4775a502c8e31811da4e` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:34.349721 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd20ffe1-402b-4e4e-80ae-c9f1a7d89ecf admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc120edcf30a4775a502c8e31811da4e)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:34.351734 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd20ffe1-402b-4e4e-80ae-c9f1a7d89ecf admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:34.398386 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-dd20ffe1-402b-4e4e-80ae-c9f1a7d89ecf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc120edcf30a4775a502c8e31811da4e'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:34.405227 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-dd20ffe1-402b-4e4e-80ae-c9f1a7d89ecf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc120edcf30a4775a502c8e31811da4e'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:34.405866 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-dd20ffe1-402b-4e4e-80ae-c9f1a7d89ecf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc120edcf30a4775a502c8e31811da4e'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:34.406491 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-dd20ffe1-402b-4e4e-80ae-c9f1a7d89ecf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc120edcf30a4775a502c8e31811da4e'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:34.414031 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-dd20ffe1-402b-4e4e-80ae-c9f1a7d89ecf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc120edcf30a4775a502c8e31811da4e'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:34.431782 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1137/2273] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:30:34 2022] DELETE /identity/v3/users/fc120edcf30a4775a502c8e31811da4e => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:30:34.596385 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b85c32-3ab6-45a8-995a-351fbfa54476 service neutron] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:34.608175 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b85c32-3ab6-45a8-995a-351fbfa54476 service neutron] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:34.666336 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd8ec2-024b-4e87-9657-9c8f8ea70aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:34.667002 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd8ec2-024b-4e87-9657-9c8f8ea70aeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:34.667284 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd8ec2-024b-4e87-9657-9c8f8ea70aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:34.667551 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd8ec2-024b-4e87-9657-9c8f8ea70aeb admin admin] PATH_INFO: `/v3/projects/a7cff15dfaaf4708be5432039c412c59` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:34.668643 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcd8ec2-024b-4e87-9657-9c8f8ea70aeb admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7cff15dfaaf4708be5432039c412c59)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:34.671254 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcd8ec2-024b-4e87-9657-9c8f8ea70aeb admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:34.715869 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-dbcd8ec2-024b-4e87-9657-9c8f8ea70aeb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7cff15dfaaf4708be5432039c412c59', 'request_id': 'req-dbcd8ec2-024b-4e87-9657-9c8f8ea70aeb'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:34.722520 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-dbcd8ec2-024b-4e87-9657-9c8f8ea70aeb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7cff15dfaaf4708be5432039c412c59', 'request_id': 'req-dbcd8ec2-024b-4e87-9657-9c8f8ea70aeb'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:34.732789 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-dbcd8ec2-024b-4e87-9657-9c8f8ea70aeb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7cff15dfaaf4708be5432039c412c59', 'request_id': 'req-dbcd8ec2-024b-4e87-9657-9c8f8ea70aeb'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:34.745651 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-dbcd8ec2-024b-4e87-9657-9c8f8ea70aeb admin admin] The token cache is being invalidate because project a7cff15dfaaf4708be5432039c412c59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:30:34.745981 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-dbcd8ec2-024b-4e87-9657-9c8f8ea70aeb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:34.746595 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-dbcd8ec2-024b-4e87-9657-9c8f8ea70aeb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:34.748244 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1137/2274] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:30:34 2022] DELETE /identity/v3/projects/a7cff15dfaaf4708be5432039c412c59 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:30:34.753328 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f1b9f-91dd-440b-8e88-33d959e63cec None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:34.753648 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f1b9f-91dd-440b-8e88-33d959e63cec None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:34.753911 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f1b9f-91dd-440b-8e88-33d959e63cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:34.774733 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-816f1b9f-91dd-440b-8e88-33d959e63cec None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:30:34.776107 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-816f1b9f-91dd-440b-8e88-33d959e63cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:30:34.834802 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1138/2275] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:30:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:30:34.842995 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd328b86-1fdc-4452-9fb2-1680a76aa365 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:34.843291 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd328b86-1fdc-4452-9fb2-1680a76aa365 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:34.843540 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd328b86-1fdc-4452-9fb2-1680a76aa365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:34.863429 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-bd328b86-1fdc-4452-9fb2-1680a76aa365 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:30:34.864600 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-bd328b86-1fdc-4452-9fb2-1680a76aa365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:30:34.872302 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1138/2276] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:30:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:30:34.876754 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f1b9f-91dd-440b-8e88-33d959e63cec None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:34.886124 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f1b9f-91dd-440b-8e88-33d959e63cec None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:34.890556 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c14af8-0135-47d5-9f78-a430d638f123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:34.891169 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c14af8-0135-47d5-9f78-a430d638f123 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:34.891465 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c14af8-0135-47d5-9f78-a430d638f123 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:34.891911 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c14af8-0135-47d5-9f78-a430d638f123 admin admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:34.892556 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c14af8-0135-47d5-9f78-a430d638f123 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:30:34.892856 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c14af8-0135-47d5-9f78-a430d638f123 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:34.894441 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c14af8-0135-47d5-9f78-a430d638f123 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:34.906261 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1139/2277] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 15 12:30:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:30:34.910393 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd328b86-1fdc-4452-9fb2-1680a76aa365 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:34.920129 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd328b86-1fdc-4452-9fb2-1680a76aa365 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:34.924867 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0d004f-7aa8-4c5e-b5ba-d217cbb6affb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:34.925449 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d004f-7aa8-4c5e-b5ba-d217cbb6affb admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:34.926007 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d004f-7aa8-4c5e-b5ba-d217cbb6affb admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:34.926305 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d004f-7aa8-4c5e-b5ba-d217cbb6affb admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:34.926977 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0d004f-7aa8-4c5e-b5ba-d217cbb6affb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:34.928910 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0d004f-7aa8-4c5e-b5ba-d217cbb6affb admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:34.952406 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:30:34.961168 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1139/2278] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:30:34 2022] POST /identity/v3/projects => generated 405 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:30:34.965359 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c14af8-0135-47d5-9f78-a430d638f123 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:34.980077 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c14af8-0135-47d5-9f78-a430d638f123 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:35.030264 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:30:35.050257 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a2172e-d9a7-4794-bd71-5989fde30c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:35.050906 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a2172e-d9a7-4794-bd71-5989fde30c31 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:35.051182 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a2172e-d9a7-4794-bd71-5989fde30c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:35.051449 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a2172e-d9a7-4794-bd71-5989fde30c31 admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:35.052073 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a2172e-d9a7-4794-bd71-5989fde30c31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:35.053957 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a2172e-d9a7-4794-bd71-5989fde30c31 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:35.078739 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1140/2279] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:30:34 2022] POST /identity/v3/users => generated 303 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:30:35.080271 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0d004f-7aa8-4c5e-b5ba-d217cbb6affb admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:35.092798 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0d004f-7aa8-4c5e-b5ba-d217cbb6affb admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:35.097418 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e5889-35f4-4a04-af5e-309d555f1293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:35.098225 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e5889-35f4-4a04-af5e-309d555f1293 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:35.098504 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e5889-35f4-4a04-af5e-309d555f1293 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:35.098994 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e5889-35f4-4a04-af5e-309d555f1293 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:35.099637 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0e5889-35f4-4a04-af5e-309d555f1293 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:35.101377 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0e5889-35f4-4a04-af5e-309d555f1293 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:35.112017 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1140/2280] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:30:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:30:35.116565 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a2172e-d9a7-4794-bd71-5989fde30c31 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:35.127153 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a2172e-d9a7-4794-bd71-5989fde30c31 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:35.131836 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0c391c-2ef9-4883-a6a0-a2e8b80d1115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:35.132440 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c391c-2ef9-4883-a6a0-a2e8b80d1115 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:35.132722 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c391c-2ef9-4883-a6a0-a2e8b80d1115 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:35.132989 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0c391c-2ef9-4883-a6a0-a2e8b80d1115 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:35.133625 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0c391c-2ef9-4883-a6a0-a2e8b80d1115 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:35.135251 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0c391c-2ef9-4883-a6a0-a2e8b80d1115 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:35.147277 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1141/2281] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:30:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:30:35.151289 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e5889-35f4-4a04-af5e-309d555f1293 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:35.162100 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e5889-35f4-4a04-af5e-309d555f1293 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:35.166806 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabeb3c8-436a-4a1d-83fd-4eb88fd0d0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:35.167457 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabeb3c8-436a-4a1d-83fd-4eb88fd0d0cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:35.167736 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabeb3c8-436a-4a1d-83fd-4eb88fd0d0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:35.168030 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabeb3c8-436a-4a1d-83fd-4eb88fd0d0cc admin admin] PATH_INFO: `/v3/projects/d1c5754289304036b741ea0727200713/users/1d59e6706f414696af7952d5ba61aaec/roles/9371e5bbc55848949eb951a815f817f2` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:35.184208 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabeb3c8-436a-4a1d-83fd-4eb88fd0d0cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1c5754289304036b741ea0727200713, user_id=1d59e6706f414696af7952d5ba61aaec, role_id=9371e5bbc55848949eb951a815f817f2)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:35.186997 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabeb3c8-436a-4a1d-83fd-4eb88fd0d0cc admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:35.204599 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1141/2282] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:30:35 2022] PUT /identity/v3/projects/d1c5754289304036b741ea0727200713/users/1d59e6706f414696af7952d5ba61aaec/roles/9371e5bbc55848949eb951a815f817f2 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:30:35.209280 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df247ce7-dd4d-44cb-ac7b-c7bcc5bb390a None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:35.209493 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df247ce7-dd4d-44cb-ac7b-c7bcc5bb390a None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:35.209780 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df247ce7-dd4d-44cb-ac7b-c7bcc5bb390a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:35.230576 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-df247ce7-dd4d-44cb-ac7b-c7bcc5bb390a None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:30:35.231839 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-df247ce7-dd4d-44cb-ac7b-c7bcc5bb390a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:30:35.293739 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1142/2283] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:30:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:30:35.305190 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabeb3c8-436a-4a1d-83fd-4eb88fd0d0cc admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:35.306970 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-eabeb3c8-436a-4a1d-83fd-4eb88fd0d0cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:30:35.364027 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabeb3c8-436a-4a1d-83fd-4eb88fd0d0cc admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:35.367833 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf06e98-6cb2-4e74-ab5c-837c9b6394f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:35.368442 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf06e98-6cb2-4e74-ab5c-837c9b6394f4 service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:35.368721 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf06e98-6cb2-4e74-ab5c-837c9b6394f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:35.368995 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf06e98-6cb2-4e74-ab5c-837c9b6394f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:35.379027 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf06e98-6cb2-4e74-ab5c-837c9b6394f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:35.380444 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf06e98-6cb2-4e74-ab5c-837c9b6394f4 service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:35.389718 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1142/2284] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:30:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:30:36.031852 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b03b6dd-4977-4191-b6ec-4ade0cfe99d8 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:36.032409 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b03b6dd-4977-4191-b6ec-4ade0cfe99d8 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:36.032694 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b03b6dd-4977-4191-b6ec-4ade0cfe99d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:36.069114 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-8b03b6dd-4977-4191-b6ec-4ade0cfe99d8 None None] MFA Rules not processed for user `1d59e6706f414696af7952d5ba61aaec`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:30:36.071505 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-8b03b6dd-4977-4191-b6ec-4ade0cfe99d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:30:36.164424 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1143/2285] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:30:36 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:30:36.168803 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf06e98-6cb2-4e74-ab5c-837c9b6394f4 service neutron] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:36.179915 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf06e98-6cb2-4e74-ab5c-837c9b6394f4 service neutron] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:36.185859 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b38a1f2-e361-4543-8a32-085ab7f98feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:36.186731 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b38a1f2-e361-4543-8a32-085ab7f98feb admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:36.187086 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b38a1f2-e361-4543-8a32-085ab7f98feb admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:36.187361 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b38a1f2-e361-4543-8a32-085ab7f98feb admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:36.187998 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b38a1f2-e361-4543-8a32-085ab7f98feb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:36.189979 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b38a1f2-e361-4543-8a32-085ab7f98feb admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:36.222291 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1143/2286] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:30:36 2022] POST /identity/v3/projects => generated 403 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 12:30:36.226356 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b03b6dd-4977-4191-b6ec-4ade0cfe99d8 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:36.238931 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b03b6dd-4977-4191-b6ec-4ade0cfe99d8 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:36.292289 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:30:36.301898 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af748bcf-fa8e-4d8c-bbdb-0511d370f1ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:36.302620 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af748bcf-fa8e-4d8c-bbdb-0511d370f1ea admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:36.302926 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af748bcf-fa8e-4d8c-bbdb-0511d370f1ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:36.303197 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af748bcf-fa8e-4d8c-bbdb-0511d370f1ea admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:36.303827 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af748bcf-fa8e-4d8c-bbdb-0511d370f1ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:36.305712 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af748bcf-fa8e-4d8c-bbdb-0511d370f1ea admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:36.327278 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1144/2287] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:30:36 2022] POST /identity/v3/users => generated 308 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:30:36.331319 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b38a1f2-e361-4543-8a32-085ab7f98feb admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:36.345430 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b38a1f2-e361-4543-8a32-085ab7f98feb admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:36.350209 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214274b4-8b5e-4f72-9834-295d773c6f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:36.351004 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214274b4-8b5e-4f72-9834-295d773c6f53 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:36.351282 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214274b4-8b5e-4f72-9834-295d773c6f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:36.351556 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214274b4-8b5e-4f72-9834-295d773c6f53 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:36.352202 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214274b4-8b5e-4f72-9834-295d773c6f53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:36.353803 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214274b4-8b5e-4f72-9834-295d773c6f53 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:36.365262 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1144/2288] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:30:36.369502 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af748bcf-fa8e-4d8c-bbdb-0511d370f1ea admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:36.380310 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af748bcf-fa8e-4d8c-bbdb-0511d370f1ea admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:36.384996 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d17cb5-9f00-471e-bb0e-7cd0103f9d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:36.385651 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d17cb5-9f00-471e-bb0e-7cd0103f9d35 admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:36.385926 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d17cb5-9f00-471e-bb0e-7cd0103f9d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:36.386197 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d17cb5-9f00-471e-bb0e-7cd0103f9d35 admin admin] PATH_INFO: `/v3/projects/9eb9bb6dc23d41cc9df554da56880c8f/users/df55976eee2e493eb4e2d40815cbd774/roles/7f53f1c823b746529ba5057bf21b2477` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:36.402782 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d17cb5-9f00-471e-bb0e-7cd0103f9d35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9eb9bb6dc23d41cc9df554da56880c8f, user_id=df55976eee2e493eb4e2d40815cbd774, role_id=7f53f1c823b746529ba5057bf21b2477)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:36.405973 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d17cb5-9f00-471e-bb0e-7cd0103f9d35 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:36.420545 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1145/2289] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:30:36 2022] PUT /identity/v3/projects/9eb9bb6dc23d41cc9df554da56880c8f/users/df55976eee2e493eb4e2d40815cbd774/roles/7f53f1c823b746529ba5057bf21b2477 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:30:36.425001 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214274b4-8b5e-4f72-9834-295d773c6f53 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:36.440390 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214274b4-8b5e-4f72-9834-295d773c6f53 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:36.503689 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f074bdf-3a54-43d2-a59c-fef9989708d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:36.504386 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f074bdf-3a54-43d2-a59c-fef9989708d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:36.504730 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f074bdf-3a54-43d2-a59c-fef9989708d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:36.505003 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f074bdf-3a54-43d2-a59c-fef9989708d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:36.505640 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f074bdf-3a54-43d2-a59c-fef9989708d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:36.507292 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f074bdf-3a54-43d2-a59c-fef9989708d3 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:36.517531 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1145/2290] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:30:36.521742 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d17cb5-9f00-471e-bb0e-7cd0103f9d35 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:36.532857 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d17cb5-9f00-471e-bb0e-7cd0103f9d35 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:36.537433 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f047572e-174c-47a4-8004-5cda5dea51ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:36.538073 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f047572e-174c-47a4-8004-5cda5dea51ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:36.538351 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f047572e-174c-47a4-8004-5cda5dea51ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:36.538624 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f047572e-174c-47a4-8004-5cda5dea51ca admin admin] PATH_INFO: `/v3/projects/9eb9bb6dc23d41cc9df554da56880c8f/users/df55976eee2e493eb4e2d40815cbd774/roles/7f53f1c823b746529ba5057bf21b2477` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:36.540553 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f047572e-174c-47a4-8004-5cda5dea51ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=9eb9bb6dc23d41cc9df554da56880c8f, user_id=df55976eee2e493eb4e2d40815cbd774, role_id=7f53f1c823b746529ba5057bf21b2477)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:36.543240 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f047572e-174c-47a4-8004-5cda5dea51ca admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:36.553605 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1146/2291] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:30:36 2022] PUT /identity/v3/projects/9eb9bb6dc23d41cc9df554da56880c8f/users/df55976eee2e493eb4e2d40815cbd774/roles/7f53f1c823b746529ba5057bf21b2477 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:30:37.215362 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72f42d7-572f-446c-ad95-184392adb5b1 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:37.216699 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72f42d7-572f-446c-ad95-184392adb5b1 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:37.217129 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72f42d7-572f-446c-ad95-184392adb5b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:37.247866 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-a72f42d7-572f-446c-ad95-184392adb5b1 None None] MFA Rules not processed for user `df55976eee2e493eb4e2d40815cbd774`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:30:37.249126 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-a72f42d7-572f-446c-ad95-184392adb5b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:30:37.271230 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:30:37.338753 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1146/2292] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:30:37 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:30:38.404783 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f047572e-174c-47a4-8004-5cda5dea51ca admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:38.480025 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f047572e-174c-47a4-8004-5cda5dea51ca admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:38.484995 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734c69ac-23a0-48f5-a777-c76e16045a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:38.485690 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c69ac-23a0-48f5-a777-c76e16045a51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:38.485974 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c69ac-23a0-48f5-a777-c76e16045a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:38.486257 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c69ac-23a0-48f5-a777-c76e16045a51 admin admin] PATH_INFO: `/v3/users/1d59e6706f414696af7952d5ba61aaec` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:38.487429 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734c69ac-23a0-48f5-a777-c76e16045a51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d59e6706f414696af7952d5ba61aaec)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:38.489387 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734c69ac-23a0-48f5-a777-c76e16045a51 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:38.540771 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-734c69ac-23a0-48f5-a777-c76e16045a51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d59e6706f414696af7952d5ba61aaec'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:38.549061 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-734c69ac-23a0-48f5-a777-c76e16045a51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d59e6706f414696af7952d5ba61aaec'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:38.549984 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-734c69ac-23a0-48f5-a777-c76e16045a51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d59e6706f414696af7952d5ba61aaec'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:38.550606 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-734c69ac-23a0-48f5-a777-c76e16045a51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d59e6706f414696af7952d5ba61aaec'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:38.558526 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-734c69ac-23a0-48f5-a777-c76e16045a51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d59e6706f414696af7952d5ba61aaec'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:38.579277 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1147/2293] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:30:38 2022] DELETE /identity/v3/users/1d59e6706f414696af7952d5ba61aaec => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:30:38.761131 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72f42d7-572f-446c-ad95-184392adb5b1 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:38.790513 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72f42d7-572f-446c-ad95-184392adb5b1 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:38.856277 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e970bce1-9efd-4136-bd2b-2d9fd605e05c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:38.857555 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e970bce1-9efd-4136-bd2b-2d9fd605e05c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:38.857839 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e970bce1-9efd-4136-bd2b-2d9fd605e05c admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:38.858116 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e970bce1-9efd-4136-bd2b-2d9fd605e05c admin admin] PATH_INFO: `/v3/projects/d1c5754289304036b741ea0727200713` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:38.859281 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e970bce1-9efd-4136-bd2b-2d9fd605e05c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1c5754289304036b741ea0727200713)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:38.861265 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e970bce1-9efd-4136-bd2b-2d9fd605e05c admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:38.908876 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-e970bce1-9efd-4136-bd2b-2d9fd605e05c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1c5754289304036b741ea0727200713', 'request_id': 'req-e970bce1-9efd-4136-bd2b-2d9fd605e05c'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:38.914873 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-e970bce1-9efd-4136-bd2b-2d9fd605e05c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1c5754289304036b741ea0727200713', 'request_id': 'req-e970bce1-9efd-4136-bd2b-2d9fd605e05c'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:38.923850 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-e970bce1-9efd-4136-bd2b-2d9fd605e05c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1c5754289304036b741ea0727200713', 'request_id': 'req-e970bce1-9efd-4136-bd2b-2d9fd605e05c'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:38.936526 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-e970bce1-9efd-4136-bd2b-2d9fd605e05c admin admin] The token cache is being invalidate because project d1c5754289304036b741ea0727200713 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:30:38.936809 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-e970bce1-9efd-4136-bd2b-2d9fd605e05c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:38.937454 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-e970bce1-9efd-4136-bd2b-2d9fd605e05c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:38.938988 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1147/2294] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:30:38 2022] DELETE /identity/v3/projects/d1c5754289304036b741ea0727200713 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:30:38.943188 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734c69ac-23a0-48f5-a777-c76e16045a51 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:38.944565 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-734c69ac-23a0-48f5-a777-c76e16045a51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:30:38.957898 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734c69ac-23a0-48f5-a777-c76e16045a51 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:38.983624 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:30:39.019557 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d262dd2-e2fc-4780-ab12-43985cb1e783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:39.020128 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d262dd2-e2fc-4780-ab12-43985cb1e783 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:39.020412 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d262dd2-e2fc-4780-ab12-43985cb1e783 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:39.020688 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d262dd2-e2fc-4780-ab12-43985cb1e783 admin admin] PATH_INFO: `/v3/users/df55976eee2e493eb4e2d40815cbd774` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:39.021816 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d262dd2-e2fc-4780-ab12-43985cb1e783 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df55976eee2e493eb4e2d40815cbd774)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:39.023787 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d262dd2-e2fc-4780-ab12-43985cb1e783 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:39.072794 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-3d262dd2-e2fc-4780-ab12-43985cb1e783 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df55976eee2e493eb4e2d40815cbd774'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:39.081169 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-3d262dd2-e2fc-4780-ab12-43985cb1e783 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df55976eee2e493eb4e2d40815cbd774'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:39.081788 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-3d262dd2-e2fc-4780-ab12-43985cb1e783 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df55976eee2e493eb4e2d40815cbd774'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:39.082431 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-3d262dd2-e2fc-4780-ab12-43985cb1e783 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df55976eee2e493eb4e2d40815cbd774'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:39.089713 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-3d262dd2-e2fc-4780-ab12-43985cb1e783 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df55976eee2e493eb4e2d40815cbd774'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:39.108679 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1148/2295] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:30:38 2022] DELETE /identity/v3/users/df55976eee2e493eb4e2d40815cbd774 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:30:39.288931 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e970bce1-9efd-4136-bd2b-2d9fd605e05c admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:39.290482 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-e970bce1-9efd-4136-bd2b-2d9fd605e05c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:30:39.305813 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e970bce1-9efd-4136-bd2b-2d9fd605e05c admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:39.351558 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:30:39.368706 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5b60a0-05c3-4060-a766-974e0b1f79f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:39.369441 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b60a0-05c3-4060-a766-974e0b1f79f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:39.369846 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b60a0-05c3-4060-a766-974e0b1f79f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:39.370179 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b60a0-05c3-4060-a766-974e0b1f79f3 admin admin] PATH_INFO: `/v3/projects/9eb9bb6dc23d41cc9df554da56880c8f` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:39.371480 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5b60a0-05c3-4060-a766-974e0b1f79f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9eb9bb6dc23d41cc9df554da56880c8f)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:39.374001 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5b60a0-05c3-4060-a766-974e0b1f79f3 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:39.424285 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-4d5b60a0-05c3-4060-a766-974e0b1f79f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9eb9bb6dc23d41cc9df554da56880c8f', 'request_id': 'req-4d5b60a0-05c3-4060-a766-974e0b1f79f3'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:39.430206 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-4d5b60a0-05c3-4060-a766-974e0b1f79f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9eb9bb6dc23d41cc9df554da56880c8f', 'request_id': 'req-4d5b60a0-05c3-4060-a766-974e0b1f79f3'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:39.440642 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-4d5b60a0-05c3-4060-a766-974e0b1f79f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9eb9bb6dc23d41cc9df554da56880c8f', 'request_id': 'req-4d5b60a0-05c3-4060-a766-974e0b1f79f3'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:39.456990 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-4d5b60a0-05c3-4060-a766-974e0b1f79f3 admin admin] The token cache is being invalidate because project 9eb9bb6dc23d41cc9df554da56880c8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:30:39.457279 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-4d5b60a0-05c3-4060-a766-974e0b1f79f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:39.457985 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-4d5b60a0-05c3-4060-a766-974e0b1f79f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:39.459786 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1148/2296] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:30:39 2022] DELETE /identity/v3/projects/9eb9bb6dc23d41cc9df554da56880c8f => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:30:39.464782 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12ce8a8-f5b2-4970-bea1-e78618c8fe14 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:39.465234 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12ce8a8-f5b2-4970-bea1-e78618c8fe14 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:39.465484 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12ce8a8-f5b2-4970-bea1-e78618c8fe14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:39.487880 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-b12ce8a8-f5b2-4970-bea1-e78618c8fe14 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:30:39.489074 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-b12ce8a8-f5b2-4970-bea1-e78618c8fe14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:30:39.552145 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1149/2297] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:30:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:30:39.560746 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b71df-9bc6-41d3-9dd5-b70752dbc053 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:39.561029 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b71df-9bc6-41d3-9dd5-b70752dbc053 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:39.561301 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b71df-9bc6-41d3-9dd5-b70752dbc053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:39.584225 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-939b71df-9bc6-41d3-9dd5-b70752dbc053 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:30:39.585440 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-939b71df-9bc6-41d3-9dd5-b70752dbc053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:30:39.593724 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1149/2298] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:30:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:30:39.598062 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12ce8a8-f5b2-4970-bea1-e78618c8fe14 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:39.608819 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12ce8a8-f5b2-4970-bea1-e78618c8fe14 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:39.613446 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fac0cb-17d4-46ac-89b1-b496e050c148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:39.614108 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fac0cb-17d4-46ac-89b1-b496e050c148 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:39.614448 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fac0cb-17d4-46ac-89b1-b496e050c148 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:39.614785 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fac0cb-17d4-46ac-89b1-b496e050c148 admin admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:39.615410 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fac0cb-17d4-46ac-89b1-b496e050c148 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:30:39.615711 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fac0cb-17d4-46ac-89b1-b496e050c148 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:39.617298 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fac0cb-17d4-46ac-89b1-b496e050c148 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:39.630835 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1150/2299] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 15 12:30:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:30:39.634984 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b71df-9bc6-41d3-9dd5-b70752dbc053 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:39.644582 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b71df-9bc6-41d3-9dd5-b70752dbc053 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:39.649579 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a59e17-f571-4a3d-a0df-863205959c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:39.650181 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a59e17-f571-4a3d-a0df-863205959c02 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:39.650463 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a59e17-f571-4a3d-a0df-863205959c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:39.650759 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a59e17-f571-4a3d-a0df-863205959c02 admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:39.651406 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a59e17-f571-4a3d-a0df-863205959c02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:39.653326 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a59e17-f571-4a3d-a0df-863205959c02 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:39.681773 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1150/2300] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:30:39 2022] POST /identity/v3/projects => generated 365 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:30:39.686474 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fac0cb-17d4-46ac-89b1-b496e050c148 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:39.696689 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fac0cb-17d4-46ac-89b1-b496e050c148 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:39.728294 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:30:39.758857 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eb122f-eaec-4161-83bb-8b4fd034f2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:39.759464 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb122f-eaec-4161-83bb-8b4fd034f2b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:39.759766 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb122f-eaec-4161-83bb-8b4fd034f2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:39.760043 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb122f-eaec-4161-83bb-8b4fd034f2b2 admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:39.760687 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eb122f-eaec-4161-83bb-8b4fd034f2b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:39.762678 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eb122f-eaec-4161-83bb-8b4fd034f2b2 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:39.786744 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1151/2301] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:30:39 2022] POST /identity/v3/users => generated 283 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 12:30:39.791105 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a59e17-f571-4a3d-a0df-863205959c02 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:39.802997 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a59e17-f571-4a3d-a0df-863205959c02 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:39.807723 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b204c-b412-4797-b064-b9a9b0c67c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:39.808400 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b204c-b412-4797-b064-b9a9b0c67c9f admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:39.808732 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b204c-b412-4797-b064-b9a9b0c67c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:39.809069 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b204c-b412-4797-b064-b9a9b0c67c9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:39.810337 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402b204c-b412-4797-b064-b9a9b0c67c9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:39.812003 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402b204c-b412-4797-b064-b9a9b0c67c9f admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:39.824190 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1151/2302] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:30:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:30:39.828424 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eb122f-eaec-4161-83bb-8b4fd034f2b2 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:39.839086 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eb122f-eaec-4161-83bb-8b4fd034f2b2 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:39.843865 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6702814d-e6ad-4d8f-9df6-955f83d72868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:39.844464 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702814d-e6ad-4d8f-9df6-955f83d72868 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:39.844742 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702814d-e6ad-4d8f-9df6-955f83d72868 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:39.845015 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702814d-e6ad-4d8f-9df6-955f83d72868 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:39.845657 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6702814d-e6ad-4d8f-9df6-955f83d72868 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:39.847273 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6702814d-e6ad-4d8f-9df6-955f83d72868 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:39.859706 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1152/2303] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:30:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:30:39.863794 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b204c-b412-4797-b064-b9a9b0c67c9f admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:39.876006 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b204c-b412-4797-b064-b9a9b0c67c9f admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:39.881522 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038f5181-3779-4a34-8020-caa84da464be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:39.882208 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f5181-3779-4a34-8020-caa84da464be admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:39.882492 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f5181-3779-4a34-8020-caa84da464be admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:39.882799 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f5181-3779-4a34-8020-caa84da464be admin admin] PATH_INFO: `/v3/projects/0819e3fef5b9444d8223a50c95c57bad/users/a8794822854f41aa8e8ab404554aa6d7/roles/9371e5bbc55848949eb951a815f817f2` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:39.900661 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038f5181-3779-4a34-8020-caa84da464be admin admin] RBAC: Authorizing `identity:create_grant(project_id=0819e3fef5b9444d8223a50c95c57bad, user_id=a8794822854f41aa8e8ab404554aa6d7, role_id=9371e5bbc55848949eb951a815f817f2)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:39.903870 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038f5181-3779-4a34-8020-caa84da464be admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:39.917486 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1152/2304] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:30:39 2022] PUT /identity/v3/projects/0819e3fef5b9444d8223a50c95c57bad/users/a8794822854f41aa8e8ab404554aa6d7/roles/9371e5bbc55848949eb951a815f817f2 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:30:39.929506 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceae1f2-211b-42e3-a7ae-7c5b37247898 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:39.929792 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceae1f2-211b-42e3-a7ae-7c5b37247898 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:39.930071 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceae1f2-211b-42e3-a7ae-7c5b37247898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:39.963893 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-3ceae1f2-211b-42e3-a7ae-7c5b37247898 None None] MFA Rules not processed for user `a8794822854f41aa8e8ab404554aa6d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:30:39.965138 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-3ceae1f2-211b-42e3-a7ae-7c5b37247898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:30:40.036181 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1153/2305] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:30:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:30:40.040737 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038f5181-3779-4a34-8020-caa84da464be admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:40.081121 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceae1f2-211b-42e3-a7ae-7c5b37247898 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:40.082642 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-3ceae1f2-211b-42e3-a7ae-7c5b37247898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:30:40.108962 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038f5181-3779-4a34-8020-caa84da464be admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:40.114306 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837892c3-96eb-4718-b023-b929fa17706b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:40.115423 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837892c3-96eb-4718-b023-b929fa17706b admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:40.115706 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837892c3-96eb-4718-b023-b929fa17706b admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:40.115981 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837892c3-96eb-4718-b023-b929fa17706b admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:40.117016 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837892c3-96eb-4718-b023-b929fa17706b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:40.118975 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837892c3-96eb-4718-b023-b929fa17706b admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:40.136669 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:30:40.155757 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1153/2306] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:30:40 2022] POST /identity/v3/projects => generated 361 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:30:40.155950 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceae1f2-211b-42e3-a7ae-7c5b37247898 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:40.157184 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837892c3-96eb-4718-b023-b929fa17706b admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:40.207086 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede24cc9-c58c-419d-a5c9-a2b81e846e0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceafc5e4283841528053f01931f10293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:40.208198 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede24cc9-c58c-419d-a5c9-a2b81e846e0f service cinder] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:40.208500 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede24cc9-c58c-419d-a5c9-a2b81e846e0f service cinder] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:40.208755 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede24cc9-c58c-419d-a5c9-a2b81e846e0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:40.213351 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-ede24cc9-c58c-419d-a5c9-a2b81e846e0f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:30:40.225028 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:30:40.226577 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837892c3-96eb-4718-b023-b929fa17706b admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:40.234012 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd8e2c0-1195-410d-98a0-bf71dd441fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:40.234628 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd8e2c0-1195-410d-98a0-bf71dd441fd8 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:40.234957 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd8e2c0-1195-410d-98a0-bf71dd441fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:40.235236 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd8e2c0-1195-410d-98a0-bf71dd441fd8 admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:40.236256 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd8e2c0-1195-410d-98a0-bf71dd441fd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:40.238255 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd8e2c0-1195-410d-98a0-bf71dd441fd8 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:40.264012 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1154/2307] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:30:40 2022] POST /identity/v3/users => generated 287 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 12:30:40.268380 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd8e2c0-1195-410d-98a0-bf71dd441fd8 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:40.280076 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd8e2c0-1195-410d-98a0-bf71dd441fd8 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:40.282656 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede24cc9-c58c-419d-a5c9-a2b81e846e0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:40.284124 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede24cc9-c58c-419d-a5c9-a2b81e846e0f service cinder] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:40.285919 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eef3728-0187-46ec-93ff-d8ad47fa966f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:40.286616 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eef3728-0187-46ec-93ff-d8ad47fa966f admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:40.287120 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eef3728-0187-46ec-93ff-d8ad47fa966f admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:40.287586 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eef3728-0187-46ec-93ff-d8ad47fa966f admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:40.288334 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eef3728-0187-46ec-93ff-d8ad47fa966f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:40.290059 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eef3728-0187-46ec-93ff-d8ad47fa966f admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:40.293515 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1154/2308] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:30:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 12:30:40.303969 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1155/2309] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:30:40 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:30:40.308305 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede24cc9-c58c-419d-a5c9-a2b81e846e0f service cinder] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:40.320124 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede24cc9-c58c-419d-a5c9-a2b81e846e0f service cinder] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:40.325886 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088c16ee-1c06-487e-a45c-72459e216678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:40.326493 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c16ee-1c06-487e-a45c-72459e216678 admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:40.326878 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c16ee-1c06-487e-a45c-72459e216678 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:40.327137 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c16ee-1c06-487e-a45c-72459e216678 admin admin] PATH_INFO: `/v3/projects/ca4a43ddd15747989b9a0352243c8fb5/users/209d42a1d86d469e915ae325e9dbf592/roles/7f53f1c823b746529ba5057bf21b2477` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:40.344517 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088c16ee-1c06-487e-a45c-72459e216678 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca4a43ddd15747989b9a0352243c8fb5, user_id=209d42a1d86d469e915ae325e9dbf592, role_id=7f53f1c823b746529ba5057bf21b2477)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:40.347234 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088c16ee-1c06-487e-a45c-72459e216678 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:40.365861 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1155/2310] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:30:40 2022] PUT /identity/v3/projects/ca4a43ddd15747989b9a0352243c8fb5/users/209d42a1d86d469e915ae325e9dbf592/roles/7f53f1c823b746529ba5057bf21b2477 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:30:40.367601 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eef3728-0187-46ec-93ff-d8ad47fa966f admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:40.380605 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eef3728-0187-46ec-93ff-d8ad47fa966f admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:40.447407 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11f06e9-8fc2-4354-83c7-ab59f26163bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:40.448034 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f06e9-8fc2-4354-83c7-ab59f26163bf admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:40.448315 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f06e9-8fc2-4354-83c7-ab59f26163bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:40.448582 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f06e9-8fc2-4354-83c7-ab59f26163bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:40.449258 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11f06e9-8fc2-4354-83c7-ab59f26163bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:40.451690 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11f06e9-8fc2-4354-83c7-ab59f26163bf admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:40.470900 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1156/2311] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:30:40 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:30:40.473042 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088c16ee-1c06-487e-a45c-72459e216678 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:40.485159 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088c16ee-1c06-487e-a45c-72459e216678 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:40.490153 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8e98c6-07e1-4f62-8e10-c7549dacb296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:40.490871 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e98c6-07e1-4f62-8e10-c7549dacb296 admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:40.491152 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e98c6-07e1-4f62-8e10-c7549dacb296 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:40.491428 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e98c6-07e1-4f62-8e10-c7549dacb296 admin admin] PATH_INFO: `/v3/projects/ca4a43ddd15747989b9a0352243c8fb5/users/209d42a1d86d469e915ae325e9dbf592/roles/7f53f1c823b746529ba5057bf21b2477` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:40.493788 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8e98c6-07e1-4f62-8e10-c7549dacb296 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca4a43ddd15747989b9a0352243c8fb5, user_id=209d42a1d86d469e915ae325e9dbf592, role_id=7f53f1c823b746529ba5057bf21b2477)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:40.496416 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8e98c6-07e1-4f62-8e10-c7549dacb296 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:40.508663 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1156/2312] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:30:40 2022] PUT /identity/v3/projects/ca4a43ddd15747989b9a0352243c8fb5/users/209d42a1d86d469e915ae325e9dbf592/roles/7f53f1c823b746529ba5057bf21b2477 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:30:40.519755 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda0377-530a-47c1-913a-0a491d8fd0dc None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:40.520048 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda0377-530a-47c1-913a-0a491d8fd0dc None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:40.521245 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda0377-530a-47c1-913a-0a491d8fd0dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:40.551628 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-1cda0377-530a-47c1-913a-0a491d8fd0dc None None] MFA Rules not processed for user `209d42a1d86d469e915ae325e9dbf592`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:30:40.552910 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-1cda0377-530a-47c1-913a-0a491d8fd0dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:30:40.633287 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:30:40.646416 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1157/2313] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:30:40 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:30:40.658326 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8e98c6-07e1-4f62-8e10-c7549dacb296 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:40.723068 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8e98c6-07e1-4f62-8e10-c7549dacb296 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:40.727327 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fa3e00-d75a-4de2-8a9c-8233a7be3030 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceafc5e4283841528053f01931f10293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:40.727945 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa3e00-d75a-4de2-8a9c-8233a7be3030 service cinder] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:40.728360 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa3e00-d75a-4de2-8a9c-8233a7be3030 service cinder] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:40.728699 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa3e00-d75a-4de2-8a9c-8233a7be3030 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:40.739374 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fa3e00-d75a-4de2-8a9c-8233a7be3030 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:40.740812 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fa3e00-d75a-4de2-8a9c-8233a7be3030 service cinder] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:40.752855 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1157/2314] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:30:40 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:30:40.843524 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cda0377-530a-47c1-913a-0a491d8fd0dc None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:40.854401 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cda0377-530a-47c1-913a-0a491d8fd0dc None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:40.859033 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea003dde-1380-451c-b10e-6882a1d9e024 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceafc5e4283841528053f01931f10293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:40.859716 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea003dde-1380-451c-b10e-6882a1d9e024 service cinder] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:40.860057 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea003dde-1380-451c-b10e-6882a1d9e024 service cinder] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:40.860414 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea003dde-1380-451c-b10e-6882a1d9e024 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:40.917885 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea003dde-1380-451c-b10e-6882a1d9e024 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:40.920052 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea003dde-1380-451c-b10e-6882a1d9e024 service cinder] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:40.929345 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1158/2315] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:30:40 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:30:43.745215 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fa3e00-d75a-4de2-8a9c-8233a7be3030 service cinder] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:43.818805 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fa3e00-d75a-4de2-8a9c-8233a7be3030 service cinder] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:43.823529 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0804e1-15f2-4a6f-9688-56c999415c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:43.824158 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0804e1-15f2-4a6f-9688-56c999415c76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:43.824437 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0804e1-15f2-4a6f-9688-56c999415c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:43.824705 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0804e1-15f2-4a6f-9688-56c999415c76 admin admin] PATH_INFO: `/v3/users/a8794822854f41aa8e8ab404554aa6d7` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:43.826056 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0804e1-15f2-4a6f-9688-56c999415c76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8794822854f41aa8e8ab404554aa6d7)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:43.828165 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0804e1-15f2-4a6f-9688-56c999415c76 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:43.850608 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:30:43.880763 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-0d0804e1-15f2-4a6f-9688-56c999415c76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8794822854f41aa8e8ab404554aa6d7'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:43.888732 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-0d0804e1-15f2-4a6f-9688-56c999415c76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8794822854f41aa8e8ab404554aa6d7'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:43.889408 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-0d0804e1-15f2-4a6f-9688-56c999415c76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8794822854f41aa8e8ab404554aa6d7'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:43.890067 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-0d0804e1-15f2-4a6f-9688-56c999415c76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8794822854f41aa8e8ab404554aa6d7'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:43.897464 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-0d0804e1-15f2-4a6f-9688-56c999415c76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8794822854f41aa8e8ab404554aa6d7'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:43.917353 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1158/2316] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:30:43 2022] DELETE /identity/v3/users/a8794822854f41aa8e8ab404554aa6d7 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:30:43.922461 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a69012a-920e-4fce-9a55-456c46a966ca None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:43.923041 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a69012a-920e-4fce-9a55-456c46a966ca None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:43.923041 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a69012a-920e-4fce-9a55-456c46a966ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:43.944535 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-4a69012a-920e-4fce-9a55-456c46a966ca None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:30:43.945853 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-4a69012a-920e-4fce-9a55-456c46a966ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:30:44.023540 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1159/2317] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:30:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:30:44.030659 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0804e1-15f2-4a6f-9688-56c999415c76 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:44.032126 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-0d0804e1-15f2-4a6f-9688-56c999415c76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:30:44.133778 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0804e1-15f2-4a6f-9688-56c999415c76 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:44.138289 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7ff982-7027-4f64-bd0d-f8d6e731172d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:44.139043 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ff982-7027-4f64-bd0d-f8d6e731172d service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:44.139422 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ff982-7027-4f64-bd0d-f8d6e731172d service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:44.139794 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ff982-7027-4f64-bd0d-f8d6e731172d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:44.154859 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7ff982-7027-4f64-bd0d-f8d6e731172d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:44.160884 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7ff982-7027-4f64-bd0d-f8d6e731172d service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:44.187860 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1159/2318] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:30:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:30:44.495801 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a69012a-920e-4fce-9a55-456c46a966ca None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:44.497309 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-4a69012a-920e-4fce-9a55-456c46a966ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:30:44.510068 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a69012a-920e-4fce-9a55-456c46a966ca None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:44.515030 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60fbc18-32a7-4615-bb10-ce4322d39233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:44.515671 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60fbc18-32a7-4615-bb10-ce4322d39233 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:44.515952 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60fbc18-32a7-4615-bb10-ce4322d39233 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:44.516224 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60fbc18-32a7-4615-bb10-ce4322d39233 admin admin] PATH_INFO: `/v3/projects/0819e3fef5b9444d8223a50c95c57bad` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:44.517364 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60fbc18-32a7-4615-bb10-ce4322d39233 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0819e3fef5b9444d8223a50c95c57bad)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:44.519355 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60fbc18-32a7-4615-bb10-ce4322d39233 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:44.568405 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-b60fbc18-32a7-4615-bb10-ce4322d39233 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0819e3fef5b9444d8223a50c95c57bad', 'request_id': 'req-b60fbc18-32a7-4615-bb10-ce4322d39233'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:44.574664 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-b60fbc18-32a7-4615-bb10-ce4322d39233 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0819e3fef5b9444d8223a50c95c57bad', 'request_id': 'req-b60fbc18-32a7-4615-bb10-ce4322d39233'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:44.584622 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-b60fbc18-32a7-4615-bb10-ce4322d39233 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0819e3fef5b9444d8223a50c95c57bad', 'request_id': 'req-b60fbc18-32a7-4615-bb10-ce4322d39233'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:44.596319 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-b60fbc18-32a7-4615-bb10-ce4322d39233 admin admin] The token cache is being invalidate because project 0819e3fef5b9444d8223a50c95c57bad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:30:44.596604 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-b60fbc18-32a7-4615-bb10-ce4322d39233 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:44.597247 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-b60fbc18-32a7-4615-bb10-ce4322d39233 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:44.598813 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1160/2319] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:30:44 2022] DELETE /identity/v3/projects/0819e3fef5b9444d8223a50c95c57bad => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:30:44.602887 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7ff982-7027-4f64-bd0d-f8d6e731172d service neutron] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:44.617902 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7ff982-7027-4f64-bd0d-f8d6e731172d service neutron] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:44.676139 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2bfe58-9966-4a59-a00d-3774ba638913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:44.676758 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2bfe58-9966-4a59-a00d-3774ba638913 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:44.677038 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2bfe58-9966-4a59-a00d-3774ba638913 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:44.677310 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2bfe58-9966-4a59-a00d-3774ba638913 admin admin] PATH_INFO: `/v3/users/209d42a1d86d469e915ae325e9dbf592` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:44.678413 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2bfe58-9966-4a59-a00d-3774ba638913 admin admin] RBAC: Authorizing `identity:delete_user(user_id=209d42a1d86d469e915ae325e9dbf592)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:44.680375 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2bfe58-9966-4a59-a00d-3774ba638913 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:44.722941 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:30:44.728625 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-fe2bfe58-9966-4a59-a00d-3774ba638913 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '209d42a1d86d469e915ae325e9dbf592'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:44.736652 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-fe2bfe58-9966-4a59-a00d-3774ba638913 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '209d42a1d86d469e915ae325e9dbf592'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:44.737432 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-fe2bfe58-9966-4a59-a00d-3774ba638913 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '209d42a1d86d469e915ae325e9dbf592'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:44.738144 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-fe2bfe58-9966-4a59-a00d-3774ba638913 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '209d42a1d86d469e915ae325e9dbf592'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:44.745684 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-fe2bfe58-9966-4a59-a00d-3774ba638913 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '209d42a1d86d469e915ae325e9dbf592'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:44.763255 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1160/2320] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:30:44 2022] DELETE /identity/v3/users/209d42a1d86d469e915ae325e9dbf592 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:30:45.063997 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60fbc18-32a7-4615-bb10-ce4322d39233 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:45.065493 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-b60fbc18-32a7-4615-bb10-ce4322d39233 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:30:45.078777 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60fbc18-32a7-4615-bb10-ce4322d39233 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:45.092287 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:30:45.140521 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdd44b8-b856-485f-a918-14775c2f8064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:45.141071 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdd44b8-b856-485f-a918-14775c2f8064 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:45.141336 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdd44b8-b856-485f-a918-14775c2f8064 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:45.141605 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdd44b8-b856-485f-a918-14775c2f8064 admin admin] PATH_INFO: `/v3/projects/ca4a43ddd15747989b9a0352243c8fb5` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:45.142714 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdd44b8-b856-485f-a918-14775c2f8064 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca4a43ddd15747989b9a0352243c8fb5)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:45.144630 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdd44b8-b856-485f-a918-14775c2f8064 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:45.189261 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-2fdd44b8-b856-485f-a918-14775c2f8064 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca4a43ddd15747989b9a0352243c8fb5', 'request_id': 'req-2fdd44b8-b856-485f-a918-14775c2f8064'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:45.194600 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-2fdd44b8-b856-485f-a918-14775c2f8064 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca4a43ddd15747989b9a0352243c8fb5', 'request_id': 'req-2fdd44b8-b856-485f-a918-14775c2f8064'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:45.203310 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-2fdd44b8-b856-485f-a918-14775c2f8064 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca4a43ddd15747989b9a0352243c8fb5', 'request_id': 'req-2fdd44b8-b856-485f-a918-14775c2f8064'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:45.232509 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-2fdd44b8-b856-485f-a918-14775c2f8064 admin admin] The token cache is being invalidate because project ca4a43ddd15747989b9a0352243c8fb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:30:45.232805 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-2fdd44b8-b856-485f-a918-14775c2f8064 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:45.233475 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-2fdd44b8-b856-485f-a918-14775c2f8064 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:45.235019 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1161/2321] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:30:45 2022] DELETE /identity/v3/projects/ca4a43ddd15747989b9a0352243c8fb5 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:30:45.240847 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b4063-41f6-446c-82c2-fb2049797a4e None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:45.241131 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b4063-41f6-446c-82c2-fb2049797a4e None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:45.241402 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b4063-41f6-446c-82c2-fb2049797a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:45.263684 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-012b4063-41f6-446c-82c2-fb2049797a4e None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:30:45.264864 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-012b4063-41f6-446c-82c2-fb2049797a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:30:45.321217 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1161/2322] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:30:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:30:45.329698 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85ffb2-d41c-4792-9fa2-889898ec73da None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:45.329983 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85ffb2-d41c-4792-9fa2-889898ec73da None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:45.330258 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85ffb2-d41c-4792-9fa2-889898ec73da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:45.350101 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-ff85ffb2-d41c-4792-9fa2-889898ec73da None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:30:45.351343 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-ff85ffb2-d41c-4792-9fa2-889898ec73da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:30:45.359312 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1162/2323] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:30:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:30:45.365806 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012b4063-41f6-446c-82c2-fb2049797a4e None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:45.376718 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012b4063-41f6-446c-82c2-fb2049797a4e None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:45.381279 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8e7a30-b353-4fa6-8181-564010619d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:45.381883 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e7a30-b353-4fa6-8181-564010619d98 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:45.382159 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e7a30-b353-4fa6-8181-564010619d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:45.382434 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e7a30-b353-4fa6-8181-564010619d98 admin admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:45.383113 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8e7a30-b353-4fa6-8181-564010619d98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:30:45.383418 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8e7a30-b353-4fa6-8181-564010619d98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:45.384994 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8e7a30-b353-4fa6-8181-564010619d98 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:45.398721 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1162/2324] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 15 12:30:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:30:45.401767 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff85ffb2-d41c-4792-9fa2-889898ec73da None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:45.410999 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff85ffb2-d41c-4792-9fa2-889898ec73da None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:45.415640 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb26bb0-8c7b-4d54-b341-a11a7528ee91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:45.416264 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb26bb0-8c7b-4d54-b341-a11a7528ee91 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:45.416537 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb26bb0-8c7b-4d54-b341-a11a7528ee91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:45.416802 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb26bb0-8c7b-4d54-b341-a11a7528ee91 admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:45.417420 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb26bb0-8c7b-4d54-b341-a11a7528ee91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:45.419380 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb26bb0-8c7b-4d54-b341-a11a7528ee91 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:45.453874 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1163/2325] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:30:45 2022] POST /identity/v3/projects => generated 399 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:30:45.458835 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8e7a30-b353-4fa6-8181-564010619d98 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:45.476903 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8e7a30-b353-4fa6-8181-564010619d98 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:45.556161 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1277f10a-a492-4627-9823-84b14d450f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:45.557589 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1277f10a-a492-4627-9823-84b14d450f66 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:45.557948 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1277f10a-a492-4627-9823-84b14d450f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:45.558152 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1277f10a-a492-4627-9823-84b14d450f66 admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:45.558839 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1277f10a-a492-4627-9823-84b14d450f66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:45.562309 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1277f10a-a492-4627-9823-84b14d450f66 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:45.598291 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1163/2326] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:30:45 2022] POST /identity/v3/users => generated 300 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:30:45.602488 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb26bb0-8c7b-4d54-b341-a11a7528ee91 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:45.617443 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb26bb0-8c7b-4d54-b341-a11a7528ee91 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:45.622860 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a2bf6-3666-4e3a-8a24-657539e2fd54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:45.623634 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a2bf6-3666-4e3a-8a24-657539e2fd54 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:45.625018 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a2bf6-3666-4e3a-8a24-657539e2fd54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:45.625477 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a2bf6-3666-4e3a-8a24-657539e2fd54 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:45.626744 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9a2bf6-3666-4e3a-8a24-657539e2fd54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:45.628741 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9a2bf6-3666-4e3a-8a24-657539e2fd54 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:45.645688 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1164/2327] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:30:45 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:30:45.649657 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1277f10a-a492-4627-9823-84b14d450f66 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:45.661751 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1277f10a-a492-4627-9823-84b14d450f66 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:45.666877 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479255b3-6c19-4b7f-aeae-0d8104550c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:45.667702 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479255b3-6c19-4b7f-aeae-0d8104550c35 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:45.668086 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479255b3-6c19-4b7f-aeae-0d8104550c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:45.668683 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479255b3-6c19-4b7f-aeae-0d8104550c35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:45.669870 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479255b3-6c19-4b7f-aeae-0d8104550c35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:45.671675 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479255b3-6c19-4b7f-aeae-0d8104550c35 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:45.684205 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1164/2328] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:30:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:30:45.688317 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a2bf6-3666-4e3a-8a24-657539e2fd54 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:45.699301 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a2bf6-3666-4e3a-8a24-657539e2fd54 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:45.705451 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb989c5-a58a-49da-b5aa-a675c2f0522f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:45.706187 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb989c5-a58a-49da-b5aa-a675c2f0522f admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:45.706528 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb989c5-a58a-49da-b5aa-a675c2f0522f admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:45.706859 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb989c5-a58a-49da-b5aa-a675c2f0522f admin admin] PATH_INFO: `/v3/projects/427d26f7ca9e4eb4a4fb2f5ba5a7d0fa/users/5fae16ae0a7f41d3928af49904a37db9/roles/9371e5bbc55848949eb951a815f817f2` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:45.726439 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb989c5-a58a-49da-b5aa-a675c2f0522f admin admin] RBAC: Authorizing `identity:create_grant(project_id=427d26f7ca9e4eb4a4fb2f5ba5a7d0fa, user_id=5fae16ae0a7f41d3928af49904a37db9, role_id=9371e5bbc55848949eb951a815f817f2)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:45.729127 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb989c5-a58a-49da-b5aa-a675c2f0522f admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:45.744308 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1165/2329] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:30:45 2022] PUT /identity/v3/projects/427d26f7ca9e4eb4a4fb2f5ba5a7d0fa/users/5fae16ae0a7f41d3928af49904a37db9/roles/9371e5bbc55848949eb951a815f817f2 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:30:45.756254 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0c51b2-bbb3-47f2-9a63-492b1959dc75 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:45.756767 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0c51b2-bbb3-47f2-9a63-492b1959dc75 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:45.756852 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0c51b2-bbb3-47f2-9a63-492b1959dc75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:45.790939 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-bf0c51b2-bbb3-47f2-9a63-492b1959dc75 None None] MFA Rules not processed for user `5fae16ae0a7f41d3928af49904a37db9`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:30:45.792213 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-bf0c51b2-bbb3-47f2-9a63-492b1959dc75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:30:45.804361 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:30:45.863382 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1165/2330] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:30:45 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:30:45.867828 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb989c5-a58a-49da-b5aa-a675c2f0522f admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:45.915372 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:30:45.934472 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb989c5-a58a-49da-b5aa-a675c2f0522f admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:45.939352 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711356dd-052b-4885-a032-af4caa62e953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:45.939960 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711356dd-052b-4885-a032-af4caa62e953 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:45.940244 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711356dd-052b-4885-a032-af4caa62e953 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:45.940518 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711356dd-052b-4885-a032-af4caa62e953 admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:45.941188 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711356dd-052b-4885-a032-af4caa62e953 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:45.943165 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711356dd-052b-4885-a032-af4caa62e953 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:45.973496 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1166/2331] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:30:45 2022] POST /identity/v3/projects => generated 401 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:30:45.975362 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0c51b2-bbb3-47f2-9a63-492b1959dc75 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:45.988429 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0c51b2-bbb3-47f2-9a63-492b1959dc75 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:46.048496 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00ecad6-7879-4484-9e03-d16f83612947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:46.049849 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00ecad6-7879-4484-9e03-d16f83612947 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:46.050168 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00ecad6-7879-4484-9e03-d16f83612947 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:46.050394 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00ecad6-7879-4484-9e03-d16f83612947 admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:46.051255 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00ecad6-7879-4484-9e03-d16f83612947 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:46.053158 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00ecad6-7879-4484-9e03-d16f83612947 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:46.079966 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1166/2332] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:30:45 2022] POST /identity/v3/users => generated 307 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:30:46.081159 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711356dd-052b-4885-a032-af4caa62e953 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:46.091901 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711356dd-052b-4885-a032-af4caa62e953 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:46.096902 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4bc89b-e2cf-4aad-9057-3c836188146c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:46.097496 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4bc89b-e2cf-4aad-9057-3c836188146c admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:46.097767 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4bc89b-e2cf-4aad-9057-3c836188146c admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:46.098166 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4bc89b-e2cf-4aad-9057-3c836188146c admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:46.098840 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4bc89b-e2cf-4aad-9057-3c836188146c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:46.100427 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4bc89b-e2cf-4aad-9057-3c836188146c admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:46.111814 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1167/2333] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:30:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:30:46.115938 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00ecad6-7879-4484-9e03-d16f83612947 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:46.128696 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00ecad6-7879-4484-9e03-d16f83612947 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:46.133750 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f51a15-e7d2-43e7-b841-684122d49962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:46.134447 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f51a15-e7d2-43e7-b841-684122d49962 admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:46.134749 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f51a15-e7d2-43e7-b841-684122d49962 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:46.135022 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f51a15-e7d2-43e7-b841-684122d49962 admin admin] PATH_INFO: `/v3/projects/555f900e435a4a9c92a6e2e4279ca0cc/users/05195c9931d040609e39237409528567/roles/7f53f1c823b746529ba5057bf21b2477` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:46.150959 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f51a15-e7d2-43e7-b841-684122d49962 admin admin] RBAC: Authorizing `identity:create_grant(project_id=555f900e435a4a9c92a6e2e4279ca0cc, user_id=05195c9931d040609e39237409528567, role_id=7f53f1c823b746529ba5057bf21b2477)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:46.154162 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f51a15-e7d2-43e7-b841-684122d49962 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:46.167797 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1167/2334] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:30:46 2022] PUT /identity/v3/projects/555f900e435a4a9c92a6e2e4279ca0cc/users/05195c9931d040609e39237409528567/roles/7f53f1c823b746529ba5057bf21b2477 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:30:46.172169 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4bc89b-e2cf-4aad-9057-3c836188146c admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:46.182075 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4bc89b-e2cf-4aad-9057-3c836188146c admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:46.243426 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b458a6ad-76b0-4c71-8cb5-5831e31431d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:46.244045 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b458a6ad-76b0-4c71-8cb5-5831e31431d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:46.244330 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b458a6ad-76b0-4c71-8cb5-5831e31431d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:46.244603 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b458a6ad-76b0-4c71-8cb5-5831e31431d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:46.245253 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b458a6ad-76b0-4c71-8cb5-5831e31431d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:46.246896 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b458a6ad-76b0-4c71-8cb5-5831e31431d9 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:46.257654 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1168/2335] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:30:46 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:30:46.261835 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f51a15-e7d2-43e7-b841-684122d49962 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:46.274449 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f51a15-e7d2-43e7-b841-684122d49962 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:46.281114 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4d058f-0c52-4122-9ddd-dbf5dd502a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:46.281882 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d058f-0c52-4122-9ddd-dbf5dd502a6f admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:46.282052 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d058f-0c52-4122-9ddd-dbf5dd502a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:46.282333 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d058f-0c52-4122-9ddd-dbf5dd502a6f admin admin] PATH_INFO: `/v3/projects/555f900e435a4a9c92a6e2e4279ca0cc/users/05195c9931d040609e39237409528567/roles/7f53f1c823b746529ba5057bf21b2477` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:46.284456 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4d058f-0c52-4122-9ddd-dbf5dd502a6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=555f900e435a4a9c92a6e2e4279ca0cc, user_id=05195c9931d040609e39237409528567, role_id=7f53f1c823b746529ba5057bf21b2477)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:46.287126 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4d058f-0c52-4122-9ddd-dbf5dd502a6f admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:46.299602 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1168/2336] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:30:46 2022] PUT /identity/v3/projects/555f900e435a4a9c92a6e2e4279ca0cc/users/05195c9931d040609e39237409528567/roles/7f53f1c823b746529ba5057bf21b2477 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:30:46.310533 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6add4115-c63f-4b97-9586-8654150d1e6e None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:46.310857 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6add4115-c63f-4b97-9586-8654150d1e6e None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:46.311152 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6add4115-c63f-4b97-9586-8654150d1e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:46.339162 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-6add4115-c63f-4b97-9586-8654150d1e6e None None] MFA Rules not processed for user `05195c9931d040609e39237409528567`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:30:46.340363 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-6add4115-c63f-4b97-9586-8654150d1e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:30:46.414233 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1169/2337] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:30:46 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:30:46.425854 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4d058f-0c52-4122-9ddd-dbf5dd502a6f admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:46.427804 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-fa4d058f-0c52-4122-9ddd-dbf5dd502a6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:30:46.488033 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4d058f-0c52-4122-9ddd-dbf5dd502a6f admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:46.491890 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f5d3d-eed8-4403-a8ed-c668f1501810 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceafc5e4283841528053f01931f10293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:46.492474 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f5d3d-eed8-4403-a8ed-c668f1501810 service cinder] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:46.492791 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f5d3d-eed8-4403-a8ed-c668f1501810 service cinder] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:46.493075 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f5d3d-eed8-4403-a8ed-c668f1501810 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:46.502896 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816f5d3d-eed8-4403-a8ed-c668f1501810 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:46.504338 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816f5d3d-eed8-4403-a8ed-c668f1501810 service cinder] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:46.526271 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1169/2338] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:30:46 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:30:46.598608 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6add4115-c63f-4b97-9586-8654150d1e6e None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:46.608479 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6add4115-c63f-4b97-9586-8654150d1e6e None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:46.612118 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dea54d-9c45-4623-967d-affb63f07751 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceafc5e4283841528053f01931f10293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:46.612744 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dea54d-9c45-4623-967d-affb63f07751 service cinder] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:46.613025 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dea54d-9c45-4623-967d-affb63f07751 service cinder] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:46.613298 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dea54d-9c45-4623-967d-affb63f07751 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:46.654314 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:30:46.673443 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dea54d-9c45-4623-967d-affb63f07751 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:46.674808 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dea54d-9c45-4623-967d-affb63f07751 service cinder] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:46.683898 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1170/2339] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:30:46 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:30:47.348082 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1619950d-2dbe-4ab0-add7-17a8c0b147ab None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:47.348596 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1619950d-2dbe-4ab0-add7-17a8c0b147ab None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:47.348690 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1619950d-2dbe-4ab0-add7-17a8c0b147ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:47.367797 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-1619950d-2dbe-4ab0-add7-17a8c0b147ab None None] MFA Rules not processed for user `74811d83f5924dfbaa0866a2a48ca281`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:30:47.368961 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-1619950d-2dbe-4ab0-add7-17a8c0b147ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:30:47.373381 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:30:47.424499 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1170/2340] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:30:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:30:47.729332 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dea54d-9c45-4623-967d-affb63f07751 service cinder] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:47.730866 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-a1dea54d-9c45-4623-967d-affb63f07751 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:30:47.789220 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dea54d-9c45-4623-967d-affb63f07751 service cinder] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:47.792808 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dba021-0e35-45ba-9dd1-21e7fbdc2921 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:47.793404 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dba021-0e35-45ba-9dd1-21e7fbdc2921 service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:47.794173 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dba021-0e35-45ba-9dd1-21e7fbdc2921 service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:47.794440 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dba021-0e35-45ba-9dd1-21e7fbdc2921 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:47.796190 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-e9dba021-0e35-45ba-9dd1-21e7fbdc2921 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:30:47.805241 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dba021-0e35-45ba-9dd1-21e7fbdc2921 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:47.806663 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dba021-0e35-45ba-9dd1-21e7fbdc2921 service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:47.815045 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1171/2341] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:30:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 12:30:50.828719 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1619950d-2dbe-4ab0-add7-17a8c0b147ab None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:50.894870 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1619950d-2dbe-4ab0-add7-17a8c0b147ab None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:50.899451 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bd49d6-13b8-41e1-a2f2-4be4a8ebaf2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:50.900074 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd49d6-13b8-41e1-a2f2-4be4a8ebaf2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:50.900348 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd49d6-13b8-41e1-a2f2-4be4a8ebaf2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:50.900624 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd49d6-13b8-41e1-a2f2-4be4a8ebaf2f admin admin] PATH_INFO: `/v3/users/5fae16ae0a7f41d3928af49904a37db9` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:50.902039 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bd49d6-13b8-41e1-a2f2-4be4a8ebaf2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fae16ae0a7f41d3928af49904a37db9)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:50.903683 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bd49d6-13b8-41e1-a2f2-4be4a8ebaf2f admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:50.953654 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-81bd49d6-13b8-41e1-a2f2-4be4a8ebaf2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fae16ae0a7f41d3928af49904a37db9'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:50.961398 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-81bd49d6-13b8-41e1-a2f2-4be4a8ebaf2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fae16ae0a7f41d3928af49904a37db9'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:50.962184 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-81bd49d6-13b8-41e1-a2f2-4be4a8ebaf2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fae16ae0a7f41d3928af49904a37db9'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:50.962937 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-81bd49d6-13b8-41e1-a2f2-4be4a8ebaf2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fae16ae0a7f41d3928af49904a37db9'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:50.975976 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-81bd49d6-13b8-41e1-a2f2-4be4a8ebaf2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fae16ae0a7f41d3928af49904a37db9'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:50.994059 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1171/2342] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:30:50 2022] DELETE /identity/v3/users/5fae16ae0a7f41d3928af49904a37db9 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:30:50.999223 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4891626f-2884-405c-80f9-355b6d4d2bd0 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:50.999690 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4891626f-2884-405c-80f9-355b6d4d2bd0 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:50.999804 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4891626f-2884-405c-80f9-355b6d4d2bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:51.018766 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-4891626f-2884-405c-80f9-355b6d4d2bd0 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:30:51.019965 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-4891626f-2884-405c-80f9-355b6d4d2bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:30:51.079932 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1172/2343] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:30:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:30:51.090066 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bd49d6-13b8-41e1-a2f2-4be4a8ebaf2f admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:51.091632 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-81bd49d6-13b8-41e1-a2f2-4be4a8ebaf2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:30:51.134455 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:30:51.166277 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bd49d6-13b8-41e1-a2f2-4be4a8ebaf2f admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:51.170551 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d223c5-d1a8-4c48-a909-a470981ac4c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:51.171195 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d223c5-d1a8-4c48-a909-a470981ac4c2 service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:51.171474 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d223c5-d1a8-4c48-a909-a470981ac4c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:51.171742 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d223c5-d1a8-4c48-a909-a470981ac4c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:51.181235 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d223c5-d1a8-4c48-a909-a470981ac4c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:51.182656 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d223c5-d1a8-4c48-a909-a470981ac4c2 service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:51.192511 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1172/2344] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:30:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:30:51.637459 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4891626f-2884-405c-80f9-355b6d4d2bd0 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:51.639587 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-4891626f-2884-405c-80f9-355b6d4d2bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:30:51.651480 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4891626f-2884-405c-80f9-355b6d4d2bd0 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:51.657389 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd66c43e-94f2-4772-a8ab-172958cf063c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:51.658031 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66c43e-94f2-4772-a8ab-172958cf063c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:51.658310 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66c43e-94f2-4772-a8ab-172958cf063c admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:51.658583 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66c43e-94f2-4772-a8ab-172958cf063c admin admin] PATH_INFO: `/v3/projects/427d26f7ca9e4eb4a4fb2f5ba5a7d0fa` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:51.659747 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd66c43e-94f2-4772-a8ab-172958cf063c admin admin] RBAC: Authorizing `identity:delete_project(project_id=427d26f7ca9e4eb4a4fb2f5ba5a7d0fa)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:51.661658 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd66c43e-94f2-4772-a8ab-172958cf063c admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:51.717886 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-dd66c43e-94f2-4772-a8ab-172958cf063c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '427d26f7ca9e4eb4a4fb2f5ba5a7d0fa', 'request_id': 'req-dd66c43e-94f2-4772-a8ab-172958cf063c'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:51.723798 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-dd66c43e-94f2-4772-a8ab-172958cf063c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '427d26f7ca9e4eb4a4fb2f5ba5a7d0fa', 'request_id': 'req-dd66c43e-94f2-4772-a8ab-172958cf063c'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:51.732287 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-dd66c43e-94f2-4772-a8ab-172958cf063c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '427d26f7ca9e4eb4a4fb2f5ba5a7d0fa', 'request_id': 'req-dd66c43e-94f2-4772-a8ab-172958cf063c'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:51.744602 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-dd66c43e-94f2-4772-a8ab-172958cf063c admin admin] The token cache is being invalidate because project 427d26f7ca9e4eb4a4fb2f5ba5a7d0fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:30:51.745031 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-dd66c43e-94f2-4772-a8ab-172958cf063c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:51.745707 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-dd66c43e-94f2-4772-a8ab-172958cf063c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:51.747266 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1173/2345] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:30:51 2022] DELETE /identity/v3/projects/427d26f7ca9e4eb4a4fb2f5ba5a7d0fa => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:30:51.751745 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d223c5-d1a8-4c48-a909-a470981ac4c2 service neutron] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:51.765329 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d223c5-d1a8-4c48-a909-a470981ac4c2 service neutron] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:51.821954 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8284769-c437-4a96-828d-08e8c83c3348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:51.822572 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8284769-c437-4a96-828d-08e8c83c3348 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:51.822875 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8284769-c437-4a96-828d-08e8c83c3348 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:51.823150 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8284769-c437-4a96-828d-08e8c83c3348 admin admin] PATH_INFO: `/v3/users/05195c9931d040609e39237409528567` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:51.824254 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8284769-c437-4a96-828d-08e8c83c3348 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05195c9931d040609e39237409528567)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:51.826729 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8284769-c437-4a96-828d-08e8c83c3348 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:51.871235 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-a8284769-c437-4a96-828d-08e8c83c3348 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05195c9931d040609e39237409528567'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:51.879152 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-a8284769-c437-4a96-828d-08e8c83c3348 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05195c9931d040609e39237409528567'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:51.879739 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-a8284769-c437-4a96-828d-08e8c83c3348 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05195c9931d040609e39237409528567'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:51.880356 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-a8284769-c437-4a96-828d-08e8c83c3348 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05195c9931d040609e39237409528567'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:51.887373 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-a8284769-c437-4a96-828d-08e8c83c3348 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05195c9931d040609e39237409528567'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:51.906242 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1173/2346] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:30:51 2022] DELETE /identity/v3/users/05195c9931d040609e39237409528567 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:30:52.190234 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd66c43e-94f2-4772-a8ab-172958cf063c admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:52.191740 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-dd66c43e-94f2-4772-a8ab-172958cf063c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:30:52.202395 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:30:52.207381 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd66c43e-94f2-4772-a8ab-172958cf063c admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:52.267067 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80b3eb6-4788-4407-8e80-41a50b71ce53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:52.267706 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b3eb6-4788-4407-8e80-41a50b71ce53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:52.267986 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b3eb6-4788-4407-8e80-41a50b71ce53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:52.268259 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b3eb6-4788-4407-8e80-41a50b71ce53 admin admin] PATH_INFO: `/v3/projects/555f900e435a4a9c92a6e2e4279ca0cc` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:52.269390 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80b3eb6-4788-4407-8e80-41a50b71ce53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=555f900e435a4a9c92a6e2e4279ca0cc)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:52.271380 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80b3eb6-4788-4407-8e80-41a50b71ce53 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:52.317154 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-f80b3eb6-4788-4407-8e80-41a50b71ce53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '555f900e435a4a9c92a6e2e4279ca0cc', 'request_id': 'req-f80b3eb6-4788-4407-8e80-41a50b71ce53'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:52.322505 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-f80b3eb6-4788-4407-8e80-41a50b71ce53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '555f900e435a4a9c92a6e2e4279ca0cc', 'request_id': 'req-f80b3eb6-4788-4407-8e80-41a50b71ce53'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:52.330029 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-f80b3eb6-4788-4407-8e80-41a50b71ce53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '555f900e435a4a9c92a6e2e4279ca0cc', 'request_id': 'req-f80b3eb6-4788-4407-8e80-41a50b71ce53'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:52.340754 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-f80b3eb6-4788-4407-8e80-41a50b71ce53 admin admin] The token cache is being invalidate because project 555f900e435a4a9c92a6e2e4279ca0cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:30:52.341600 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-f80b3eb6-4788-4407-8e80-41a50b71ce53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:52.342235 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-f80b3eb6-4788-4407-8e80-41a50b71ce53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:52.343727 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1174/2347] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:30:52 2022] DELETE /identity/v3/projects/555f900e435a4a9c92a6e2e4279ca0cc => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:30:52.348706 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ff82b-fc20-4ab3-9ba1-cab14f124ef5 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:52.348996 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ff82b-fc20-4ab3-9ba1-cab14f124ef5 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:52.349268 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ff82b-fc20-4ab3-9ba1-cab14f124ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:52.368550 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-167ff82b-fc20-4ab3-9ba1-cab14f124ef5 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:30:52.369750 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-167ff82b-fc20-4ab3-9ba1-cab14f124ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:30:52.417408 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:30:52.429608 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1174/2348] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:30:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:30:52.437366 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d0672-6b00-487f-b01b-499703812695 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:52.437646 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d0672-6b00-487f-b01b-499703812695 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:52.437918 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d0672-6b00-487f-b01b-499703812695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:52.457488 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-b30d0672-6b00-487f-b01b-499703812695 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:30:52.458675 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-b30d0672-6b00-487f-b01b-499703812695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:30:52.466991 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1175/2349] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:30:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:30:52.471165 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167ff82b-fc20-4ab3-9ba1-cab14f124ef5 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:52.480666 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167ff82b-fc20-4ab3-9ba1-cab14f124ef5 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:52.485809 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830f7cf9-500c-4086-95e9-cd4166a09a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:52.486402 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f7cf9-500c-4086-95e9-cd4166a09a94 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:52.486678 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f7cf9-500c-4086-95e9-cd4166a09a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:52.486971 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f7cf9-500c-4086-95e9-cd4166a09a94 admin admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:52.487612 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830f7cf9-500c-4086-95e9-cd4166a09a94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:30:52.487913 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830f7cf9-500c-4086-95e9-cd4166a09a94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:52.489540 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830f7cf9-500c-4086-95e9-cd4166a09a94 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:52.501861 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1175/2350] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 15 12:30:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:30:52.505896 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30d0672-6b00-487f-b01b-499703812695 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:52.515092 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30d0672-6b00-487f-b01b-499703812695 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:52.519709 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5359ab-6fe4-4b0d-8711-8c090dd32f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:52.520316 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5359ab-6fe4-4b0d-8711-8c090dd32f0e admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:52.520615 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5359ab-6fe4-4b0d-8711-8c090dd32f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:52.520888 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5359ab-6fe4-4b0d-8711-8c090dd32f0e admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:52.521522 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5359ab-6fe4-4b0d-8711-8c090dd32f0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:52.523446 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5359ab-6fe4-4b0d-8711-8c090dd32f0e admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:52.549947 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1176/2351] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:30:52 2022] POST /identity/v3/projects => generated 383 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:30:52.553797 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830f7cf9-500c-4086-95e9-cd4166a09a94 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:52.564259 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830f7cf9-500c-4086-95e9-cd4166a09a94 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:52.619045 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5c1d96-36e4-4e87-bb15-7014cbaf5f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:52.619640 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c1d96-36e4-4e87-bb15-7014cbaf5f61 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:52.619919 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c1d96-36e4-4e87-bb15-7014cbaf5f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:52.620188 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c1d96-36e4-4e87-bb15-7014cbaf5f61 admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:52.620815 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5c1d96-36e4-4e87-bb15-7014cbaf5f61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:52.622871 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5c1d96-36e4-4e87-bb15-7014cbaf5f61 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:52.646960 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1176/2352] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:30:52 2022] POST /identity/v3/users => generated 292 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 12:30:52.648090 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5359ab-6fe4-4b0d-8711-8c090dd32f0e admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:52.659283 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5359ab-6fe4-4b0d-8711-8c090dd32f0e admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:52.663871 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b993c2e7-05a9-41d9-9952-9823270600fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:52.664466 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b993c2e7-05a9-41d9-9952-9823270600fd admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:52.664743 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b993c2e7-05a9-41d9-9952-9823270600fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:52.665013 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b993c2e7-05a9-41d9-9952-9823270600fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:52.665650 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b993c2e7-05a9-41d9-9952-9823270600fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:52.667273 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b993c2e7-05a9-41d9-9952-9823270600fd admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:52.677886 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1177/2353] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:30:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:30:52.681752 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5c1d96-36e4-4e87-bb15-7014cbaf5f61 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:52.692159 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5c1d96-36e4-4e87-bb15-7014cbaf5f61 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:52.696758 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dff24d-774f-4912-a9ea-f63bd663a8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:52.697348 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dff24d-774f-4912-a9ea-f63bd663a8fc admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:52.697626 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dff24d-774f-4912-a9ea-f63bd663a8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:52.697896 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dff24d-774f-4912-a9ea-f63bd663a8fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:52.698528 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dff24d-774f-4912-a9ea-f63bd663a8fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:52.700161 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dff24d-774f-4912-a9ea-f63bd663a8fc admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:52.710799 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1177/2354] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:30:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:30:52.714519 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b993c2e7-05a9-41d9-9952-9823270600fd admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:52.724431 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b993c2e7-05a9-41d9-9952-9823270600fd admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:52.728974 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24744b0d-e338-48a7-9ac2-828aed5c9841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:52.729609 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24744b0d-e338-48a7-9ac2-828aed5c9841 admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:52.729883 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24744b0d-e338-48a7-9ac2-828aed5c9841 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:52.730149 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24744b0d-e338-48a7-9ac2-828aed5c9841 admin admin] PATH_INFO: `/v3/projects/294fbc3b2e574e76b0c8132c558f2084/users/c962541061724e14843cf121c602c0a6/roles/9371e5bbc55848949eb951a815f817f2` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:52.746280 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24744b0d-e338-48a7-9ac2-828aed5c9841 admin admin] RBAC: Authorizing `identity:create_grant(project_id=294fbc3b2e574e76b0c8132c558f2084, user_id=c962541061724e14843cf121c602c0a6, role_id=9371e5bbc55848949eb951a815f817f2)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:52.749658 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24744b0d-e338-48a7-9ac2-828aed5c9841 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:52.762318 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1178/2355] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:30:52 2022] PUT /identity/v3/projects/294fbc3b2e574e76b0c8132c558f2084/users/c962541061724e14843cf121c602c0a6/roles/9371e5bbc55848949eb951a815f817f2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:30:52.773481 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b9e6f-d87b-4c51-9c03-9b23d0477dc0 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:52.773767 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b9e6f-d87b-4c51-9c03-9b23d0477dc0 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:52.774038 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b9e6f-d87b-4c51-9c03-9b23d0477dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:52.802863 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-2a1b9e6f-d87b-4c51-9c03-9b23d0477dc0 None None] MFA Rules not processed for user `c962541061724e14843cf121c602c0a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:30:52.804071 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-2a1b9e6f-d87b-4c51-9c03-9b23d0477dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:30:52.869223 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1178/2356] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:30:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:30:52.874389 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24744b0d-e338-48a7-9ac2-828aed5c9841 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:52.907828 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:30:52.940628 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24744b0d-e338-48a7-9ac2-828aed5c9841 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:52.945540 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd8c156-72f5-47d8-ac75-8b8d2bcb6645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:52.946145 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd8c156-72f5-47d8-ac75-8b8d2bcb6645 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:52.946424 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd8c156-72f5-47d8-ac75-8b8d2bcb6645 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:52.946707 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd8c156-72f5-47d8-ac75-8b8d2bcb6645 admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:52.947534 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd8c156-72f5-47d8-ac75-8b8d2bcb6645 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:52.949457 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd8c156-72f5-47d8-ac75-8b8d2bcb6645 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:52.977408 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1179/2357] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:30:52 2022] POST /identity/v3/projects => generated 381 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:30:52.981448 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b9e6f-d87b-4c51-9c03-9b23d0477dc0 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:52.992599 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b9e6f-d87b-4c51-9c03-9b23d0477dc0 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:53.038949 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:30:53.050421 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b3c73d-c421-403e-85cd-e16c010b005f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:53.051070 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b3c73d-c421-403e-85cd-e16c010b005f admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:53.051348 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b3c73d-c421-403e-85cd-e16c010b005f admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:53.051618 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b3c73d-c421-403e-85cd-e16c010b005f admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:53.052251 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b3c73d-c421-403e-85cd-e16c010b005f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:53.054154 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b3c73d-c421-403e-85cd-e16c010b005f admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:53.077300 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1179/2358] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:30:52 2022] POST /identity/v3/users => generated 297 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 12:30:53.078490 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd8c156-72f5-47d8-ac75-8b8d2bcb6645 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:53.088646 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd8c156-72f5-47d8-ac75-8b8d2bcb6645 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:53.093807 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83727117-d7d5-43b0-88b8-c20668013fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:53.094390 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83727117-d7d5-43b0-88b8-c20668013fc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:53.094664 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83727117-d7d5-43b0-88b8-c20668013fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:53.094963 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83727117-d7d5-43b0-88b8-c20668013fc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:53.095597 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83727117-d7d5-43b0-88b8-c20668013fc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:53.097172 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83727117-d7d5-43b0-88b8-c20668013fc3 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:53.108164 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1180/2359] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:30:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:30:53.112037 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b3c73d-c421-403e-85cd-e16c010b005f admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:53.121753 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b3c73d-c421-403e-85cd-e16c010b005f admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:53.126264 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaaed3d-1d7a-46ed-99e5-41e9df5e2f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:53.127170 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaaed3d-1d7a-46ed-99e5-41e9df5e2f12 admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:53.127448 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaaed3d-1d7a-46ed-99e5-41e9df5e2f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:53.127716 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaaed3d-1d7a-46ed-99e5-41e9df5e2f12 admin admin] PATH_INFO: `/v3/projects/ffcc536c073248b9800e95cf82aa7b64/users/0c1511cdf99d499cbcf3310a937f286d/roles/7f53f1c823b746529ba5057bf21b2477` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:53.141999 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaaed3d-1d7a-46ed-99e5-41e9df5e2f12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffcc536c073248b9800e95cf82aa7b64, user_id=0c1511cdf99d499cbcf3310a937f286d, role_id=7f53f1c823b746529ba5057bf21b2477)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:53.144738 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaaed3d-1d7a-46ed-99e5-41e9df5e2f12 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:53.157267 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1180/2360] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:30:53 2022] PUT /identity/v3/projects/ffcc536c073248b9800e95cf82aa7b64/users/0c1511cdf99d499cbcf3310a937f286d/roles/7f53f1c823b746529ba5057bf21b2477 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:30:53.161308 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83727117-d7d5-43b0-88b8-c20668013fc3 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:53.172572 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83727117-d7d5-43b0-88b8-c20668013fc3 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:53.226346 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feee7fc-56dc-484b-90fc-290a62f8f2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:53.226974 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feee7fc-56dc-484b-90fc-290a62f8f2b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:53.227250 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feee7fc-56dc-484b-90fc-290a62f8f2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:53.227515 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feee7fc-56dc-484b-90fc-290a62f8f2b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:53.228141 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feee7fc-56dc-484b-90fc-290a62f8f2b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:53.229741 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feee7fc-56dc-484b-90fc-290a62f8f2b5 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:53.239642 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1181/2361] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:30:53 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:30:53.243879 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaaed3d-1d7a-46ed-99e5-41e9df5e2f12 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:53.254420 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaaed3d-1d7a-46ed-99e5-41e9df5e2f12 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:53.259469 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fa024e-f3cf-40ba-8eef-cfc39c254838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:53.260119 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa024e-f3cf-40ba-8eef-cfc39c254838 admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:53.260428 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa024e-f3cf-40ba-8eef-cfc39c254838 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:53.260663 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa024e-f3cf-40ba-8eef-cfc39c254838 admin admin] PATH_INFO: `/v3/projects/ffcc536c073248b9800e95cf82aa7b64/users/0c1511cdf99d499cbcf3310a937f286d/roles/7f53f1c823b746529ba5057bf21b2477` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:53.262613 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fa024e-f3cf-40ba-8eef-cfc39c254838 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffcc536c073248b9800e95cf82aa7b64, user_id=0c1511cdf99d499cbcf3310a937f286d, role_id=7f53f1c823b746529ba5057bf21b2477)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:53.265320 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fa024e-f3cf-40ba-8eef-cfc39c254838 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:53.275452 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1181/2362] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:30:53 2022] PUT /identity/v3/projects/ffcc536c073248b9800e95cf82aa7b64/users/0c1511cdf99d499cbcf3310a937f286d/roles/7f53f1c823b746529ba5057bf21b2477 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:30:53.286367 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d1af24-4de9-4206-987d-7dc8002a9ea0 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:53.286653 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d1af24-4de9-4206-987d-7dc8002a9ea0 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:53.286998 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d1af24-4de9-4206-987d-7dc8002a9ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:53.317063 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-44d1af24-4de9-4206-987d-7dc8002a9ea0 None None] MFA Rules not processed for user `0c1511cdf99d499cbcf3310a937f286d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:30:53.318280 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-44d1af24-4de9-4206-987d-7dc8002a9ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:30:53.384116 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1182/2363] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:30:53 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:30:53.396078 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fa024e-f3cf-40ba-8eef-cfc39c254838 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:53.397891 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-65fa024e-f3cf-40ba-8eef-cfc39c254838 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:30:53.455760 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fa024e-f3cf-40ba-8eef-cfc39c254838 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:53.459283 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6b6cad-e68d-4388-8602-9351f76ad5b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceafc5e4283841528053f01931f10293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:53.459882 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6b6cad-e68d-4388-8602-9351f76ad5b8 service cinder] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:53.460165 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6b6cad-e68d-4388-8602-9351f76ad5b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:53.460435 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6b6cad-e68d-4388-8602-9351f76ad5b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:53.469809 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6b6cad-e68d-4388-8602-9351f76ad5b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:53.471304 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6b6cad-e68d-4388-8602-9351f76ad5b8 service cinder] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:53.480613 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1182/2364] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:30:53 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:30:53.554658 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d1af24-4de9-4206-987d-7dc8002a9ea0 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:53.563978 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d1af24-4de9-4206-987d-7dc8002a9ea0 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:53.567566 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f1b1a2-72d4-464e-bf81-5e5c4c20a2f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceafc5e4283841528053f01931f10293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:53.568155 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f1b1a2-72d4-464e-bf81-5e5c4c20a2f2 service cinder] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:53.568426 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f1b1a2-72d4-464e-bf81-5e5c4c20a2f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:53.568691 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f1b1a2-72d4-464e-bf81-5e5c4c20a2f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:53.593320 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:30:53.631949 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f1b1a2-72d4-464e-bf81-5e5c4c20a2f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:53.634178 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f1b1a2-72d4-464e-bf81-5e5c4c20a2f2 service cinder] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:53.647248 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1183/2365] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:30:53 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:30:53.912879 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6b6cad-e68d-4388-8602-9351f76ad5b8 service cinder] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:53.979468 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6b6cad-e68d-4388-8602-9351f76ad5b8 service cinder] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:53.985634 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78b261b-5be2-4cd9-aa49-c0df5b4b2ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:53.986492 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78b261b-5be2-4cd9-aa49-c0df5b4b2ceb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:53.986583 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78b261b-5be2-4cd9-aa49-c0df5b4b2ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:53.986890 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78b261b-5be2-4cd9-aa49-c0df5b4b2ceb admin admin] PATH_INFO: `/v3/users/c962541061724e14843cf121c602c0a6` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:53.988076 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78b261b-5be2-4cd9-aa49-c0df5b4b2ceb admin admin] RBAC: Authorizing `identity:delete_user(user_id=c962541061724e14843cf121c602c0a6)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:53.990058 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78b261b-5be2-4cd9-aa49-c0df5b4b2ceb admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:54.038818 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-d78b261b-5be2-4cd9-aa49-c0df5b4b2ceb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c962541061724e14843cf121c602c0a6'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:54.040500 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:30:54.047129 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-d78b261b-5be2-4cd9-aa49-c0df5b4b2ceb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c962541061724e14843cf121c602c0a6'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:54.047828 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-d78b261b-5be2-4cd9-aa49-c0df5b4b2ceb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c962541061724e14843cf121c602c0a6'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:54.049031 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-d78b261b-5be2-4cd9-aa49-c0df5b4b2ceb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c962541061724e14843cf121c602c0a6'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:54.056955 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-d78b261b-5be2-4cd9-aa49-c0df5b4b2ceb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c962541061724e14843cf121c602c0a6'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:54.081898 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1183/2366] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:30:53 2022] DELETE /identity/v3/users/c962541061724e14843cf121c602c0a6 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:30:54.086892 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd961c5-e4df-4865-b392-281a8b31069d None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:54.087206 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd961c5-e4df-4865-b392-281a8b31069d None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:54.087494 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd961c5-e4df-4865-b392-281a8b31069d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:54.108655 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-fbd961c5-e4df-4865-b392-281a8b31069d None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:30:54.110283 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-fbd961c5-e4df-4865-b392-281a8b31069d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:30:54.185589 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1184/2367] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:30:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:30:54.196385 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78b261b-5be2-4cd9-aa49-c0df5b4b2ceb admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:54.197828 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-d78b261b-5be2-4cd9-aa49-c0df5b4b2ceb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:30:54.255824 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78b261b-5be2-4cd9-aa49-c0df5b4b2ceb admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:54.259368 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b183a3f1-e30b-40f2-bbbe-316bc7c014a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:54.259968 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b183a3f1-e30b-40f2-bbbe-316bc7c014a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:54.260249 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b183a3f1-e30b-40f2-bbbe-316bc7c014a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:54.260516 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b183a3f1-e30b-40f2-bbbe-316bc7c014a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:54.270047 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b183a3f1-e30b-40f2-bbbe-316bc7c014a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:54.271482 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b183a3f1-e30b-40f2-bbbe-316bc7c014a0 service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:54.282130 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1184/2368] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:30:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:30:54.715563 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd961c5-e4df-4865-b392-281a8b31069d None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:54.717221 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-fbd961c5-e4df-4865-b392-281a8b31069d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:30:54.739729 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd961c5-e4df-4865-b392-281a8b31069d None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:54.745434 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dd0547-f288-4cb0-ace3-c9a800998c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:54.746090 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd0547-f288-4cb0-ace3-c9a800998c47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:54.746367 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd0547-f288-4cb0-ace3-c9a800998c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:54.746641 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd0547-f288-4cb0-ace3-c9a800998c47 admin admin] PATH_INFO: `/v3/projects/294fbc3b2e574e76b0c8132c558f2084` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:54.748360 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dd0547-f288-4cb0-ace3-c9a800998c47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=294fbc3b2e574e76b0c8132c558f2084)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:54.750278 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dd0547-f288-4cb0-ace3-c9a800998c47 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:54.798443 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-48dd0547-f288-4cb0-ace3-c9a800998c47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '294fbc3b2e574e76b0c8132c558f2084', 'request_id': 'req-48dd0547-f288-4cb0-ace3-c9a800998c47'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:54.803952 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-48dd0547-f288-4cb0-ace3-c9a800998c47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '294fbc3b2e574e76b0c8132c558f2084', 'request_id': 'req-48dd0547-f288-4cb0-ace3-c9a800998c47'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:54.811987 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-48dd0547-f288-4cb0-ace3-c9a800998c47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '294fbc3b2e574e76b0c8132c558f2084', 'request_id': 'req-48dd0547-f288-4cb0-ace3-c9a800998c47'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:54.822965 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-48dd0547-f288-4cb0-ace3-c9a800998c47 admin admin] The token cache is being invalidate because project 294fbc3b2e574e76b0c8132c558f2084 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:30:54.823280 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-48dd0547-f288-4cb0-ace3-c9a800998c47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:54.823905 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-48dd0547-f288-4cb0-ace3-c9a800998c47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:54.825387 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1185/2369] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:30:54 2022] DELETE /identity/v3/projects/294fbc3b2e574e76b0c8132c558f2084 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:30:54.829940 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b183a3f1-e30b-40f2-bbbe-316bc7c014a0 service neutron] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:54.839606 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b183a3f1-e30b-40f2-bbbe-316bc7c014a0 service neutron] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:54.895261 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2e3a7b-9d8c-416c-a1b5-9ee1369a6368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:54.895879 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e3a7b-9d8c-416c-a1b5-9ee1369a6368 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:54.896161 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e3a7b-9d8c-416c-a1b5-9ee1369a6368 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:54.896437 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e3a7b-9d8c-416c-a1b5-9ee1369a6368 admin admin] PATH_INFO: `/v3/users/0c1511cdf99d499cbcf3310a937f286d` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:54.897547 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2e3a7b-9d8c-416c-a1b5-9ee1369a6368 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c1511cdf99d499cbcf3310a937f286d)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:54.899493 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2e3a7b-9d8c-416c-a1b5-9ee1369a6368 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:54.953754 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-5d2e3a7b-9d8c-416c-a1b5-9ee1369a6368 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c1511cdf99d499cbcf3310a937f286d'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:54.961961 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-5d2e3a7b-9d8c-416c-a1b5-9ee1369a6368 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c1511cdf99d499cbcf3310a937f286d'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:54.962863 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-5d2e3a7b-9d8c-416c-a1b5-9ee1369a6368 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c1511cdf99d499cbcf3310a937f286d'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:54.967193 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-5d2e3a7b-9d8c-416c-a1b5-9ee1369a6368 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c1511cdf99d499cbcf3310a937f286d'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:54.976273 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-5d2e3a7b-9d8c-416c-a1b5-9ee1369a6368 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c1511cdf99d499cbcf3310a937f286d'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:54.981512 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:INSERT=2,keystone:DELETE=12,keystone:SELECT=86 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:30:54.995712 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1185/2370] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:30:54 2022] DELETE /identity/v3/users/0c1511cdf99d499cbcf3310a937f286d => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:30:55.282429 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dd0547-f288-4cb0-ace3-c9a800998c47 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:55.284210 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-48dd0547-f288-4cb0-ace3-c9a800998c47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:30:55.307408 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dd0547-f288-4cb0-ace3-c9a800998c47 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:55.357803 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:30:55.372722 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f56c741-a84a-4105-a895-d84d30e7e902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:55.373435 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f56c741-a84a-4105-a895-d84d30e7e902 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:55.373775 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f56c741-a84a-4105-a895-d84d30e7e902 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:55.374144 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f56c741-a84a-4105-a895-d84d30e7e902 admin admin] PATH_INFO: `/v3/projects/ffcc536c073248b9800e95cf82aa7b64` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:55.375586 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f56c741-a84a-4105-a895-d84d30e7e902 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffcc536c073248b9800e95cf82aa7b64)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:55.377730 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f56c741-a84a-4105-a895-d84d30e7e902 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:55.427458 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-2f56c741-a84a-4105-a895-d84d30e7e902 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffcc536c073248b9800e95cf82aa7b64', 'request_id': 'req-2f56c741-a84a-4105-a895-d84d30e7e902'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:55.432888 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-2f56c741-a84a-4105-a895-d84d30e7e902 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffcc536c073248b9800e95cf82aa7b64', 'request_id': 'req-2f56c741-a84a-4105-a895-d84d30e7e902'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:55.440173 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-2f56c741-a84a-4105-a895-d84d30e7e902 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffcc536c073248b9800e95cf82aa7b64', 'request_id': 'req-2f56c741-a84a-4105-a895-d84d30e7e902'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:55.451829 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-2f56c741-a84a-4105-a895-d84d30e7e902 admin admin] The token cache is being invalidate because project ffcc536c073248b9800e95cf82aa7b64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:30:55.452118 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-2f56c741-a84a-4105-a895-d84d30e7e902 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:55.452824 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-2f56c741-a84a-4105-a895-d84d30e7e902 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:55.454353 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1186/2371] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:30:55 2022] DELETE /identity/v3/projects/ffcc536c073248b9800e95cf82aa7b64 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:30:55.459088 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1834b13b-dffe-4407-869a-991d78316ec9 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:55.459378 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1834b13b-dffe-4407-869a-991d78316ec9 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:55.459658 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1834b13b-dffe-4407-869a-991d78316ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:55.479269 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-1834b13b-dffe-4407-869a-991d78316ec9 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:30:55.480454 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-1834b13b-dffe-4407-869a-991d78316ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:30:55.541445 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1186/2372] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:30:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:30:55.551157 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd2d4e8-4e11-462a-b3f3-87070a90969d None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:55.551449 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd2d4e8-4e11-462a-b3f3-87070a90969d None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:55.551726 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd2d4e8-4e11-462a-b3f3-87070a90969d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:55.571116 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-dbd2d4e8-4e11-462a-b3f3-87070a90969d None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:30:55.572322 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-dbd2d4e8-4e11-462a-b3f3-87070a90969d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:30:55.580144 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1187/2373] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:30:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:30:55.584311 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1834b13b-dffe-4407-869a-991d78316ec9 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:55.594244 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1834b13b-dffe-4407-869a-991d78316ec9 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:55.598853 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3efa323-5e71-4e4d-bfcc-d421a07505bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:55.599443 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3efa323-5e71-4e4d-bfcc-d421a07505bf admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:55.599772 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3efa323-5e71-4e4d-bfcc-d421a07505bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:55.599989 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3efa323-5e71-4e4d-bfcc-d421a07505bf admin admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:55.600626 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3efa323-5e71-4e4d-bfcc-d421a07505bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:30:55.600928 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3efa323-5e71-4e4d-bfcc-d421a07505bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:55.602500 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3efa323-5e71-4e4d-bfcc-d421a07505bf admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:55.614439 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1187/2374] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 15 12:30:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:30:55.618647 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd2d4e8-4e11-462a-b3f3-87070a90969d None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:55.628296 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd2d4e8-4e11-462a-b3f3-87070a90969d None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:55.632908 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b613a4e-82a5-4de7-888a-9f73e188b236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:55.633498 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b613a4e-82a5-4de7-888a-9f73e188b236 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:55.633779 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b613a4e-82a5-4de7-888a-9f73e188b236 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:55.634078 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b613a4e-82a5-4de7-888a-9f73e188b236 admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:55.634735 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b613a4e-82a5-4de7-888a-9f73e188b236 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:55.636632 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b613a4e-82a5-4de7-888a-9f73e188b236 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:55.664005 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1188/2375] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:30:55 2022] POST /identity/v3/projects => generated 359 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:30:55.668272 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3efa323-5e71-4e4d-bfcc-d421a07505bf admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:55.678189 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3efa323-5e71-4e4d-bfcc-d421a07505bf admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:55.733778 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5f3678-3542-472d-b11d-278650b93353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:55.734373 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5f3678-3542-472d-b11d-278650b93353 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:55.734646 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5f3678-3542-472d-b11d-278650b93353 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:55.734941 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5f3678-3542-472d-b11d-278650b93353 admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:55.735556 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5f3678-3542-472d-b11d-278650b93353 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:55.737460 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5f3678-3542-472d-b11d-278650b93353 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:55.758199 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1188/2376] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:30:55 2022] POST /identity/v3/users => generated 280 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:30:55.762468 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b613a4e-82a5-4de7-888a-9f73e188b236 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:55.772560 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b613a4e-82a5-4de7-888a-9f73e188b236 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:55.777170 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a3f6ad-4b78-4a96-a29b-fe88baaec949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:55.777757 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a3f6ad-4b78-4a96-a29b-fe88baaec949 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:55.778032 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a3f6ad-4b78-4a96-a29b-fe88baaec949 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:55.778301 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a3f6ad-4b78-4a96-a29b-fe88baaec949 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:55.778965 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a3f6ad-4b78-4a96-a29b-fe88baaec949 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:55.780556 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a3f6ad-4b78-4a96-a29b-fe88baaec949 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:55.790588 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1189/2377] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:30:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:30:55.794267 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5f3678-3542-472d-b11d-278650b93353 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:55.804585 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5f3678-3542-472d-b11d-278650b93353 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:55.809376 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70991e9a-0538-4811-9805-c00fb9ec7ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:55.809959 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70991e9a-0538-4811-9805-c00fb9ec7ff4 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:55.810902 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70991e9a-0538-4811-9805-c00fb9ec7ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:55.811175 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70991e9a-0538-4811-9805-c00fb9ec7ff4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:55.811808 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70991e9a-0538-4811-9805-c00fb9ec7ff4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:55.813442 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70991e9a-0538-4811-9805-c00fb9ec7ff4 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:55.824939 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1189/2378] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:30:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 12:30:55.829044 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a3f6ad-4b78-4a96-a29b-fe88baaec949 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:55.839023 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a3f6ad-4b78-4a96-a29b-fe88baaec949 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:55.843604 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f108dac-2ba1-461d-995b-232d030835e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:55.844246 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f108dac-2ba1-461d-995b-232d030835e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:55.844527 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f108dac-2ba1-461d-995b-232d030835e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:55.844829 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f108dac-2ba1-461d-995b-232d030835e3 admin admin] PATH_INFO: `/v3/projects/9d28193b6d8d4476831f855b1d27b465/users/33b9d80ac0b1453e9f0f7378a6ad6907/roles/9371e5bbc55848949eb951a815f817f2` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:55.860147 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f108dac-2ba1-461d-995b-232d030835e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d28193b6d8d4476831f855b1d27b465, user_id=33b9d80ac0b1453e9f0f7378a6ad6907, role_id=9371e5bbc55848949eb951a815f817f2)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:55.862842 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f108dac-2ba1-461d-995b-232d030835e3 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:55.877385 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1190/2379] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:30:55 2022] PUT /identity/v3/projects/9d28193b6d8d4476831f855b1d27b465/users/33b9d80ac0b1453e9f0f7378a6ad6907/roles/9371e5bbc55848949eb951a815f817f2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:30:55.887666 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261006e7-d74f-410d-aa48-ef4f1e3e8816 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:55.887948 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261006e7-d74f-410d-aa48-ef4f1e3e8816 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:55.888224 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261006e7-d74f-410d-aa48-ef4f1e3e8816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:55.915728 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-261006e7-d74f-410d-aa48-ef4f1e3e8816 None None] MFA Rules not processed for user `33b9d80ac0b1453e9f0f7378a6ad6907`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:30:55.916951 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-261006e7-d74f-410d-aa48-ef4f1e3e8816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:30:55.959273 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:30:55.988441 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1190/2380] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:30:55 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:30:56.024063 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f108dac-2ba1-461d-995b-232d030835e3 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:56.025747 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-7f108dac-2ba1-461d-995b-232d030835e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:30:56.082785 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f108dac-2ba1-461d-995b-232d030835e3 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:56.086361 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5607e63-d568-4f76-a34a-96edb7329f50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceafc5e4283841528053f01931f10293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:56.086981 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5607e63-d568-4f76-a34a-96edb7329f50 service cinder] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:56.087259 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5607e63-d568-4f76-a34a-96edb7329f50 service cinder] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:56.087527 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5607e63-d568-4f76-a34a-96edb7329f50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:56.096025 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5607e63-d568-4f76-a34a-96edb7329f50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:56.097435 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5607e63-d568-4f76-a34a-96edb7329f50 service cinder] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:56.105990 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1191/2381] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:30:56 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:30:56.121811 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261006e7-d74f-410d-aa48-ef4f1e3e8816 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:56.183045 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261006e7-d74f-410d-aa48-ef4f1e3e8816 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:56.187523 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b61fbe-c512-4280-80af-8b8800f411dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:56.188134 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b61fbe-c512-4280-80af-8b8800f411dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:56.188407 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b61fbe-c512-4280-80af-8b8800f411dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:56.188674 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b61fbe-c512-4280-80af-8b8800f411dd admin admin] PATH_INFO: `/v3/users/33b9d80ac0b1453e9f0f7378a6ad6907` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:56.189765 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b61fbe-c512-4280-80af-8b8800f411dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=33b9d80ac0b1453e9f0f7378a6ad6907)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:56.191710 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b61fbe-c512-4280-80af-8b8800f411dd admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:56.237044 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-e8b61fbe-c512-4280-80af-8b8800f411dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33b9d80ac0b1453e9f0f7378a6ad6907'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:56.244270 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-e8b61fbe-c512-4280-80af-8b8800f411dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33b9d80ac0b1453e9f0f7378a6ad6907'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:56.245092 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-e8b61fbe-c512-4280-80af-8b8800f411dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33b9d80ac0b1453e9f0f7378a6ad6907'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:56.245709 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-e8b61fbe-c512-4280-80af-8b8800f411dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33b9d80ac0b1453e9f0f7378a6ad6907'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:56.252756 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-e8b61fbe-c512-4280-80af-8b8800f411dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33b9d80ac0b1453e9f0f7378a6ad6907'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:56.270485 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1191/2382] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:30:56 2022] DELETE /identity/v3/users/33b9d80ac0b1453e9f0f7378a6ad6907 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:30:56.274979 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895fbf83-d5b4-476a-8721-61771c36a6b9 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:56.275265 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895fbf83-d5b4-476a-8721-61771c36a6b9 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:56.275540 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895fbf83-d5b4-476a-8721-61771c36a6b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:56.295321 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-895fbf83-d5b4-476a-8721-61771c36a6b9 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:30:56.296509 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-895fbf83-d5b4-476a-8721-61771c36a6b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:30:56.307990 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:30:56.358105 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1192/2383] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:30:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:30:56.367628 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b61fbe-c512-4280-80af-8b8800f411dd admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:56.369106 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-e8b61fbe-c512-4280-80af-8b8800f411dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:30:56.426998 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b61fbe-c512-4280-80af-8b8800f411dd admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:56.430496 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc94a2db-15af-46c6-ae0f-472e7966fbc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:56.431127 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc94a2db-15af-46c6-ae0f-472e7966fbc4 service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:56.431401 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc94a2db-15af-46c6-ae0f-472e7966fbc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:56.431667 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc94a2db-15af-46c6-ae0f-472e7966fbc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:56.440424 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc94a2db-15af-46c6-ae0f-472e7966fbc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:56.441828 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc94a2db-15af-46c6-ae0f-472e7966fbc4 service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:56.451750 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1192/2384] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:30:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:30:56.720050 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895fbf83-d5b4-476a-8721-61771c36a6b9 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:56.721701 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-895fbf83-d5b4-476a-8721-61771c36a6b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:30:56.733443 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895fbf83-d5b4-476a-8721-61771c36a6b9 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:56.738079 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9852beec-d93d-4a27-be10-cbaed0420b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:56.738839 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9852beec-d93d-4a27-be10-cbaed0420b95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:56.739121 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9852beec-d93d-4a27-be10-cbaed0420b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:56.739393 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9852beec-d93d-4a27-be10-cbaed0420b95 admin admin] PATH_INFO: `/v3/projects/9d28193b6d8d4476831f855b1d27b465` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:56.740727 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9852beec-d93d-4a27-be10-cbaed0420b95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d28193b6d8d4476831f855b1d27b465)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:56.742981 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9852beec-d93d-4a27-be10-cbaed0420b95 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:56.793382 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-9852beec-d93d-4a27-be10-cbaed0420b95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d28193b6d8d4476831f855b1d27b465', 'request_id': 'req-9852beec-d93d-4a27-be10-cbaed0420b95'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:56.798958 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-9852beec-d93d-4a27-be10-cbaed0420b95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d28193b6d8d4476831f855b1d27b465', 'request_id': 'req-9852beec-d93d-4a27-be10-cbaed0420b95'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:56.806119 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-9852beec-d93d-4a27-be10-cbaed0420b95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d28193b6d8d4476831f855b1d27b465', 'request_id': 'req-9852beec-d93d-4a27-be10-cbaed0420b95'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:56.817642 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-9852beec-d93d-4a27-be10-cbaed0420b95 admin admin] The token cache is being invalidate because project 9d28193b6d8d4476831f855b1d27b465 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:30:56.817936 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-9852beec-d93d-4a27-be10-cbaed0420b95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:56.818565 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-9852beec-d93d-4a27-be10-cbaed0420b95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:30:56.820071 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1193/2385] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:30:56 2022] DELETE /identity/v3/projects/9d28193b6d8d4476831f855b1d27b465 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:30:56.824935 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc194380-73f8-4443-8ce0-e136373129c2 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:56.825218 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc194380-73f8-4443-8ce0-e136373129c2 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:56.825491 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc194380-73f8-4443-8ce0-e136373129c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:56.834605 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:30:56.846185 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-dc194380-73f8-4443-8ce0-e136373129c2 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:30:56.847774 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-dc194380-73f8-4443-8ce0-e136373129c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:30:56.906784 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1193/2386] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:30:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:30:56.914429 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa257128-cb20-4ac1-8dec-f30598634b13 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:56.914819 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa257128-cb20-4ac1-8dec-f30598634b13 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:56.915028 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa257128-cb20-4ac1-8dec-f30598634b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:56.935992 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-fa257128-cb20-4ac1-8dec-f30598634b13 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:30:56.937282 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-fa257128-cb20-4ac1-8dec-f30598634b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:30:56.945292 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1194/2387] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:30:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:30:56.949576 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc194380-73f8-4443-8ce0-e136373129c2 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:56.959253 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc194380-73f8-4443-8ce0-e136373129c2 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:56.963726 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0769e33-2e68-4e8d-8913-34225daf77e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:56.964318 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0769e33-2e68-4e8d-8913-34225daf77e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:56.964601 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0769e33-2e68-4e8d-8913-34225daf77e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:56.964874 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0769e33-2e68-4e8d-8913-34225daf77e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:56.965520 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0769e33-2e68-4e8d-8913-34225daf77e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:30:56.965824 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0769e33-2e68-4e8d-8913-34225daf77e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:56.968005 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0769e33-2e68-4e8d-8913-34225daf77e5 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:56.979973 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1194/2388] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 15 12:30:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:30:56.984795 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa257128-cb20-4ac1-8dec-f30598634b13 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:56.994067 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa257128-cb20-4ac1-8dec-f30598634b13 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:56.998718 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e26abe-12f2-4997-9fe4-b2bacfbba8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:56.999321 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e26abe-12f2-4997-9fe4-b2bacfbba8ca admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:56.999600 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e26abe-12f2-4997-9fe4-b2bacfbba8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:56.999873 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e26abe-12f2-4997-9fe4-b2bacfbba8ca admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:57.000508 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e26abe-12f2-4997-9fe4-b2bacfbba8ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:57.002663 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e26abe-12f2-4997-9fe4-b2bacfbba8ca admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:57.029545 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1195/2389] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:30:56 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:30:57.033663 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0769e33-2e68-4e8d-8913-34225daf77e5 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:57.043482 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0769e33-2e68-4e8d-8913-34225daf77e5 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:57.098197 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2a8f30-6106-4bf2-b243-6c8d524982be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:57.098822 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2a8f30-6106-4bf2-b243-6c8d524982be admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:57.099101 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2a8f30-6106-4bf2-b243-6c8d524982be admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:57.099371 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2a8f30-6106-4bf2-b243-6c8d524982be admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:57.099993 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2a8f30-6106-4bf2-b243-6c8d524982be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:57.101882 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2a8f30-6106-4bf2-b243-6c8d524982be admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:57.122835 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1195/2390] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:30:57 2022] POST /identity/v3/users => generated 288 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:30:57.127117 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e26abe-12f2-4997-9fe4-b2bacfbba8ca admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:57.137661 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e26abe-12f2-4997-9fe4-b2bacfbba8ca admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:57.142934 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97ac9e4-4643-4bdf-805c-899270ba5622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:57.143611 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ac9e4-4643-4bdf-805c-899270ba5622 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:57.143898 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ac9e4-4643-4bdf-805c-899270ba5622 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:57.144168 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ac9e4-4643-4bdf-805c-899270ba5622 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:57.144809 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97ac9e4-4643-4bdf-805c-899270ba5622 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:57.146393 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97ac9e4-4643-4bdf-805c-899270ba5622 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:57.157837 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1196/2391] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:30:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:30:57.161443 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2a8f30-6106-4bf2-b243-6c8d524982be admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:57.171442 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2a8f30-6106-4bf2-b243-6c8d524982be admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:57.176108 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bc7c40-a2d7-40c8-8b51-f0224ae8371c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:57.176699 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc7c40-a2d7-40c8-8b51-f0224ae8371c admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:57.176982 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc7c40-a2d7-40c8-8b51-f0224ae8371c admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:57.177259 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc7c40-a2d7-40c8-8b51-f0224ae8371c admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:57.177896 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bc7c40-a2d7-40c8-8b51-f0224ae8371c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:57.179516 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bc7c40-a2d7-40c8-8b51-f0224ae8371c admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:57.189971 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1196/2392] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:30:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:30:57.194068 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97ac9e4-4643-4bdf-805c-899270ba5622 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:57.207374 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97ac9e4-4643-4bdf-805c-899270ba5622 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:57.212084 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee6a495-b7b5-4aae-8b1a-ed0d46f6bafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:57.212739 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee6a495-b7b5-4aae-8b1a-ed0d46f6bafb admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:57.213016 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee6a495-b7b5-4aae-8b1a-ed0d46f6bafb admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:57.213288 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee6a495-b7b5-4aae-8b1a-ed0d46f6bafb admin admin] PATH_INFO: `/v3/projects/53205b541c0b4a08be8ce5d4bbed02d6/users/7f410a1a41fa444386761af83e64335d/roles/9371e5bbc55848949eb951a815f817f2` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:57.229416 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee6a495-b7b5-4aae-8b1a-ed0d46f6bafb admin admin] RBAC: Authorizing `identity:create_grant(project_id=53205b541c0b4a08be8ce5d4bbed02d6, user_id=7f410a1a41fa444386761af83e64335d, role_id=9371e5bbc55848949eb951a815f817f2)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:57.232133 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee6a495-b7b5-4aae-8b1a-ed0d46f6bafb admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:57.246420 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1197/2393] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:30:57 2022] PUT /identity/v3/projects/53205b541c0b4a08be8ce5d4bbed02d6/users/7f410a1a41fa444386761af83e64335d/roles/9371e5bbc55848949eb951a815f817f2 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:30:57.314730 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d735bf2c-ff00-48c4-98cf-36dca1f13b35 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:57.315022 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d735bf2c-ff00-48c4-98cf-36dca1f13b35 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:57.315295 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d735bf2c-ff00-48c4-98cf-36dca1f13b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:57.344064 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-d735bf2c-ff00-48c4-98cf-36dca1f13b35 None None] MFA Rules not processed for user `7f410a1a41fa444386761af83e64335d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:30:57.345269 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-d735bf2c-ff00-48c4-98cf-36dca1f13b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:30:57.417347 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:30:57.422040 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1197/2394] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:30:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:30:57.426490 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee6a495-b7b5-4aae-8b1a-ed0d46f6bafb admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:57.471241 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:30:57.496509 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee6a495-b7b5-4aae-8b1a-ed0d46f6bafb admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:57.505591 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e9420e-7a83-4832-b95a-874a72b8a2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:57.506208 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e9420e-7a83-4832-b95a-874a72b8a2d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:57.506485 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e9420e-7a83-4832-b95a-874a72b8a2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:57.506792 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e9420e-7a83-4832-b95a-874a72b8a2d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:57.507441 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e9420e-7a83-4832-b95a-874a72b8a2d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:57.509355 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e9420e-7a83-4832-b95a-874a72b8a2d3 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:57.543320 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1198/2395] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:30:57 2022] POST /identity/v3/projects => generated 375 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:30:57.545077 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d735bf2c-ff00-48c4-98cf-36dca1f13b35 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:57.556153 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d735bf2c-ff00-48c4-98cf-36dca1f13b35 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:57.618511 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed0dd91-5ddc-4ebd-8e37-67e392207796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:57.619151 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed0dd91-5ddc-4ebd-8e37-67e392207796 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:57.619424 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed0dd91-5ddc-4ebd-8e37-67e392207796 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:57.619691 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed0dd91-5ddc-4ebd-8e37-67e392207796 admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:57.620319 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed0dd91-5ddc-4ebd-8e37-67e392207796 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:57.622235 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed0dd91-5ddc-4ebd-8e37-67e392207796 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:57.645989 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1198/2396] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:30:57 2022] POST /identity/v3/users => generated 294 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:30:57.650008 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e9420e-7a83-4832-b95a-874a72b8a2d3 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:57.660637 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e9420e-7a83-4832-b95a-874a72b8a2d3 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:57.665452 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7702a16a-c883-4e42-835e-56aa881bcb02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:57.666061 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7702a16a-c883-4e42-835e-56aa881bcb02 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:57.666334 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7702a16a-c883-4e42-835e-56aa881bcb02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:57.666601 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7702a16a-c883-4e42-835e-56aa881bcb02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:57.667265 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7702a16a-c883-4e42-835e-56aa881bcb02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:57.669082 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7702a16a-c883-4e42-835e-56aa881bcb02 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:57.680034 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1199/2397] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:30:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 12:30:57.684269 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed0dd91-5ddc-4ebd-8e37-67e392207796 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:57.695318 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed0dd91-5ddc-4ebd-8e37-67e392207796 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:57.699987 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6a9e58-390c-48f0-b29a-3483b411a0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:57.700648 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a9e58-390c-48f0-b29a-3483b411a0fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:57.701529 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a9e58-390c-48f0-b29a-3483b411a0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:57.701802 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a9e58-390c-48f0-b29a-3483b411a0fa admin admin] PATH_INFO: `/v3/projects/5c193e087035469bbd1ab0e79683957f/users/56c45d92454240029c4603468379c4ee/roles/7f53f1c823b746529ba5057bf21b2477` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:57.717461 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6a9e58-390c-48f0-b29a-3483b411a0fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c193e087035469bbd1ab0e79683957f, user_id=56c45d92454240029c4603468379c4ee, role_id=7f53f1c823b746529ba5057bf21b2477)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:57.720141 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6a9e58-390c-48f0-b29a-3483b411a0fa admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:57.734804 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1199/2398] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:30:57 2022] PUT /identity/v3/projects/5c193e087035469bbd1ab0e79683957f/users/56c45d92454240029c4603468379c4ee/roles/7f53f1c823b746529ba5057bf21b2477 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:30:57.740007 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7702a16a-c883-4e42-835e-56aa881bcb02 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:57.753453 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7702a16a-c883-4e42-835e-56aa881bcb02 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:57.807224 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3099371b-0d6e-446b-9fa2-b5bd23437cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:57.807836 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3099371b-0d6e-446b-9fa2-b5bd23437cbf admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:57.808084 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3099371b-0d6e-446b-9fa2-b5bd23437cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:57.808352 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3099371b-0d6e-446b-9fa2-b5bd23437cbf admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:57.808978 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3099371b-0d6e-446b-9fa2-b5bd23437cbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:57.811147 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3099371b-0d6e-446b-9fa2-b5bd23437cbf admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:57.820564 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1200/2399] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:30:57 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:30:57.824681 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6a9e58-390c-48f0-b29a-3483b411a0fa admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:57.835463 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6a9e58-390c-48f0-b29a-3483b411a0fa admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:57.840002 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054fe7fd-811c-49bb-af04-cb168bcc451b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:57.840638 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054fe7fd-811c-49bb-af04-cb168bcc451b admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:57.840917 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054fe7fd-811c-49bb-af04-cb168bcc451b admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:57.841186 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054fe7fd-811c-49bb-af04-cb168bcc451b admin admin] PATH_INFO: `/v3/projects/5c193e087035469bbd1ab0e79683957f/users/56c45d92454240029c4603468379c4ee/roles/7f53f1c823b746529ba5057bf21b2477` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:57.843104 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054fe7fd-811c-49bb-af04-cb168bcc451b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c193e087035469bbd1ab0e79683957f, user_id=56c45d92454240029c4603468379c4ee, role_id=7f53f1c823b746529ba5057bf21b2477)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:57.845705 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054fe7fd-811c-49bb-af04-cb168bcc451b admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:57.855621 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1200/2400] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:30:57 2022] PUT /identity/v3/projects/5c193e087035469bbd1ab0e79683957f/users/56c45d92454240029c4603468379c4ee/roles/7f53f1c823b746529ba5057bf21b2477 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:30:57.866230 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ff496-b375-4fed-983c-6661bc80501d None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:57.866513 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ff496-b375-4fed-983c-6661bc80501d None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:57.866821 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ff496-b375-4fed-983c-6661bc80501d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:57.894317 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-7b3ff496-b375-4fed-983c-6661bc80501d None None] MFA Rules not processed for user `56c45d92454240029c4603468379c4ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:30:57.895548 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-7b3ff496-b375-4fed-983c-6661bc80501d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:30:57.960383 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1201/2401] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:30:57 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:30:57.971547 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054fe7fd-811c-49bb-af04-cb168bcc451b admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:30:57.972803 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-054fe7fd-811c-49bb-af04-cb168bcc451b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:30:58.029594 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054fe7fd-811c-49bb-af04-cb168bcc451b admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:30:58.033179 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361a6ee2-b506-4ffa-9318-a4f5f2169d29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceafc5e4283841528053f01931f10293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:30:58.033765 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a6ee2-b506-4ffa-9318-a4f5f2169d29 service cinder] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:30:58.034039 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a6ee2-b506-4ffa-9318-a4f5f2169d29 service cinder] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:30:58.034310 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a6ee2-b506-4ffa-9318-a4f5f2169d29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:30:58.089890 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361a6ee2-b506-4ffa-9318-a4f5f2169d29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:30:58.091353 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361a6ee2-b506-4ffa-9318-a4f5f2169d29 service cinder] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:30:58.099997 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1201/2402] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:30:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 12:31:00.631572 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3ff496-b375-4fed-983c-6661bc80501d None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:31:00.665727 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:31:00.694553 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3ff496-b375-4fed-983c-6661bc80501d None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:31:00.699197 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe70ee73-852e-4ba4-99c3-829c5e93e699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:31:00.699847 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70ee73-852e-4ba4-99c3-829c5e93e699 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:31:00.700123 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70ee73-852e-4ba4-99c3-829c5e93e699 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:31:00.700394 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70ee73-852e-4ba4-99c3-829c5e93e699 admin admin] PATH_INFO: `/v3/users/7f410a1a41fa444386761af83e64335d` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:31:00.701529 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe70ee73-852e-4ba4-99c3-829c5e93e699 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f410a1a41fa444386761af83e64335d)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:31:00.703539 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe70ee73-852e-4ba4-99c3-829c5e93e699 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:31:00.752201 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-fe70ee73-852e-4ba4-99c3-829c5e93e699 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f410a1a41fa444386761af83e64335d'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:31:00.759369 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-fe70ee73-852e-4ba4-99c3-829c5e93e699 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f410a1a41fa444386761af83e64335d'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:31:00.759974 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-fe70ee73-852e-4ba4-99c3-829c5e93e699 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f410a1a41fa444386761af83e64335d'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:31:00.760583 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-fe70ee73-852e-4ba4-99c3-829c5e93e699 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f410a1a41fa444386761af83e64335d'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:31:00.767500 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-fe70ee73-852e-4ba4-99c3-829c5e93e699 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f410a1a41fa444386761af83e64335d'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:31:00.784739 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1202/2403] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:31:00 2022] DELETE /identity/v3/users/7f410a1a41fa444386761af83e64335d => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:31:00.789156 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b88f0e4-ef04-4506-a589-d398a7d8815a None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:31:00.789629 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b88f0e4-ef04-4506-a589-d398a7d8815a None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:31:00.789748 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b88f0e4-ef04-4506-a589-d398a7d8815a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:31:00.803267 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:31:00.809674 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-7b88f0e4-ef04-4506-a589-d398a7d8815a None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:31:00.811647 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-7b88f0e4-ef04-4506-a589-d398a7d8815a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:31:00.869259 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1202/2404] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:31:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:31:00.879113 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe70ee73-852e-4ba4-99c3-829c5e93e699 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:31:00.880540 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-fe70ee73-852e-4ba4-99c3-829c5e93e699 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:31:00.936280 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe70ee73-852e-4ba4-99c3-829c5e93e699 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:31:00.939894 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dee81b-b802-4452-b198-e0b6ef251b4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:31:00.940493 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dee81b-b802-4452-b198-e0b6ef251b4f service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:31:00.940770 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dee81b-b802-4452-b198-e0b6ef251b4f service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:31:00.941062 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dee81b-b802-4452-b198-e0b6ef251b4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:31:00.949804 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dee81b-b802-4452-b198-e0b6ef251b4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:31:00.951258 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dee81b-b802-4452-b198-e0b6ef251b4f service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:31:00.960952 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1203/2405] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:31:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:31:01.236334 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b88f0e4-ef04-4506-a589-d398a7d8815a None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:31:01.238829 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-7b88f0e4-ef04-4506-a589-d398a7d8815a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:31:01.265591 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b88f0e4-ef04-4506-a589-d398a7d8815a None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:31:01.273771 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a38778-0c37-40e9-9a51-463bc8c53ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:31:01.274410 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a38778-0c37-40e9-9a51-463bc8c53ff3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:31:01.274722 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a38778-0c37-40e9-9a51-463bc8c53ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:31:01.275001 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a38778-0c37-40e9-9a51-463bc8c53ff3 admin admin] PATH_INFO: `/v3/projects/53205b541c0b4a08be8ce5d4bbed02d6` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:31:01.276144 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a38778-0c37-40e9-9a51-463bc8c53ff3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53205b541c0b4a08be8ce5d4bbed02d6)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:31:01.278022 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a38778-0c37-40e9-9a51-463bc8c53ff3 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:31:01.325647 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-66a38778-0c37-40e9-9a51-463bc8c53ff3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53205b541c0b4a08be8ce5d4bbed02d6', 'request_id': 'req-66a38778-0c37-40e9-9a51-463bc8c53ff3'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:31:01.332002 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-66a38778-0c37-40e9-9a51-463bc8c53ff3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53205b541c0b4a08be8ce5d4bbed02d6', 'request_id': 'req-66a38778-0c37-40e9-9a51-463bc8c53ff3'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:31:01.337893 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-66a38778-0c37-40e9-9a51-463bc8c53ff3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53205b541c0b4a08be8ce5d4bbed02d6', 'request_id': 'req-66a38778-0c37-40e9-9a51-463bc8c53ff3'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:31:01.351702 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-66a38778-0c37-40e9-9a51-463bc8c53ff3 admin admin] The token cache is being invalidate because project 53205b541c0b4a08be8ce5d4bbed02d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:31:01.351996 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-66a38778-0c37-40e9-9a51-463bc8c53ff3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:31:01.352641 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-66a38778-0c37-40e9-9a51-463bc8c53ff3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:31:01.354211 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1203/2406] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:31:01 2022] DELETE /identity/v3/projects/53205b541c0b4a08be8ce5d4bbed02d6 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:31:01.358923 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dee81b-b802-4452-b198-e0b6ef251b4f service neutron] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:31:01.368950 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dee81b-b802-4452-b198-e0b6ef251b4f service neutron] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:31:01.420873 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:31:01.429539 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71518eb2-0467-4348-a9f3-821b8a1788ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:31:01.430539 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71518eb2-0467-4348-a9f3-821b8a1788ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:31:01.431176 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71518eb2-0467-4348-a9f3-821b8a1788ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:31:01.431772 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71518eb2-0467-4348-a9f3-821b8a1788ce admin admin] PATH_INFO: `/v3/users/56c45d92454240029c4603468379c4ee` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:31:01.433181 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71518eb2-0467-4348-a9f3-821b8a1788ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=56c45d92454240029c4603468379c4ee)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:31:01.435783 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71518eb2-0467-4348-a9f3-821b8a1788ce admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:31:01.483470 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-71518eb2-0467-4348-a9f3-821b8a1788ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56c45d92454240029c4603468379c4ee'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:31:01.491806 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-71518eb2-0467-4348-a9f3-821b8a1788ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56c45d92454240029c4603468379c4ee'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:31:01.492615 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-71518eb2-0467-4348-a9f3-821b8a1788ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56c45d92454240029c4603468379c4ee'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:31:01.493235 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-71518eb2-0467-4348-a9f3-821b8a1788ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56c45d92454240029c4603468379c4ee'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:31:01.500380 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-71518eb2-0467-4348-a9f3-821b8a1788ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56c45d92454240029c4603468379c4ee'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:31:01.521392 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1204/2407] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:31:01 2022] DELETE /identity/v3/users/56c45d92454240029c4603468379c4ee => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:31:02.047876 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a38778-0c37-40e9-9a51-463bc8c53ff3 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:31:02.049701 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-66a38778-0c37-40e9-9a51-463bc8c53ff3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:31:02.071677 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a38778-0c37-40e9-9a51-463bc8c53ff3 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:31:02.137218 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806749c7-6072-4504-854f-1900e503752c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:31:02.137845 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806749c7-6072-4504-854f-1900e503752c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:31:02.138122 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806749c7-6072-4504-854f-1900e503752c admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:31:02.138392 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806749c7-6072-4504-854f-1900e503752c admin admin] PATH_INFO: `/v3/projects/5c193e087035469bbd1ab0e79683957f` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:31:02.140177 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806749c7-6072-4504-854f-1900e503752c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c193e087035469bbd1ab0e79683957f)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:31:02.142069 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806749c7-6072-4504-854f-1900e503752c admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:31:02.179168 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:31:02.193937 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-806749c7-6072-4504-854f-1900e503752c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c193e087035469bbd1ab0e79683957f', 'request_id': 'req-806749c7-6072-4504-854f-1900e503752c'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:31:02.200537 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-806749c7-6072-4504-854f-1900e503752c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c193e087035469bbd1ab0e79683957f', 'request_id': 'req-806749c7-6072-4504-854f-1900e503752c'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:31:02.207034 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-806749c7-6072-4504-854f-1900e503752c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c193e087035469bbd1ab0e79683957f', 'request_id': 'req-806749c7-6072-4504-854f-1900e503752c'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:31:02.220523 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-806749c7-6072-4504-854f-1900e503752c admin admin] The token cache is being invalidate because project 5c193e087035469bbd1ab0e79683957f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:31:02.221009 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-806749c7-6072-4504-854f-1900e503752c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:31:02.221631 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-806749c7-6072-4504-854f-1900e503752c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:31:02.224171 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1204/2408] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:31:02 2022] DELETE /identity/v3/projects/5c193e087035469bbd1ab0e79683957f => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:31:02.228088 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f3f677-9392-409a-a97c-5c76de8c8329 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:31:02.228541 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f3f677-9392-409a-a97c-5c76de8c8329 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:31:02.228634 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f3f677-9392-409a-a97c-5c76de8c8329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:31:02.249595 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-96f3f677-9392-409a-a97c-5c76de8c8329 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:31:02.250978 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-96f3f677-9392-409a-a97c-5c76de8c8329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:31:02.312499 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1205/2409] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:31:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:31:02.321281 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c443f6d4-7c44-4f96-bbe0-e9fbfc61c9a5 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:31:02.322028 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c443f6d4-7c44-4f96-bbe0-e9fbfc61c9a5 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:31:02.322462 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c443f6d4-7c44-4f96-bbe0-e9fbfc61c9a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:31:02.364107 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-c443f6d4-7c44-4f96-bbe0-e9fbfc61c9a5 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:31:02.366522 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-c443f6d4-7c44-4f96-bbe0-e9fbfc61c9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:31:02.381056 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1205/2410] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:31:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:31:02.385349 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f3f677-9392-409a-a97c-5c76de8c8329 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:31:02.396130 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f3f677-9392-409a-a97c-5c76de8c8329 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:31:02.401166 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ceb689-5c88-4c75-9fc1-e3b69ea0ca63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:31:02.401862 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ceb689-5c88-4c75-9fc1-e3b69ea0ca63 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:31:02.402195 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ceb689-5c88-4c75-9fc1-e3b69ea0ca63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:31:02.402537 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ceb689-5c88-4c75-9fc1-e3b69ea0ca63 admin admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:31:02.403788 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ceb689-5c88-4c75-9fc1-e3b69ea0ca63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:31:02.403788 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ceb689-5c88-4c75-9fc1-e3b69ea0ca63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:31:02.405544 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ceb689-5c88-4c75-9fc1-e3b69ea0ca63 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:31:02.418863 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1206/2411] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 15 12:31:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:31:02.423667 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c443f6d4-7c44-4f96-bbe0-e9fbfc61c9a5 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:31:02.432912 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c443f6d4-7c44-4f96-bbe0-e9fbfc61c9a5 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:31:02.439081 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2119b2-e8b4-414f-bee3-47c4d3adc410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:31:02.439681 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2119b2-e8b4-414f-bee3-47c4d3adc410 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:31:02.439960 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2119b2-e8b4-414f-bee3-47c4d3adc410 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:31:02.440228 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2119b2-e8b4-414f-bee3-47c4d3adc410 admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:31:02.440856 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2119b2-e8b4-414f-bee3-47c4d3adc410 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:31:02.442761 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2119b2-e8b4-414f-bee3-47c4d3adc410 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:31:02.471024 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1206/2412] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:31:02 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:31:02.475018 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ceb689-5c88-4c75-9fc1-e3b69ea0ca63 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:31:02.485435 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ceb689-5c88-4c75-9fc1-e3b69ea0ca63 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:31:02.555267 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f011561-c879-4af1-92e7-2081a6f9ecea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:31:02.556342 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f011561-c879-4af1-92e7-2081a6f9ecea admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:31:02.556753 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f011561-c879-4af1-92e7-2081a6f9ecea admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:31:02.557183 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f011561-c879-4af1-92e7-2081a6f9ecea admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:31:02.557926 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f011561-c879-4af1-92e7-2081a6f9ecea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:31:02.560288 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f011561-c879-4af1-92e7-2081a6f9ecea admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:31:02.571361 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:31:02.590415 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1207/2413] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:31:02 2022] POST /identity/v3/users => generated 288 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:31:02.593966 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2119b2-e8b4-414f-bee3-47c4d3adc410 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:31:02.606296 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2119b2-e8b4-414f-bee3-47c4d3adc410 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:31:02.612454 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8942d15-8444-487d-9e3f-8ed3d3df009e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:31:02.613498 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8942d15-8444-487d-9e3f-8ed3d3df009e admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:31:02.613498 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8942d15-8444-487d-9e3f-8ed3d3df009e admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:31:02.613740 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8942d15-8444-487d-9e3f-8ed3d3df009e admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:31:02.614213 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8942d15-8444-487d-9e3f-8ed3d3df009e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:31:02.615902 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8942d15-8444-487d-9e3f-8ed3d3df009e admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:31:02.628030 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1207/2414] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:31:02 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:31:02.632133 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f011561-c879-4af1-92e7-2081a6f9ecea admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:31:02.642446 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f011561-c879-4af1-92e7-2081a6f9ecea admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:31:02.647299 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3261132-e746-445a-9f5f-dc5a21c732d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:31:02.647911 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3261132-e746-445a-9f5f-dc5a21c732d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:31:02.648190 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3261132-e746-445a-9f5f-dc5a21c732d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:31:02.648464 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3261132-e746-445a-9f5f-dc5a21c732d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:31:02.649251 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3261132-e746-445a-9f5f-dc5a21c732d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:31:02.650908 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3261132-e746-445a-9f5f-dc5a21c732d1 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:31:02.664134 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1208/2415] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:31:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:31:02.669559 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8942d15-8444-487d-9e3f-8ed3d3df009e admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:31:02.690744 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8942d15-8444-487d-9e3f-8ed3d3df009e admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:31:02.696113 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d34b9b-0af8-4fb2-885e-b3c08489b73f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:31:02.697141 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d34b9b-0af8-4fb2-885e-b3c08489b73f admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:31:02.697811 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d34b9b-0af8-4fb2-885e-b3c08489b73f admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:31:02.698206 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d34b9b-0af8-4fb2-885e-b3c08489b73f admin admin] PATH_INFO: `/v3/projects/4d3bcabfe5a2431fa77c02459cd7ea05/users/19893a46bd0a4ae08d713488fe57d7e2/roles/9371e5bbc55848949eb951a815f817f2` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:31:02.717681 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d34b9b-0af8-4fb2-885e-b3c08489b73f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d3bcabfe5a2431fa77c02459cd7ea05, user_id=19893a46bd0a4ae08d713488fe57d7e2, role_id=9371e5bbc55848949eb951a815f817f2)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:31:02.720841 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d34b9b-0af8-4fb2-885e-b3c08489b73f admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:31:02.737557 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1208/2416] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:31:02 2022] PUT /identity/v3/projects/4d3bcabfe5a2431fa77c02459cd7ea05/users/19893a46bd0a4ae08d713488fe57d7e2/roles/9371e5bbc55848949eb951a815f817f2 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:31:02.750839 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a27cd4-b482-403d-b00a-398106d005c2 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:31:02.751004 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a27cd4-b482-403d-b00a-398106d005c2 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:31:02.751704 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a27cd4-b482-403d-b00a-398106d005c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:31:02.783227 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-82a27cd4-b482-403d-b00a-398106d005c2 None None] MFA Rules not processed for user `19893a46bd0a4ae08d713488fe57d7e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:31:02.784615 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-82a27cd4-b482-403d-b00a-398106d005c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:31:02.855893 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1209/2417] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:31:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:31:02.868726 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d34b9b-0af8-4fb2-885e-b3c08489b73f admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:31:02.870510 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-51d34b9b-0af8-4fb2-885e-b3c08489b73f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:31:02.933983 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d34b9b-0af8-4fb2-885e-b3c08489b73f admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:31:02.938572 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41989de-10c6-4541-af36-954e366c314c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceafc5e4283841528053f01931f10293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:31:02.939320 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41989de-10c6-4541-af36-954e366c314c service cinder] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:31:02.939669 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41989de-10c6-4541-af36-954e366c314c service cinder] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:31:02.940005 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41989de-10c6-4541-af36-954e366c314c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:31:02.950847 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41989de-10c6-4541-af36-954e366c314c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:31:02.952380 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41989de-10c6-4541-af36-954e366c314c service cinder] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:31:02.962726 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1209/2418] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:31:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:31:04.344375 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ac33ea-b7f6-4883-9b1d-607bd72ba843 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:31:04.344880 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ac33ea-b7f6-4883-9b1d-607bd72ba843 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:31:04.344976 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ac33ea-b7f6-4883-9b1d-607bd72ba843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:31:04.364718 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-49ac33ea-b7f6-4883-9b1d-607bd72ba843 None None] MFA Rules not processed for user `19893a46bd0a4ae08d713488fe57d7e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:31:04.365919 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-49ac33ea-b7f6-4883-9b1d-607bd72ba843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:31:04.372695 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1210/2419] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:31:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:31:12.957407 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=65,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:31:14.359954 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:INSERT=2,keystone:SELECT=42 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:31:22.224633 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca069d-0e63-4a72-a20d-a35ea414738c None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:31:22.225161 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca069d-0e63-4a72-a20d-a35ea414738c None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:31:22.225161 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca069d-0e63-4a72-a20d-a35ea414738c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:31:22.245368 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-46ca069d-0e63-4a72-a20d-a35ea414738c None None] MFA Rules not processed for user `b4614bede59c47ea813a73fcc0840a2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:31:22.246553 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-46ca069d-0e63-4a72-a20d-a35ea414738c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:31:22.326993 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1210/2420] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Sep 15 12:31:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:31:22.390011 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ac33ea-b7f6-4883-9b1d-607bd72ba843 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:31:22.391451 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-49ac33ea-b7f6-4883-9b1d-607bd72ba843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:31:22.478551 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ac33ea-b7f6-4883-9b1d-607bd72ba843 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:31:22.484410 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ab0512-350c-4a3f-a37f-dd0da191c577 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee33b730d0ec428ca2cd3af4ebf723e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:31:22.485036 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab0512-350c-4a3f-a37f-dd0da191c577 service swift] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:31:22.485313 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab0512-350c-4a3f-a37f-dd0da191c577 service swift] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:31:22.485584 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab0512-350c-4a3f-a37f-dd0da191c577 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:31:22.494849 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ab0512-350c-4a3f-a37f-dd0da191c577 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:31:22.496624 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ab0512-350c-4a3f-a37f-dd0da191c577 service swift] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:31:22.505627 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1211/2421] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Sep 15 12:31:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 12:31:22.997697 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2da6ff-011d-4099-937c-20b7baaf0d55 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:31:22.997994 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2da6ff-011d-4099-937c-20b7baaf0d55 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:31:22.998244 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2da6ff-011d-4099-937c-20b7baaf0d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:31:23.023242 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-2d2da6ff-011d-4099-937c-20b7baaf0d55 None None] MFA Rules not processed for user `b4614bede59c47ea813a73fcc0840a2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:31:23.024434 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-2d2da6ff-011d-4099-937c-20b7baaf0d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:31:23.031584 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1211/2422] 10.222.0.16 () {58 vars in 967 bytes} [Thu Sep 15 12:31:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:31:23.043598 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ab0512-350c-4a3f-a37f-dd0da191c577 service swift] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:31:23.053978 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ab0512-350c-4a3f-a37f-dd0da191c577 service swift] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:31:23.058938 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375ca287-9640-4790-8ba4-55e4fdc10afd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee33b730d0ec428ca2cd3af4ebf723e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:31:23.059523 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ca287-9640-4790-8ba4-55e4fdc10afd service swift] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:31:23.059798 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ca287-9640-4790-8ba4-55e4fdc10afd service swift] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:31:23.060064 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ca287-9640-4790-8ba4-55e4fdc10afd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:31:23.068388 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375ca287-9640-4790-8ba4-55e4fdc10afd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:31:23.069926 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375ca287-9640-4790-8ba4-55e4fdc10afd service swift] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:31:23.078318 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1212/2423] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Sep 15 12:31:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 12:31:23.309112 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65db3295-4c66-4475-9f16-099d92586e29 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:31:23.309589 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65db3295-4c66-4475-9f16-099d92586e29 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:31:23.309699 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65db3295-4c66-4475-9f16-099d92586e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:31:23.329292 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-65db3295-4c66-4475-9f16-099d92586e29 None None] MFA Rules not processed for user `b4614bede59c47ea813a73fcc0840a2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:31:23.330517 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-65db3295-4c66-4475-9f16-099d92586e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:31:23.337808 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1212/2424] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Sep 15 12:31:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:31:23.350675 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375ca287-9640-4790-8ba4-55e4fdc10afd service swift] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:31:23.361476 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375ca287-9640-4790-8ba4-55e4fdc10afd service swift] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:31:23.366378 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c643d97-44fe-4d4c-90ee-c697b5976698 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee33b730d0ec428ca2cd3af4ebf723e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:31:23.366994 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c643d97-44fe-4d4c-90ee-c697b5976698 service swift] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:31:23.367271 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c643d97-44fe-4d4c-90ee-c697b5976698 service swift] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:31:23.367538 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c643d97-44fe-4d4c-90ee-c697b5976698 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:31:23.375883 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c643d97-44fe-4d4c-90ee-c697b5976698 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:31:23.377706 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c643d97-44fe-4d4c-90ee-c697b5976698 service swift] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:31:23.385882 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1213/2425] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Sep 15 12:31:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 12:31:23.750474 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f583ed3-1cfc-4398-87f1-652eab6514e0 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:31:23.750891 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f583ed3-1cfc-4398-87f1-652eab6514e0 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:31:23.751581 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f583ed3-1cfc-4398-87f1-652eab6514e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:31:23.770832 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-3f583ed3-1cfc-4398-87f1-652eab6514e0 None None] MFA Rules not processed for user `b4614bede59c47ea813a73fcc0840a2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:31:23.772026 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-3f583ed3-1cfc-4398-87f1-652eab6514e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:31:23.779149 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1213/2426] 10.222.0.16 () {58 vars in 967 bytes} [Thu Sep 15 12:31:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:31:23.792307 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c643d97-44fe-4d4c-90ee-c697b5976698 service swift] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:31:23.803180 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c643d97-44fe-4d4c-90ee-c697b5976698 service swift] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:31:23.808166 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092adb20-2ad4-437a-a8d1-c002819df294 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee33b730d0ec428ca2cd3af4ebf723e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:31:23.808768 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092adb20-2ad4-437a-a8d1-c002819df294 service swift] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:31:23.809051 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092adb20-2ad4-437a-a8d1-c002819df294 service swift] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:31:23.809324 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092adb20-2ad4-437a-a8d1-c002819df294 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:31:23.817472 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092adb20-2ad4-437a-a8d1-c002819df294 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:31:23.819091 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092adb20-2ad4-437a-a8d1-c002819df294 service swift] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:31:23.827139 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1214/2427] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Sep 15 12:31:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 12:31:25.389506 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40bd82c-00c1-42cd-a385-5d503a491c05 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:31:25.390075 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40bd82c-00c1-42cd-a385-5d503a491c05 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:31:25.390430 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40bd82c-00c1-42cd-a385-5d503a491c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:31:25.414931 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-f40bd82c-00c1-42cd-a385-5d503a491c05 None None] MFA Rules not processed for user `983e501359234b31879e5cdfb34ea31a`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:31:25.416151 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-f40bd82c-00c1-42cd-a385-5d503a491c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:31:25.471327 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1214/2428] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:31:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:31:26.028657 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092adb20-2ad4-437a-a8d1-c002819df294 service swift] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:31:26.236556 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092adb20-2ad4-437a-a8d1-c002819df294 service swift] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:31:26.241283 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc5f8f4-8e5f-4a2a-83e8-a5ddf0916506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:31:26.241908 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5f8f4-8e5f-4a2a-83e8-a5ddf0916506 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:31:26.242181 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5f8f4-8e5f-4a2a-83e8-a5ddf0916506 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:31:26.242447 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5f8f4-8e5f-4a2a-83e8-a5ddf0916506 admin admin] PATH_INFO: `/v3/users/19893a46bd0a4ae08d713488fe57d7e2` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:31:26.243614 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc5f8f4-8e5f-4a2a-83e8-a5ddf0916506 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19893a46bd0a4ae08d713488fe57d7e2)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:31:26.245512 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc5f8f4-8e5f-4a2a-83e8-a5ddf0916506 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:31:26.292044 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-9dc5f8f4-8e5f-4a2a-83e8-a5ddf0916506 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19893a46bd0a4ae08d713488fe57d7e2'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:31:26.295606 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:31:26.300877 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-9dc5f8f4-8e5f-4a2a-83e8-a5ddf0916506 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19893a46bd0a4ae08d713488fe57d7e2'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:31:26.302049 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-9dc5f8f4-8e5f-4a2a-83e8-a5ddf0916506 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19893a46bd0a4ae08d713488fe57d7e2'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:31:26.302826 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-9dc5f8f4-8e5f-4a2a-83e8-a5ddf0916506 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19893a46bd0a4ae08d713488fe57d7e2'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:31:26.310805 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-9dc5f8f4-8e5f-4a2a-83e8-a5ddf0916506 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19893a46bd0a4ae08d713488fe57d7e2'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:31:26.328964 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1215/2429] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:31:26 2022] DELETE /identity/v3/users/19893a46bd0a4ae08d713488fe57d7e2 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:31:26.333377 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f9b32-b693-40c6-896e-d24c52cd30af None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:31:26.333666 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f9b32-b693-40c6-896e-d24c52cd30af None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:31:26.334006 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f9b32-b693-40c6-896e-d24c52cd30af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:31:26.353811 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-203f9b32-b693-40c6-896e-d24c52cd30af None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:31:26.355086 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-203f9b32-b693-40c6-896e-d24c52cd30af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:31:26.416387 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1215/2430] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:31:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:31:26.426043 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc5f8f4-8e5f-4a2a-83e8-a5ddf0916506 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:31:26.427521 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-9dc5f8f4-8e5f-4a2a-83e8-a5ddf0916506 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:31:26.487761 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc5f8f4-8e5f-4a2a-83e8-a5ddf0916506 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:31:26.491552 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f2391d-c94e-4958-8091-cc25760a3c90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:31:26.492148 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f2391d-c94e-4958-8091-cc25760a3c90 service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:31:26.492418 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f2391d-c94e-4958-8091-cc25760a3c90 service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:31:26.492680 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f2391d-c94e-4958-8091-cc25760a3c90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:31:26.501600 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f2391d-c94e-4958-8091-cc25760a3c90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:31:26.503049 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f2391d-c94e-4958-8091-cc25760a3c90 service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:31:26.512447 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1216/2431] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:31:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:31:26.685592 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203f9b32-b693-40c6-896e-d24c52cd30af None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:31:26.687124 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-203f9b32-b693-40c6-896e-d24c52cd30af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:31:26.701071 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203f9b32-b693-40c6-896e-d24c52cd30af None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:31:26.706019 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c289db63-ae56-4439-98cf-7390d4d1185f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:31:26.706913 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c289db63-ae56-4439-98cf-7390d4d1185f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:31:26.707197 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c289db63-ae56-4439-98cf-7390d4d1185f admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:31:26.707471 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c289db63-ae56-4439-98cf-7390d4d1185f admin admin] PATH_INFO: `/v3/projects/4d3bcabfe5a2431fa77c02459cd7ea05` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:31:26.709305 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c289db63-ae56-4439-98cf-7390d4d1185f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d3bcabfe5a2431fa77c02459cd7ea05)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:31:26.712046 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c289db63-ae56-4439-98cf-7390d4d1185f admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:31:26.748390 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:31:26.768262 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-c289db63-ae56-4439-98cf-7390d4d1185f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d3bcabfe5a2431fa77c02459cd7ea05', 'request_id': 'req-c289db63-ae56-4439-98cf-7390d4d1185f'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:31:26.776509 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-c289db63-ae56-4439-98cf-7390d4d1185f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d3bcabfe5a2431fa77c02459cd7ea05', 'request_id': 'req-c289db63-ae56-4439-98cf-7390d4d1185f'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:31:26.784572 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-c289db63-ae56-4439-98cf-7390d4d1185f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d3bcabfe5a2431fa77c02459cd7ea05', 'request_id': 'req-c289db63-ae56-4439-98cf-7390d4d1185f'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:31:26.799573 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-c289db63-ae56-4439-98cf-7390d4d1185f admin admin] The token cache is being invalidate because project 4d3bcabfe5a2431fa77c02459cd7ea05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:31:26.799863 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-c289db63-ae56-4439-98cf-7390d4d1185f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:31:26.800502 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-c289db63-ae56-4439-98cf-7390d4d1185f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:31:26.802022 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1216/2432] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:31:26 2022] DELETE /identity/v3/projects/4d3bcabfe5a2431fa77c02459cd7ea05 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:31:36.508086 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=38,keystone:DELETE=2 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:31:36.795577 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:DELETE=6,keystone:SELECT=14,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:31:51.500684 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e6f28-ceab-4280-ad96-36ed7e39c037 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:31:51.501156 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e6f28-ceab-4280-ad96-36ed7e39c037 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:31:51.501256 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e6f28-ceab-4280-ad96-36ed7e39c037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:31:51.520841 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-862e6f28-ceab-4280-ad96-36ed7e39c037 None None] MFA Rules not processed for user `b4614bede59c47ea813a73fcc0840a2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:31:51.522005 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-862e6f28-ceab-4280-ad96-36ed7e39c037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:31:51.573155 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1217/2433] 10.222.0.16 () {58 vars in 967 bytes} [Thu Sep 15 12:31:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:31:51.585580 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c289db63-ae56-4439-98cf-7390d4d1185f admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:31:51.586976 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-c289db63-ae56-4439-98cf-7390d4d1185f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:31:51.657856 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c289db63-ae56-4439-98cf-7390d4d1185f admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:31:51.662830 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9da76a-7339-4c47-b025-5d41e479f6cb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee33b730d0ec428ca2cd3af4ebf723e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:31:51.663445 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9da76a-7339-4c47-b025-5d41e479f6cb service swift] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:31:51.663723 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9da76a-7339-4c47-b025-5d41e479f6cb service swift] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:31:51.664005 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9da76a-7339-4c47-b025-5d41e479f6cb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:31:51.671793 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9da76a-7339-4c47-b025-5d41e479f6cb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:31:51.673369 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9da76a-7339-4c47-b025-5d41e479f6cb service swift] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:31:51.681234 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1217/2434] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Sep 15 12:31:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 12:31:55.017970 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862e6f28-ceab-4280-ad96-36ed7e39c037 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:31:55.019693 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-862e6f28-ceab-4280-ad96-36ed7e39c037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:31:55.095282 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862e6f28-ceab-4280-ad96-36ed7e39c037 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:31:55.102330 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281e5ac5-b156-4787-872a-6a059121ad85 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ff8a5ddf1e422ca97f92bd9d4e5fb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:31:55.103010 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281e5ac5-b156-4787-872a-6a059121ad85 service placement] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:31:55.103286 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281e5ac5-b156-4787-872a-6a059121ad85 service placement] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:31:55.103555 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281e5ac5-b156-4787-872a-6a059121ad85 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:31:55.105318 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-281e5ac5-b156-4787-872a-6a059121ad85 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:31:55.117462 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281e5ac5-b156-4787-872a-6a059121ad85 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:31:55.119059 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281e5ac5-b156-4787-872a-6a059121ad85 service placement] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:31:55.129767 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1218/2435] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:31:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:31:58.088536 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9da76a-7339-4c47-b025-5d41e479f6cb service swift] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:31:58.090026 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-8f9da76a-7339-4c47-b025-5d41e479f6cb service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:31:58.154086 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9da76a-7339-4c47-b025-5d41e479f6cb service swift] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:31:58.158980 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e83a882-b0ac-42f7-9024-b5e9303bd25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:31:58.159591 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e83a882-b0ac-42f7-9024-b5e9303bd25e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:31:58.159865 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e83a882-b0ac-42f7-9024-b5e9303bd25e admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:31:58.160133 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e83a882-b0ac-42f7-9024-b5e9303bd25e admin admin] PATH_INFO: `/v3/users/c497af3978444ea9a99023e8af121fa9` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:31:58.161215 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e83a882-b0ac-42f7-9024-b5e9303bd25e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c497af3978444ea9a99023e8af121fa9)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:31:58.163149 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e83a882-b0ac-42f7-9024-b5e9303bd25e admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:31:58.208813 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-0e83a882-b0ac-42f7-9024-b5e9303bd25e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c497af3978444ea9a99023e8af121fa9'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:31:58.216282 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-0e83a882-b0ac-42f7-9024-b5e9303bd25e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c497af3978444ea9a99023e8af121fa9'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:31:58.216955 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-0e83a882-b0ac-42f7-9024-b5e9303bd25e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c497af3978444ea9a99023e8af121fa9'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:31:58.217548 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-0e83a882-b0ac-42f7-9024-b5e9303bd25e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c497af3978444ea9a99023e8af121fa9'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:31:58.225293 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-0e83a882-b0ac-42f7-9024-b5e9303bd25e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c497af3978444ea9a99023e8af121fa9'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:31:58.242389 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1218/2436] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:31:58 2022] DELETE /identity/v3/users/c497af3978444ea9a99023e8af121fa9 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:31:58.414217 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281e5ac5-b156-4787-872a-6a059121ad85 service placement] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:31:58.424785 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281e5ac5-b156-4787-872a-6a059121ad85 service placement] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:31:58.480083 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b81c7c-00d1-429d-a119-5525047df3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:31:58.480703 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b81c7c-00d1-429d-a119-5525047df3ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:31:58.480980 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b81c7c-00d1-429d-a119-5525047df3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:31:58.481250 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b81c7c-00d1-429d-a119-5525047df3ab admin admin] PATH_INFO: `/v3/projects/08edd7bc35ec4123b17b3bbe0bc3c763` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:31:58.482340 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b81c7c-00d1-429d-a119-5525047df3ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=08edd7bc35ec4123b17b3bbe0bc3c763)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:31:58.484261 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b81c7c-00d1-429d-a119-5525047df3ab admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:31:58.521076 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:31:58.530994 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-40b81c7c-00d1-429d-a119-5525047df3ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08edd7bc35ec4123b17b3bbe0bc3c763', 'request_id': 'req-40b81c7c-00d1-429d-a119-5525047df3ab'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:31:58.537072 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-40b81c7c-00d1-429d-a119-5525047df3ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08edd7bc35ec4123b17b3bbe0bc3c763', 'request_id': 'req-40b81c7c-00d1-429d-a119-5525047df3ab'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:31:58.544492 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-40b81c7c-00d1-429d-a119-5525047df3ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08edd7bc35ec4123b17b3bbe0bc3c763', 'request_id': 'req-40b81c7c-00d1-429d-a119-5525047df3ab'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:31:58.555319 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-40b81c7c-00d1-429d-a119-5525047df3ab admin admin] The token cache is being invalidate because project 08edd7bc35ec4123b17b3bbe0bc3c763 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:31:58.555609 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-40b81c7c-00d1-429d-a119-5525047df3ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:31:58.556227 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-40b81c7c-00d1-429d-a119-5525047df3ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:31:58.557713 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1219/2437] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:31:58 2022] DELETE /identity/v3/projects/08edd7bc35ec4123b17b3bbe0bc3c763 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:31:58.561857 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e83a882-b0ac-42f7-9024-b5e9303bd25e admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:31:58.563815 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-0e83a882-b0ac-42f7-9024-b5e9303bd25e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:31:58.576590 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e83a882-b0ac-42f7-9024-b5e9303bd25e admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:31:58.581653 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:31:58.633452 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3038c736-0510-455d-b212-6c693644fafe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:31:58.634075 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3038c736-0510-455d-b212-6c693644fafe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:31:58.634351 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3038c736-0510-455d-b212-6c693644fafe admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:31:58.634622 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3038c736-0510-455d-b212-6c693644fafe admin admin] PATH_INFO: `/v3/users/7e953821c50b4a79862d8edb18ac4476` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:31:58.635750 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3038c736-0510-455d-b212-6c693644fafe admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e953821c50b4a79862d8edb18ac4476)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:31:58.637649 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3038c736-0510-455d-b212-6c693644fafe admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:31:58.681761 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-3038c736-0510-455d-b212-6c693644fafe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e953821c50b4a79862d8edb18ac4476'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:31:58.689309 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-3038c736-0510-455d-b212-6c693644fafe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e953821c50b4a79862d8edb18ac4476'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:31:58.689940 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-3038c736-0510-455d-b212-6c693644fafe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e953821c50b4a79862d8edb18ac4476'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:31:58.690539 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-3038c736-0510-455d-b212-6c693644fafe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e953821c50b4a79862d8edb18ac4476'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:31:58.697467 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-3038c736-0510-455d-b212-6c693644fafe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e953821c50b4a79862d8edb18ac4476'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:31:58.715274 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1219/2438] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:31:58 2022] DELETE /identity/v3/users/7e953821c50b4a79862d8edb18ac4476 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:31:58.886969 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b81c7c-00d1-429d-a119-5525047df3ab admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:31:58.888453 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-40b81c7c-00d1-429d-a119-5525047df3ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:31:58.904268 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b81c7c-00d1-429d-a119-5525047df3ab admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:31:58.960066 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89622c40-acca-4a93-a7e8-2735cc473534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:31:58.960685 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89622c40-acca-4a93-a7e8-2735cc473534 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:31:58.960959 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89622c40-acca-4a93-a7e8-2735cc473534 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:31:58.961225 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89622c40-acca-4a93-a7e8-2735cc473534 admin admin] PATH_INFO: `/v3/projects/6c6a27e93f6546e8b23c1376857833a8` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:31:58.962311 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89622c40-acca-4a93-a7e8-2735cc473534 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c6a27e93f6546e8b23c1376857833a8)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:31:58.964230 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89622c40-acca-4a93-a7e8-2735cc473534 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:31:59.011184 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-89622c40-acca-4a93-a7e8-2735cc473534 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c6a27e93f6546e8b23c1376857833a8', 'request_id': 'req-89622c40-acca-4a93-a7e8-2735cc473534'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:31:59.016737 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-89622c40-acca-4a93-a7e8-2735cc473534 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c6a27e93f6546e8b23c1376857833a8', 'request_id': 'req-89622c40-acca-4a93-a7e8-2735cc473534'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:31:59.023958 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-89622c40-acca-4a93-a7e8-2735cc473534 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c6a27e93f6546e8b23c1376857833a8', 'request_id': 'req-89622c40-acca-4a93-a7e8-2735cc473534'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:31:59.034643 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-89622c40-acca-4a93-a7e8-2735cc473534 admin admin] The token cache is being invalidate because project 6c6a27e93f6546e8b23c1376857833a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:31:59.034948 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-89622c40-acca-4a93-a7e8-2735cc473534 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:31:59.035558 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-89622c40-acca-4a93-a7e8-2735cc473534 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:31:59.037018 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1220/2439] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:31:58 2022] DELETE /identity/v3/projects/6c6a27e93f6546e8b23c1376857833a8 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:32:08.711795 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=49,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:32:09.031752 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=62,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:32:19.468938 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d99c11-818b-4fd5-b323-62bd98657ad3 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:32:19.469447 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d99c11-818b-4fd5-b323-62bd98657ad3 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:32:19.469555 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d99c11-818b-4fd5-b323-62bd98657ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:32:19.508471 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-b7d99c11-818b-4fd5-b323-62bd98657ad3 None None] MFA Rules not processed for user `b4614bede59c47ea813a73fcc0840a2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:32:19.509659 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-b7d99c11-818b-4fd5-b323-62bd98657ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:32:19.591339 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1220/2440] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Sep 15 12:32:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:32:19.603428 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89622c40-acca-4a93-a7e8-2735cc473534 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:32:19.604810 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-89622c40-acca-4a93-a7e8-2735cc473534 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:32:19.694417 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89622c40-acca-4a93-a7e8-2735cc473534 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:32:19.699431 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac785be-1cdf-4ba6-b63e-51f8f83f8c2a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee33b730d0ec428ca2cd3af4ebf723e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:32:19.700028 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac785be-1cdf-4ba6-b63e-51f8f83f8c2a service swift] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:32:19.700304 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac785be-1cdf-4ba6-b63e-51f8f83f8c2a service swift] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:32:19.700572 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac785be-1cdf-4ba6-b63e-51f8f83f8c2a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:32:19.708386 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac785be-1cdf-4ba6-b63e-51f8f83f8c2a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:32:19.709892 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac785be-1cdf-4ba6-b63e-51f8f83f8c2a service swift] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:32:19.718298 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1221/2441] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Sep 15 12:32:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 12:32:29.589502 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=45 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:32:29.715153 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=43 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:32:34.939832 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d99c11-818b-4fd5-b323-62bd98657ad3 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:32:34.941285 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-b7d99c11-818b-4fd5-b323-62bd98657ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:32:35.052316 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d99c11-818b-4fd5-b323-62bd98657ad3 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:32:35.057533 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b694c013-4d39-4e7a-84c1-37d81cb27f00 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ff8a5ddf1e422ca97f92bd9d4e5fb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:32:35.058133 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b694c013-4d39-4e7a-84c1-37d81cb27f00 service placement] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:32:35.058407 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b694c013-4d39-4e7a-84c1-37d81cb27f00 service placement] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:32:35.058680 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b694c013-4d39-4e7a-84c1-37d81cb27f00 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:32:35.060422 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-b694c013-4d39-4e7a-84c1-37d81cb27f00 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:32:35.073067 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b694c013-4d39-4e7a-84c1-37d81cb27f00 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:32:35.074703 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b694c013-4d39-4e7a-84c1-37d81cb27f00 service placement] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:32:35.084881 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1221/2442] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:32:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:32:39.935721 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb59a0-cd75-4e73-b432-4b61fc92fda1 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:32:39.936277 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb59a0-cd75-4e73-b432-4b61fc92fda1 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:32:39.936277 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb59a0-cd75-4e73-b432-4b61fc92fda1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:32:39.957121 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-babb59a0-cd75-4e73-b432-4b61fc92fda1 None None] MFA Rules not processed for user `b4614bede59c47ea813a73fcc0840a2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:32:39.958299 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-babb59a0-cd75-4e73-b432-4b61fc92fda1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:32:39.971287 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1222/2443] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Sep 15 12:32:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:32:39.983014 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b694c013-4d39-4e7a-84c1-37d81cb27f00 service placement] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:32:39.994174 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b694c013-4d39-4e7a-84c1-37d81cb27f00 service placement] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:32:39.999118 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f76714-9302-4353-bce1-729873d45924 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee33b730d0ec428ca2cd3af4ebf723e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:32:39.999713 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f76714-9302-4353-bce1-729873d45924 service swift] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:32:39.999991 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f76714-9302-4353-bce1-729873d45924 service swift] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:32:40.000264 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f76714-9302-4353-bce1-729873d45924 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:32:40.008828 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f76714-9302-4353-bce1-729873d45924 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:32:40.010380 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f76714-9302-4353-bce1-729873d45924 service swift] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:32:40.023020 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1222/2444] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Sep 15 12:32:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 12:32:41.809230 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babb59a0-cd75-4e73-b432-4b61fc92fda1 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:32:41.810681 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-babb59a0-cd75-4e73-b432-4b61fc92fda1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:32:41.906403 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babb59a0-cd75-4e73-b432-4b61fc92fda1 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:32:41.914725 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cfc0a1-c154-45f3-9c5c-87d74662e4d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:32:41.914725 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cfc0a1-c154-45f3-9c5c-87d74662e4d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:32:41.914725 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cfc0a1-c154-45f3-9c5c-87d74662e4d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:32:41.914725 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cfc0a1-c154-45f3-9c5c-87d74662e4d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:32:41.915803 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-b0cfc0a1-c154-45f3-9c5c-87d74662e4d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:32:42.024056 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cfc0a1-c154-45f3-9c5c-87d74662e4d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:32:42.025878 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cfc0a1-c154-45f3-9c5c-87d74662e4d6 service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:32:42.047291 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1223/2445] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:32:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:32:45.695917 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f76714-9302-4353-bce1-729873d45924 service swift] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:32:45.697376 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-84f76714-9302-4353-bce1-729873d45924 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:32:45.723157 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f76714-9302-4353-bce1-729873d45924 service swift] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:32:45.755506 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69171b9b-4ed2-4668-81d4-cb74d9db748f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:32:45.756839 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69171b9b-4ed2-4668-81d4-cb74d9db748f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:32:45.758781 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69171b9b-4ed2-4668-81d4-cb74d9db748f admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:32:45.759261 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69171b9b-4ed2-4668-81d4-cb74d9db748f admin admin] PATH_INFO: `/v3/users/74811d83f5924dfbaa0866a2a48ca281` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:32:45.772088 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69171b9b-4ed2-4668-81d4-cb74d9db748f admin admin] RBAC: Authorizing `identity:delete_user(user_id=74811d83f5924dfbaa0866a2a48ca281)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:32:45.774509 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69171b9b-4ed2-4668-81d4-cb74d9db748f admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:32:45.856778 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-69171b9b-4ed2-4668-81d4-cb74d9db748f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74811d83f5924dfbaa0866a2a48ca281'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:32:45.866822 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-69171b9b-4ed2-4668-81d4-cb74d9db748f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74811d83f5924dfbaa0866a2a48ca281'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:32:45.867856 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-69171b9b-4ed2-4668-81d4-cb74d9db748f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74811d83f5924dfbaa0866a2a48ca281'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:32:45.868455 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-69171b9b-4ed2-4668-81d4-cb74d9db748f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74811d83f5924dfbaa0866a2a48ca281'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:32:45.877577 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-69171b9b-4ed2-4668-81d4-cb74d9db748f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74811d83f5924dfbaa0866a2a48ca281'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:32:45.905953 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1223/2446] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:32:45 2022] DELETE /identity/v3/users/74811d83f5924dfbaa0866a2a48ca281 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:32:46.096022 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cfc0a1-c154-45f3-9c5c-87d74662e4d6 service neutron] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:32:46.112878 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cfc0a1-c154-45f3-9c5c-87d74662e4d6 service neutron] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:32:46.165556 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:32:46.174194 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b962fdc-02be-4e24-bf59-7fec0599b7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:32:46.175002 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b962fdc-02be-4e24-bf59-7fec0599b7f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:32:46.175434 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b962fdc-02be-4e24-bf59-7fec0599b7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:32:46.175823 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b962fdc-02be-4e24-bf59-7fec0599b7f1 admin admin] PATH_INFO: `/v3/projects/8f4fd80042fc40239c3d122a8251bf57` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:32:46.177118 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b962fdc-02be-4e24-bf59-7fec0599b7f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f4fd80042fc40239c3d122a8251bf57)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:32:46.179297 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b962fdc-02be-4e24-bf59-7fec0599b7f1 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:32:46.230319 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-9b962fdc-02be-4e24-bf59-7fec0599b7f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f4fd80042fc40239c3d122a8251bf57', 'request_id': 'req-9b962fdc-02be-4e24-bf59-7fec0599b7f1'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:32:46.236749 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-9b962fdc-02be-4e24-bf59-7fec0599b7f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f4fd80042fc40239c3d122a8251bf57', 'request_id': 'req-9b962fdc-02be-4e24-bf59-7fec0599b7f1'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:32:46.244693 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-9b962fdc-02be-4e24-bf59-7fec0599b7f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f4fd80042fc40239c3d122a8251bf57', 'request_id': 'req-9b962fdc-02be-4e24-bf59-7fec0599b7f1'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:32:46.259335 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-9b962fdc-02be-4e24-bf59-7fec0599b7f1 admin admin] The token cache is being invalidate because project 8f4fd80042fc40239c3d122a8251bf57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:32:46.259598 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-9b962fdc-02be-4e24-bf59-7fec0599b7f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:32:46.260393 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-9b962fdc-02be-4e24-bf59-7fec0599b7f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:32:46.262743 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1224/2447] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:32:46 2022] DELETE /identity/v3/projects/8f4fd80042fc40239c3d122a8251bf57 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:32:46.268315 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec69b047-bd94-4975-9506-ac6dfb249b83 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:32:46.268674 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec69b047-bd94-4975-9506-ac6dfb249b83 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:32:46.269078 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec69b047-bd94-4975-9506-ac6dfb249b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:32:46.310881 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:32:46.330609 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-ec69b047-bd94-4975-9506-ac6dfb249b83 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:32:46.331922 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-ec69b047-bd94-4975-9506-ac6dfb249b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:32:46.397474 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1224/2448] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:32:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:32:46.405305 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fbedeb-814c-4c59-b03a-868558d57a3c None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:32:46.405584 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fbedeb-814c-4c59-b03a-868558d57a3c None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:32:46.405850 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fbedeb-814c-4c59-b03a-868558d57a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:32:46.428585 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-61fbedeb-814c-4c59-b03a-868558d57a3c None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:32:46.429802 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-61fbedeb-814c-4c59-b03a-868558d57a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:32:46.438264 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1225/2449] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:32:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:32:46.442466 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec69b047-bd94-4975-9506-ac6dfb249b83 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:32:46.453050 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec69b047-bd94-4975-9506-ac6dfb249b83 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:32:46.458354 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf31a95-ee97-4e2d-b36c-546a37a979c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:32:46.458986 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf31a95-ee97-4e2d-b36c-546a37a979c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:32:46.459266 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf31a95-ee97-4e2d-b36c-546a37a979c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:32:46.459536 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf31a95-ee97-4e2d-b36c-546a37a979c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:32:46.460183 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf31a95-ee97-4e2d-b36c-546a37a979c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:32:46.460483 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf31a95-ee97-4e2d-b36c-546a37a979c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:32:46.462128 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf31a95-ee97-4e2d-b36c-546a37a979c5 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:32:46.475384 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1225/2450] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 15 12:32:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:32:46.479736 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fbedeb-814c-4c59-b03a-868558d57a3c None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:32:46.488869 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fbedeb-814c-4c59-b03a-868558d57a3c None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:32:46.493733 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f964748c-4e70-4c57-a294-892463048ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:32:46.494330 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964748c-4e70-4c57-a294-892463048ce8 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:32:46.494606 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964748c-4e70-4c57-a294-892463048ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:32:46.494901 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964748c-4e70-4c57-a294-892463048ce8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:32:46.495626 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f964748c-4e70-4c57-a294-892463048ce8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:32:46.497438 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f964748c-4e70-4c57-a294-892463048ce8 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:32:46.535273 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1226/2451] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:32:46 2022] POST /identity/v3/projects => generated 379 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:32:46.539199 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf31a95-ee97-4e2d-b36c-546a37a979c5 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:32:46.549142 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf31a95-ee97-4e2d-b36c-546a37a979c5 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:32:46.611876 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869419d8-e3e2-4a08-ae3d-4dc78f2f8016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:32:46.612537 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869419d8-e3e2-4a08-ae3d-4dc78f2f8016 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:32:46.612832 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869419d8-e3e2-4a08-ae3d-4dc78f2f8016 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:32:46.613084 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869419d8-e3e2-4a08-ae3d-4dc78f2f8016 admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:32:46.613712 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869419d8-e3e2-4a08-ae3d-4dc78f2f8016 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:32:46.615666 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869419d8-e3e2-4a08-ae3d-4dc78f2f8016 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:32:46.641681 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1226/2452] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:32:46 2022] POST /identity/v3/users => generated 290 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:32:46.649002 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f964748c-4e70-4c57-a294-892463048ce8 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:32:46.653705 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f964748c-4e70-4c57-a294-892463048ce8 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:32:46.658340 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedf5709-39da-439c-9f19-4493dc07040d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:32:46.658977 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf5709-39da-439c-9f19-4493dc07040d admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:32:46.659250 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf5709-39da-439c-9f19-4493dc07040d admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:32:46.659518 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf5709-39da-439c-9f19-4493dc07040d admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:32:46.660153 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedf5709-39da-439c-9f19-4493dc07040d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:32:46.661743 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedf5709-39da-439c-9f19-4493dc07040d admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:32:46.676048 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1227/2453] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:32:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:32:46.677219 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869419d8-e3e2-4a08-ae3d-4dc78f2f8016 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:32:46.687857 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869419d8-e3e2-4a08-ae3d-4dc78f2f8016 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:32:46.693174 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b662f61d-33a4-4610-b25d-1f63876920fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:32:46.693757 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b662f61d-33a4-4610-b25d-1f63876920fb admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:32:46.694033 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b662f61d-33a4-4610-b25d-1f63876920fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:32:46.694301 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b662f61d-33a4-4610-b25d-1f63876920fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:32:46.694973 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b662f61d-33a4-4610-b25d-1f63876920fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:32:46.696560 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b662f61d-33a4-4610-b25d-1f63876920fb admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:32:46.708028 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1227/2454] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:32:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 12:32:46.712269 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedf5709-39da-439c-9f19-4493dc07040d admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:32:46.722643 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedf5709-39da-439c-9f19-4493dc07040d admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:32:46.727592 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ebc044-98b0-49f9-9139-916b21db4ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:32:46.728691 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ebc044-98b0-49f9-9139-916b21db4ce8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:32:46.728975 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ebc044-98b0-49f9-9139-916b21db4ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:32:46.729509 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ebc044-98b0-49f9-9139-916b21db4ce8 admin admin] PATH_INFO: `/v3/projects/1ba2e180ad144efbb6e89abbc87a2bbb/users/b3e63dbc11f04e7daa09690c6932e0ef/roles/9371e5bbc55848949eb951a815f817f2` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:32:46.754580 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ebc044-98b0-49f9-9139-916b21db4ce8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ba2e180ad144efbb6e89abbc87a2bbb, user_id=b3e63dbc11f04e7daa09690c6932e0ef, role_id=9371e5bbc55848949eb951a815f817f2)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:32:46.757970 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ebc044-98b0-49f9-9139-916b21db4ce8 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:32:46.787672 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1228/2455] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:32:46 2022] PUT /identity/v3/projects/1ba2e180ad144efbb6e89abbc87a2bbb/users/b3e63dbc11f04e7daa09690c6932e0ef/roles/9371e5bbc55848949eb951a815f817f2 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:32:46.799067 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444df1c0-23d3-4536-9912-41791c8d6e80 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:32:46.799928 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444df1c0-23d3-4536-9912-41791c8d6e80 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:32:46.800541 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444df1c0-23d3-4536-9912-41791c8d6e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:32:46.840503 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-444df1c0-23d3-4536-9912-41791c8d6e80 None None] MFA Rules not processed for user `b3e63dbc11f04e7daa09690c6932e0ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:32:46.842683 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-444df1c0-23d3-4536-9912-41791c8d6e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:32:46.919682 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:32:46.935181 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1228/2456] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:32:46 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:32:46.944707 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ebc044-98b0-49f9-9139-916b21db4ce8 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:32:47.043094 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ebc044-98b0-49f9-9139-916b21db4ce8 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:32:47.049424 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60432277-68c3-4ecf-8f7d-af4761d5dfd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:32:47.050459 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60432277-68c3-4ecf-8f7d-af4761d5dfd0 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:32:47.050761 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60432277-68c3-4ecf-8f7d-af4761d5dfd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:32:47.051030 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60432277-68c3-4ecf-8f7d-af4761d5dfd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:32:47.051661 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60432277-68c3-4ecf-8f7d-af4761d5dfd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:32:47.053581 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60432277-68c3-4ecf-8f7d-af4761d5dfd0 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:32:47.084407 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1229/2457] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:32:46 2022] POST /identity/v3/projects => generated 381 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:32:47.085879 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444df1c0-23d3-4536-9912-41791c8d6e80 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:32:47.097264 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444df1c0-23d3-4536-9912-41791c8d6e80 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:32:47.156919 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56033e2c-4b87-4358-90d3-e9ea60a26773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:32:47.157519 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56033e2c-4b87-4358-90d3-e9ea60a26773 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:32:47.157805 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56033e2c-4b87-4358-90d3-e9ea60a26773 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:32:47.158078 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56033e2c-4b87-4358-90d3-e9ea60a26773 admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:32:47.158728 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56033e2c-4b87-4358-90d3-e9ea60a26773 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:32:47.160642 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56033e2c-4b87-4358-90d3-e9ea60a26773 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:32:47.189856 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1229/2458] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:32:47 2022] POST /identity/v3/users => generated 297 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:32:47.193969 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60432277-68c3-4ecf-8f7d-af4761d5dfd0 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:32:47.205047 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60432277-68c3-4ecf-8f7d-af4761d5dfd0 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:32:47.209680 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92823f79-5116-4392-a0db-7913d83e1b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:32:47.210278 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92823f79-5116-4392-a0db-7913d83e1b14 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:32:47.210552 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92823f79-5116-4392-a0db-7913d83e1b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:32:47.210901 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92823f79-5116-4392-a0db-7913d83e1b14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:32:47.211535 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92823f79-5116-4392-a0db-7913d83e1b14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:32:47.213129 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92823f79-5116-4392-a0db-7913d83e1b14 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:32:47.214538 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:32:47.225526 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1230/2459] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:32:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 12:32:47.229913 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56033e2c-4b87-4358-90d3-e9ea60a26773 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:32:47.239960 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56033e2c-4b87-4358-90d3-e9ea60a26773 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:32:47.245026 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a55703e-b3f4-4030-b366-7b20194874b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:32:47.245671 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a55703e-b3f4-4030-b366-7b20194874b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:32:47.246061 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a55703e-b3f4-4030-b366-7b20194874b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:32:47.246338 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a55703e-b3f4-4030-b366-7b20194874b9 admin admin] PATH_INFO: `/v3/projects/308bfc7040514a47865c28f348721dbe/users/682c0ffe8d7e4d9c90491a16089d8f40/roles/7f53f1c823b746529ba5057bf21b2477` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:32:47.263995 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a55703e-b3f4-4030-b366-7b20194874b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=308bfc7040514a47865c28f348721dbe, user_id=682c0ffe8d7e4d9c90491a16089d8f40, role_id=7f53f1c823b746529ba5057bf21b2477)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:32:47.267706 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a55703e-b3f4-4030-b366-7b20194874b9 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:32:47.288850 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1230/2460] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:32:47 2022] PUT /identity/v3/projects/308bfc7040514a47865c28f348721dbe/users/682c0ffe8d7e4d9c90491a16089d8f40/roles/7f53f1c823b746529ba5057bf21b2477 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:32:47.290176 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92823f79-5116-4392-a0db-7913d83e1b14 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:32:47.300447 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92823f79-5116-4392-a0db-7913d83e1b14 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:32:47.358420 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6120b3-dd36-429c-85c3-a2889e9be7c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:32:47.359062 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6120b3-dd36-429c-85c3-a2889e9be7c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:32:47.359336 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6120b3-dd36-429c-85c3-a2889e9be7c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:32:47.359597 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6120b3-dd36-429c-85c3-a2889e9be7c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:32:47.360287 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6120b3-dd36-429c-85c3-a2889e9be7c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:32:47.362074 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6120b3-dd36-429c-85c3-a2889e9be7c6 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:32:47.372398 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1231/2461] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:32:47 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:32:47.377405 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a55703e-b3f4-4030-b366-7b20194874b9 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:32:47.387839 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a55703e-b3f4-4030-b366-7b20194874b9 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:32:47.393258 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96df701-d0ef-497e-9202-abf59b843432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:32:47.393934 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96df701-d0ef-497e-9202-abf59b843432 admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:32:47.394189 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96df701-d0ef-497e-9202-abf59b843432 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:32:47.394460 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96df701-d0ef-497e-9202-abf59b843432 admin admin] PATH_INFO: `/v3/projects/308bfc7040514a47865c28f348721dbe/users/682c0ffe8d7e4d9c90491a16089d8f40/roles/7f53f1c823b746529ba5057bf21b2477` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:32:47.396499 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96df701-d0ef-497e-9202-abf59b843432 admin admin] RBAC: Authorizing `identity:create_grant(project_id=308bfc7040514a47865c28f348721dbe, user_id=682c0ffe8d7e4d9c90491a16089d8f40, role_id=7f53f1c823b746529ba5057bf21b2477)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:32:47.399183 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96df701-d0ef-497e-9202-abf59b843432 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:32:47.410700 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1231/2462] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:32:47 2022] PUT /identity/v3/projects/308bfc7040514a47865c28f348721dbe/users/682c0ffe8d7e4d9c90491a16089d8f40/roles/7f53f1c823b746529ba5057bf21b2477 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:32:47.424514 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b90f40-cb2c-4ae6-bbc4-756aae0f5be9 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:32:47.424845 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b90f40-cb2c-4ae6-bbc4-756aae0f5be9 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:32:47.425077 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b90f40-cb2c-4ae6-bbc4-756aae0f5be9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:32:47.454931 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-31b90f40-cb2c-4ae6-bbc4-756aae0f5be9 None None] MFA Rules not processed for user `682c0ffe8d7e4d9c90491a16089d8f40`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:32:47.456223 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-31b90f40-cb2c-4ae6-bbc4-756aae0f5be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:32:47.530724 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1232/2463] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:32:47 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:32:47.542709 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96df701-d0ef-497e-9202-abf59b843432 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:32:47.544445 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-e96df701-d0ef-497e-9202-abf59b843432 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:32:47.631093 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96df701-d0ef-497e-9202-abf59b843432 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:32:47.635098 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5437f2b8-9125-46c6-bd5c-f316cfb0e1a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceafc5e4283841528053f01931f10293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:32:47.635811 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437f2b8-9125-46c6-bd5c-f316cfb0e1a6 service cinder] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:32:47.636133 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437f2b8-9125-46c6-bd5c-f316cfb0e1a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:32:47.636406 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437f2b8-9125-46c6-bd5c-f316cfb0e1a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:32:47.652385 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5437f2b8-9125-46c6-bd5c-f316cfb0e1a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:32:47.654440 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5437f2b8-9125-46c6-bd5c-f316cfb0e1a6 service cinder] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:32:47.666625 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1232/2464] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:32:47 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:32:47.755836 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b90f40-cb2c-4ae6-bbc4-756aae0f5be9 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:32:47.765768 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b90f40-cb2c-4ae6-bbc4-756aae0f5be9 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:32:47.770053 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60517b7f-64df-46d9-b557-cec044a1e795 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceafc5e4283841528053f01931f10293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:32:47.770795 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60517b7f-64df-46d9-b557-cec044a1e795 service cinder] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:32:47.771193 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60517b7f-64df-46d9-b557-cec044a1e795 service cinder] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:32:47.771489 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60517b7f-64df-46d9-b557-cec044a1e795 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:32:47.835538 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60517b7f-64df-46d9-b557-cec044a1e795 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:32:47.837099 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60517b7f-64df-46d9-b557-cec044a1e795 service cinder] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:32:47.847305 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1233/2465] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:32:47 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:32:54.683751 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5437f2b8-9125-46c6-bd5c-f316cfb0e1a6 service cinder] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:32:54.714055 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:32:54.746439 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5437f2b8-9125-46c6-bd5c-f316cfb0e1a6 service cinder] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:32:54.751794 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ff6142-22da-4051-98c9-bb2ecd0f82ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:32:54.752429 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff6142-22da-4051-98c9-bb2ecd0f82ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:32:54.752717 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff6142-22da-4051-98c9-bb2ecd0f82ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:32:54.752987 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff6142-22da-4051-98c9-bb2ecd0f82ba admin admin] PATH_INFO: `/v3/users/b3e63dbc11f04e7daa09690c6932e0ef` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:32:54.754163 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ff6142-22da-4051-98c9-bb2ecd0f82ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3e63dbc11f04e7daa09690c6932e0ef)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:32:54.756136 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ff6142-22da-4051-98c9-bb2ecd0f82ba admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:32:54.801816 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-52ff6142-22da-4051-98c9-bb2ecd0f82ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3e63dbc11f04e7daa09690c6932e0ef'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:32:54.809064 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-52ff6142-22da-4051-98c9-bb2ecd0f82ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3e63dbc11f04e7daa09690c6932e0ef'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:32:54.809681 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-52ff6142-22da-4051-98c9-bb2ecd0f82ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3e63dbc11f04e7daa09690c6932e0ef'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:32:54.810297 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-52ff6142-22da-4051-98c9-bb2ecd0f82ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3e63dbc11f04e7daa09690c6932e0ef'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:32:54.817818 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-52ff6142-22da-4051-98c9-bb2ecd0f82ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3e63dbc11f04e7daa09690c6932e0ef'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:32:54.835363 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1233/2466] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:32:54 2022] DELETE /identity/v3/users/b3e63dbc11f04e7daa09690c6932e0ef => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:32:54.839845 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2d5d1-1808-408d-bf46-5e655fb17974 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:32:54.840339 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2d5d1-1808-408d-bf46-5e655fb17974 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:32:54.840434 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2d5d1-1808-408d-bf46-5e655fb17974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:32:54.858843 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-72b2d5d1-1808-408d-bf46-5e655fb17974 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:32:54.860061 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-72b2d5d1-1808-408d-bf46-5e655fb17974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:32:54.870378 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:32:54.920719 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1234/2467] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:32:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:32:54.931007 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ff6142-22da-4051-98c9-bb2ecd0f82ba admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:32:54.932416 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-52ff6142-22da-4051-98c9-bb2ecd0f82ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:32:54.990136 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ff6142-22da-4051-98c9-bb2ecd0f82ba admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:32:54.993745 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13208cb-3ae1-4beb-88b0-a5addd780b32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:32:54.994368 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13208cb-3ae1-4beb-88b0-a5addd780b32 service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:32:54.994643 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13208cb-3ae1-4beb-88b0-a5addd780b32 service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:32:54.994955 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13208cb-3ae1-4beb-88b0-a5addd780b32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:32:55.004011 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13208cb-3ae1-4beb-88b0-a5addd780b32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:32:55.005413 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13208cb-3ae1-4beb-88b0-a5addd780b32 service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:32:55.014513 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1234/2468] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:32:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:32:55.289991 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b2d5d1-1808-408d-bf46-5e655fb17974 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:32:55.291803 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-72b2d5d1-1808-408d-bf46-5e655fb17974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:32:55.305727 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b2d5d1-1808-408d-bf46-5e655fb17974 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:32:55.319647 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6994cf-43a1-4246-a7cf-47d435983a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:32:55.320400 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6994cf-43a1-4246-a7cf-47d435983a71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:32:55.320744 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6994cf-43a1-4246-a7cf-47d435983a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:32:55.321076 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6994cf-43a1-4246-a7cf-47d435983a71 admin admin] PATH_INFO: `/v3/projects/1ba2e180ad144efbb6e89abbc87a2bbb` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:32:55.322323 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6994cf-43a1-4246-a7cf-47d435983a71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ba2e180ad144efbb6e89abbc87a2bbb)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:32:55.324472 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6994cf-43a1-4246-a7cf-47d435983a71 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:32:55.370923 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-6a6994cf-43a1-4246-a7cf-47d435983a71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ba2e180ad144efbb6e89abbc87a2bbb', 'request_id': 'req-6a6994cf-43a1-4246-a7cf-47d435983a71'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:32:55.376859 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-6a6994cf-43a1-4246-a7cf-47d435983a71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ba2e180ad144efbb6e89abbc87a2bbb', 'request_id': 'req-6a6994cf-43a1-4246-a7cf-47d435983a71'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:32:55.385039 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-6a6994cf-43a1-4246-a7cf-47d435983a71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ba2e180ad144efbb6e89abbc87a2bbb', 'request_id': 'req-6a6994cf-43a1-4246-a7cf-47d435983a71'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:32:55.396240 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-6a6994cf-43a1-4246-a7cf-47d435983a71 admin admin] The token cache is being invalidate because project 1ba2e180ad144efbb6e89abbc87a2bbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:32:55.396530 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-6a6994cf-43a1-4246-a7cf-47d435983a71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:32:55.397161 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-6a6994cf-43a1-4246-a7cf-47d435983a71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:32:55.398651 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1235/2469] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:32:55 2022] DELETE /identity/v3/projects/1ba2e180ad144efbb6e89abbc87a2bbb => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:32:55.408805 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13208cb-3ae1-4beb-88b0-a5addd780b32 service neutron] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:32:55.418421 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13208cb-3ae1-4beb-88b0-a5addd780b32 service neutron] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:32:55.465005 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:32:55.476396 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bfb284-2c4f-4770-8500-cc9339a06d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:32:55.477092 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bfb284-2c4f-4770-8500-cc9339a06d00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:32:55.477583 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bfb284-2c4f-4770-8500-cc9339a06d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:32:55.477854 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bfb284-2c4f-4770-8500-cc9339a06d00 admin admin] PATH_INFO: `/v3/users/682c0ffe8d7e4d9c90491a16089d8f40` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:32:55.479152 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bfb284-2c4f-4770-8500-cc9339a06d00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=682c0ffe8d7e4d9c90491a16089d8f40)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:32:55.481046 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bfb284-2c4f-4770-8500-cc9339a06d00 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:32:55.526440 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-13bfb284-2c4f-4770-8500-cc9339a06d00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '682c0ffe8d7e4d9c90491a16089d8f40'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:32:55.534251 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-13bfb284-2c4f-4770-8500-cc9339a06d00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '682c0ffe8d7e4d9c90491a16089d8f40'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:32:55.534876 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-13bfb284-2c4f-4770-8500-cc9339a06d00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '682c0ffe8d7e4d9c90491a16089d8f40'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:32:55.535474 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-13bfb284-2c4f-4770-8500-cc9339a06d00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '682c0ffe8d7e4d9c90491a16089d8f40'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:32:55.542242 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-13bfb284-2c4f-4770-8500-cc9339a06d00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '682c0ffe8d7e4d9c90491a16089d8f40'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:32:55.559155 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1235/2470] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:32:55 2022] DELETE /identity/v3/users/682c0ffe8d7e4d9c90491a16089d8f40 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:32:55.831073 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6994cf-43a1-4246-a7cf-47d435983a71 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:32:55.832580 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-6a6994cf-43a1-4246-a7cf-47d435983a71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:32:55.850333 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6994cf-43a1-4246-a7cf-47d435983a71 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:32:55.920893 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3cd8af-8b4f-4ee0-9ebe-d966eaba0f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:32:55.921450 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3cd8af-8b4f-4ee0-9ebe-d966eaba0f11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:32:55.921760 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3cd8af-8b4f-4ee0-9ebe-d966eaba0f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:32:55.922572 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3cd8af-8b4f-4ee0-9ebe-d966eaba0f11 admin admin] PATH_INFO: `/v3/projects/308bfc7040514a47865c28f348721dbe` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:32:55.923731 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3cd8af-8b4f-4ee0-9ebe-d966eaba0f11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=308bfc7040514a47865c28f348721dbe)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:32:55.925623 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3cd8af-8b4f-4ee0-9ebe-d966eaba0f11 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:32:55.967095 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:32:55.975881 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-2f3cd8af-8b4f-4ee0-9ebe-d966eaba0f11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '308bfc7040514a47865c28f348721dbe', 'request_id': 'req-2f3cd8af-8b4f-4ee0-9ebe-d966eaba0f11'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:32:55.982482 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-2f3cd8af-8b4f-4ee0-9ebe-d966eaba0f11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '308bfc7040514a47865c28f348721dbe', 'request_id': 'req-2f3cd8af-8b4f-4ee0-9ebe-d966eaba0f11'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:32:55.993397 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-2f3cd8af-8b4f-4ee0-9ebe-d966eaba0f11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '308bfc7040514a47865c28f348721dbe', 'request_id': 'req-2f3cd8af-8b4f-4ee0-9ebe-d966eaba0f11'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:32:56.005827 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-2f3cd8af-8b4f-4ee0-9ebe-d966eaba0f11 admin admin] The token cache is being invalidate because project 308bfc7040514a47865c28f348721dbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:32:56.006053 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-2f3cd8af-8b4f-4ee0-9ebe-d966eaba0f11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:32:56.006714 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-2f3cd8af-8b4f-4ee0-9ebe-d966eaba0f11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:32:56.008212 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1236/2471] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:32:55 2022] DELETE /identity/v3/projects/308bfc7040514a47865c28f348721dbe => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:32:56.013778 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5faaf1-9073-4197-8138-d68000374005 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:32:56.014235 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5faaf1-9073-4197-8138-d68000374005 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:32:56.014442 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5faaf1-9073-4197-8138-d68000374005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:32:56.035324 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-4e5faaf1-9073-4197-8138-d68000374005 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:32:56.036588 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-4e5faaf1-9073-4197-8138-d68000374005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:32:56.108552 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1236/2472] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:32:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:32:56.117658 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13515e09-e7ff-48a4-85d2-4882f38a62ae None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:32:56.117945 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13515e09-e7ff-48a4-85d2-4882f38a62ae None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:32:56.118221 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13515e09-e7ff-48a4-85d2-4882f38a62ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:32:56.137919 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-13515e09-e7ff-48a4-85d2-4882f38a62ae None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:32:56.139149 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-13515e09-e7ff-48a4-85d2-4882f38a62ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:32:56.147512 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1237/2473] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:32:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:32:56.152856 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5faaf1-9073-4197-8138-d68000374005 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:32:56.163302 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5faaf1-9073-4197-8138-d68000374005 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:32:56.167905 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ecc959-b642-42b2-9b1c-7aff9ae91db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:32:56.168502 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ecc959-b642-42b2-9b1c-7aff9ae91db5 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:32:56.168779 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ecc959-b642-42b2-9b1c-7aff9ae91db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:32:56.169048 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ecc959-b642-42b2-9b1c-7aff9ae91db5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:32:56.169695 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ecc959-b642-42b2-9b1c-7aff9ae91db5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:32:56.169996 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ecc959-b642-42b2-9b1c-7aff9ae91db5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:32:56.171662 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ecc959-b642-42b2-9b1c-7aff9ae91db5 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:32:56.183197 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1237/2474] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 15 12:32:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:32:56.187508 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13515e09-e7ff-48a4-85d2-4882f38a62ae None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:32:56.197599 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13515e09-e7ff-48a4-85d2-4882f38a62ae None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:32:56.202167 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab75cef-8cb8-480f-b04a-55866284e388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:32:56.202794 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab75cef-8cb8-480f-b04a-55866284e388 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:32:56.203073 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab75cef-8cb8-480f-b04a-55866284e388 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:32:56.203844 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab75cef-8cb8-480f-b04a-55866284e388 admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:32:56.204465 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab75cef-8cb8-480f-b04a-55866284e388 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:32:56.206342 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab75cef-8cb8-480f-b04a-55866284e388 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:32:56.234014 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1238/2475] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:32:56 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:32:56.238120 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ecc959-b642-42b2-9b1c-7aff9ae91db5 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:32:56.248076 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ecc959-b642-42b2-9b1c-7aff9ae91db5 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:32:56.298449 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:32:56.305331 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0856578-77bf-47f5-89d1-403e055ae9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:32:56.306015 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0856578-77bf-47f5-89d1-403e055ae9b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:32:56.306456 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0856578-77bf-47f5-89d1-403e055ae9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:32:56.306795 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0856578-77bf-47f5-89d1-403e055ae9b6 admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:32:56.307720 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0856578-77bf-47f5-89d1-403e055ae9b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:32:56.309794 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0856578-77bf-47f5-89d1-403e055ae9b6 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:32:56.331728 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1238/2476] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:32:56 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:32:56.336101 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab75cef-8cb8-480f-b04a-55866284e388 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:32:56.345996 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab75cef-8cb8-480f-b04a-55866284e388 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:32:56.350904 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc70caaf-9661-4845-974a-1a8561409578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:32:56.351514 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70caaf-9661-4845-974a-1a8561409578 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:32:56.351790 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70caaf-9661-4845-974a-1a8561409578 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:32:56.352064 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70caaf-9661-4845-974a-1a8561409578 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:32:56.352707 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc70caaf-9661-4845-974a-1a8561409578 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:32:56.355248 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc70caaf-9661-4845-974a-1a8561409578 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:32:56.369470 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1239/2477] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:32:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:32:56.374304 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0856578-77bf-47f5-89d1-403e055ae9b6 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:32:56.388395 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0856578-77bf-47f5-89d1-403e055ae9b6 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:32:56.394371 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e459c1ac-67ea-4625-ba2d-166ef4ad7270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:32:56.395028 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e459c1ac-67ea-4625-ba2d-166ef4ad7270 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:32:56.395313 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e459c1ac-67ea-4625-ba2d-166ef4ad7270 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:32:56.395583 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e459c1ac-67ea-4625-ba2d-166ef4ad7270 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:32:56.396357 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e459c1ac-67ea-4625-ba2d-166ef4ad7270 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:32:56.398943 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e459c1ac-67ea-4625-ba2d-166ef4ad7270 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:32:56.410872 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1239/2478] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:32:56 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:32:56.415012 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc70caaf-9661-4845-974a-1a8561409578 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:32:56.425389 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc70caaf-9661-4845-974a-1a8561409578 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:32:56.430062 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4da80e0-49a4-40e6-b7a6-54111ccf81b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:32:56.430753 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4da80e0-49a4-40e6-b7a6-54111ccf81b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:32:56.431030 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4da80e0-49a4-40e6-b7a6-54111ccf81b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:32:56.431292 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4da80e0-49a4-40e6-b7a6-54111ccf81b6 admin admin] PATH_INFO: `/v3/projects/2d2aca09750142f4afccf2e2290ca6df/users/5d5de2ddb1f14ab288611d024e04c45d/roles/9371e5bbc55848949eb951a815f817f2` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:32:56.447332 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4da80e0-49a4-40e6-b7a6-54111ccf81b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d2aca09750142f4afccf2e2290ca6df, user_id=5d5de2ddb1f14ab288611d024e04c45d, role_id=9371e5bbc55848949eb951a815f817f2)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:32:56.450000 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4da80e0-49a4-40e6-b7a6-54111ccf81b6 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:32:56.464367 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1240/2479] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:32:56 2022] PUT /identity/v3/projects/2d2aca09750142f4afccf2e2290ca6df/users/5d5de2ddb1f14ab288611d024e04c45d/roles/9371e5bbc55848949eb951a815f817f2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:32:56.475455 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7314e168-410e-41ef-ba55-ce2689acba13 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:32:56.475743 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7314e168-410e-41ef-ba55-ce2689acba13 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:32:56.476012 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7314e168-410e-41ef-ba55-ce2689acba13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:32:56.505307 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-7314e168-410e-41ef-ba55-ce2689acba13 None None] MFA Rules not processed for user `5d5de2ddb1f14ab288611d024e04c45d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:32:56.506513 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-7314e168-410e-41ef-ba55-ce2689acba13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:32:56.570324 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1240/2480] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:32:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:32:56.574987 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4da80e0-49a4-40e6-b7a6-54111ccf81b6 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:32:56.636755 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4da80e0-49a4-40e6-b7a6-54111ccf81b6 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:32:56.641963 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94264430-b630-4ab1-a0b7-0139a5e14123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:32:56.642571 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94264430-b630-4ab1-a0b7-0139a5e14123 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:32:56.642882 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94264430-b630-4ab1-a0b7-0139a5e14123 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:32:56.643156 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94264430-b630-4ab1-a0b7-0139a5e14123 admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:32:56.643818 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94264430-b630-4ab1-a0b7-0139a5e14123 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:32:56.645733 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94264430-b630-4ab1-a0b7-0139a5e14123 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:32:56.673284 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1241/2481] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:32:56 2022] POST /identity/v3/projects => generated 375 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:32:56.677687 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7314e168-410e-41ef-ba55-ce2689acba13 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:32:56.688394 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7314e168-410e-41ef-ba55-ce2689acba13 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:32:56.745701 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf99f30-c313-469c-8963-f1be54b3c67d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:32:56.746315 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf99f30-c313-469c-8963-f1be54b3c67d admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:32:56.746714 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf99f30-c313-469c-8963-f1be54b3c67d admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:32:56.746897 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf99f30-c313-469c-8963-f1be54b3c67d admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:32:56.747540 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf99f30-c313-469c-8963-f1be54b3c67d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:32:56.749620 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf99f30-c313-469c-8963-f1be54b3c67d admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:32:56.776009 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1241/2482] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:32:56 2022] POST /identity/v3/users => generated 294 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 12:32:56.780626 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94264430-b630-4ab1-a0b7-0139a5e14123 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:32:56.795516 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94264430-b630-4ab1-a0b7-0139a5e14123 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:32:56.801763 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b76d25-d005-4e38-bacb-014e38afdc8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:32:56.802371 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b76d25-d005-4e38-bacb-014e38afdc8c admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:32:56.802639 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b76d25-d005-4e38-bacb-014e38afdc8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:32:56.802931 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b76d25-d005-4e38-bacb-014e38afdc8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:32:56.803565 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b76d25-d005-4e38-bacb-014e38afdc8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:32:56.805150 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b76d25-d005-4e38-bacb-014e38afdc8c admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:32:56.815421 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1242/2483] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:32:56 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:32:56.819581 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf99f30-c313-469c-8963-f1be54b3c67d admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:32:56.829713 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf99f30-c313-469c-8963-f1be54b3c67d admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:32:56.834198 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0296f7ec-4e5a-4aa1-9b75-687daf016eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:32:56.834878 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296f7ec-4e5a-4aa1-9b75-687daf016eaf admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:32:56.835157 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296f7ec-4e5a-4aa1-9b75-687daf016eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:32:56.835429 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296f7ec-4e5a-4aa1-9b75-687daf016eaf admin admin] PATH_INFO: `/v3/projects/72690527233c4734ae32ed478876874a/users/61822112c65a405ab52a712d5adbda0f/roles/7f53f1c823b746529ba5057bf21b2477` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:32:56.850383 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0296f7ec-4e5a-4aa1-9b75-687daf016eaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=72690527233c4734ae32ed478876874a, user_id=61822112c65a405ab52a712d5adbda0f, role_id=7f53f1c823b746529ba5057bf21b2477)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:32:56.853017 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0296f7ec-4e5a-4aa1-9b75-687daf016eaf admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:32:56.865195 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1242/2484] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:32:56 2022] PUT /identity/v3/projects/72690527233c4734ae32ed478876874a/users/61822112c65a405ab52a712d5adbda0f/roles/7f53f1c823b746529ba5057bf21b2477 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:32:56.869020 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b76d25-d005-4e38-bacb-014e38afdc8c admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:32:56.879119 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b76d25-d005-4e38-bacb-014e38afdc8c admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:32:56.916653 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:32:56.936470 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa06c92-c60f-4ce3-a21b-cb3020e6682e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:32:56.937073 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa06c92-c60f-4ce3-a21b-cb3020e6682e admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:32:56.937354 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa06c92-c60f-4ce3-a21b-cb3020e6682e admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:32:56.937621 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa06c92-c60f-4ce3-a21b-cb3020e6682e admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:32:56.938253 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa06c92-c60f-4ce3-a21b-cb3020e6682e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:32:56.939867 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa06c92-c60f-4ce3-a21b-cb3020e6682e admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:32:56.949524 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1243/2485] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:32:56 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:32:56.954122 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0296f7ec-4e5a-4aa1-9b75-687daf016eaf admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:32:56.964323 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0296f7ec-4e5a-4aa1-9b75-687daf016eaf admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:32:56.969455 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90422a63-7e4f-4dc2-acc2-6ce055a06ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:32:56.970105 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90422a63-7e4f-4dc2-acc2-6ce055a06ad2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:32:56.970381 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90422a63-7e4f-4dc2-acc2-6ce055a06ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:32:56.970651 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90422a63-7e4f-4dc2-acc2-6ce055a06ad2 admin admin] PATH_INFO: `/v3/projects/72690527233c4734ae32ed478876874a/users/61822112c65a405ab52a712d5adbda0f/roles/7f53f1c823b746529ba5057bf21b2477` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:32:56.972575 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90422a63-7e4f-4dc2-acc2-6ce055a06ad2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72690527233c4734ae32ed478876874a, user_id=61822112c65a405ab52a712d5adbda0f, role_id=7f53f1c823b746529ba5057bf21b2477)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:32:56.975228 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90422a63-7e4f-4dc2-acc2-6ce055a06ad2 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:32:56.985625 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1243/2486] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:32:56 2022] PUT /identity/v3/projects/72690527233c4734ae32ed478876874a/users/61822112c65a405ab52a712d5adbda0f/roles/7f53f1c823b746529ba5057bf21b2477 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:32:56.995863 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ccb8c1-a411-4b45-8dea-11a77fe370ba None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:32:56.996154 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ccb8c1-a411-4b45-8dea-11a77fe370ba None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:32:56.996433 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ccb8c1-a411-4b45-8dea-11a77fe370ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:32:57.024788 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-e0ccb8c1-a411-4b45-8dea-11a77fe370ba None None] MFA Rules not processed for user `61822112c65a405ab52a712d5adbda0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:32:57.025990 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-e0ccb8c1-a411-4b45-8dea-11a77fe370ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:32:57.098959 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1244/2487] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:32:56 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:32:57.110768 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90422a63-7e4f-4dc2-acc2-6ce055a06ad2 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:32:57.112493 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-90422a63-7e4f-4dc2-acc2-6ce055a06ad2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:32:57.133525 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:32:57.170880 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90422a63-7e4f-4dc2-acc2-6ce055a06ad2 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:32:57.174467 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cba7b7-1290-40ba-a6fa-d8b95e7b05eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceafc5e4283841528053f01931f10293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:32:57.175097 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cba7b7-1290-40ba-a6fa-d8b95e7b05eb service cinder] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:32:57.175377 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cba7b7-1290-40ba-a6fa-d8b95e7b05eb service cinder] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:32:57.175648 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cba7b7-1290-40ba-a6fa-d8b95e7b05eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:32:57.236593 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cba7b7-1290-40ba-a6fa-d8b95e7b05eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:32:57.237936 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cba7b7-1290-40ba-a6fa-d8b95e7b05eb service cinder] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:32:57.246653 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1244/2488] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:32:57 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:32:59.836363 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ccb8c1-a411-4b45-8dea-11a77fe370ba None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:32:59.846455 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ccb8c1-a411-4b45-8dea-11a77fe370ba None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:32:59.850029 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5538896c-e92b-48eb-a803-abc9b74039dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceafc5e4283841528053f01931f10293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:32:59.850619 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5538896c-e92b-48eb-a803-abc9b74039dd service cinder] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:32:59.850934 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5538896c-e92b-48eb-a803-abc9b74039dd service cinder] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:32:59.851204 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5538896c-e92b-48eb-a803-abc9b74039dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:32:59.859938 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5538896c-e92b-48eb-a803-abc9b74039dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:32:59.861387 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5538896c-e92b-48eb-a803-abc9b74039dd service cinder] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:32:59.870529 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1245/2489] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:32:59 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:33:00.208700 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c799f9-a055-45c0-af23-1a6f2f0b59b7 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:00.209245 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c799f9-a055-45c0-af23-1a6f2f0b59b7 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:00.209415 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c799f9-a055-45c0-af23-1a6f2f0b59b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:00.229502 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-77c799f9-a055-45c0-af23-1a6f2f0b59b7 None None] MFA Rules not processed for user `b4614bede59c47ea813a73fcc0840a2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:33:00.230777 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-77c799f9-a055-45c0-af23-1a6f2f0b59b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:00.287127 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1245/2490] 10.222.0.16 () {58 vars in 967 bytes} [Thu Sep 15 12:33:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:33:00.299467 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5538896c-e92b-48eb-a803-abc9b74039dd service cinder] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:00.300885 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-5538896c-e92b-48eb-a803-abc9b74039dd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:00.368547 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5538896c-e92b-48eb-a803-abc9b74039dd service cinder] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:00.373327 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eeb11d-822f-47e8-acaf-abec7713f130 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee33b730d0ec428ca2cd3af4ebf723e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:00.373914 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eeb11d-822f-47e8-acaf-abec7713f130 service swift] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:00.374186 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eeb11d-822f-47e8-acaf-abec7713f130 service swift] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:00.374450 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eeb11d-822f-47e8-acaf-abec7713f130 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:00.383165 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eeb11d-822f-47e8-acaf-abec7713f130 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:00.384719 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eeb11d-822f-47e8-acaf-abec7713f130 service swift] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:00.392447 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1246/2491] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Sep 15 12:33:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 12:33:10.280498 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=65 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:33:10.389270 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=83 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:33:12.371541 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c799f9-a055-45c0-af23-1a6f2f0b59b7 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:12.445170 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c799f9-a055-45c0-af23-1a6f2f0b59b7 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:12.449925 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb1cac3-b9e9-4f57-8436-c0ebf4e9fa5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:12.450573 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb1cac3-b9e9-4f57-8436-c0ebf4e9fa5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:12.450900 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb1cac3-b9e9-4f57-8436-c0ebf4e9fa5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:12.451191 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb1cac3-b9e9-4f57-8436-c0ebf4e9fa5f admin admin] PATH_INFO: `/v3/users/5d5de2ddb1f14ab288611d024e04c45d` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:12.452386 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb1cac3-b9e9-4f57-8436-c0ebf4e9fa5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d5de2ddb1f14ab288611d024e04c45d)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:12.454394 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb1cac3-b9e9-4f57-8436-c0ebf4e9fa5f admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:12.502681 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-7eb1cac3-b9e9-4f57-8436-c0ebf4e9fa5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d5de2ddb1f14ab288611d024e04c45d'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:12.509748 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-7eb1cac3-b9e9-4f57-8436-c0ebf4e9fa5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d5de2ddb1f14ab288611d024e04c45d'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:12.510364 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-7eb1cac3-b9e9-4f57-8436-c0ebf4e9fa5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d5de2ddb1f14ab288611d024e04c45d'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:12.510997 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-7eb1cac3-b9e9-4f57-8436-c0ebf4e9fa5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d5de2ddb1f14ab288611d024e04c45d'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:12.517923 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-7eb1cac3-b9e9-4f57-8436-c0ebf4e9fa5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d5de2ddb1f14ab288611d024e04c45d'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:12.535709 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1246/2492] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:33:12 2022] DELETE /identity/v3/users/5d5de2ddb1f14ab288611d024e04c45d => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:33:12.540202 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd3039-33e8-48c1-8138-eab4bc62a3e4 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:12.540701 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd3039-33e8-48c1-8138-eab4bc62a3e4 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:12.540818 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd3039-33e8-48c1-8138-eab4bc62a3e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:12.559983 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-f9dd3039-33e8-48c1-8138-eab4bc62a3e4 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:33:12.561171 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-f9dd3039-33e8-48c1-8138-eab4bc62a3e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:12.618739 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1247/2493] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:33:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:33:12.628950 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb1cac3-b9e9-4f57-8436-c0ebf4e9fa5f admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:12.630460 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-7eb1cac3-b9e9-4f57-8436-c0ebf4e9fa5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:12.691555 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb1cac3-b9e9-4f57-8436-c0ebf4e9fa5f admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:12.695448 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5fb288-55ed-40cb-9824-5463809f3bb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:12.696057 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5fb288-55ed-40cb-9824-5463809f3bb5 service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:12.696339 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5fb288-55ed-40cb-9824-5463809f3bb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:12.696611 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5fb288-55ed-40cb-9824-5463809f3bb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:12.705540 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5fb288-55ed-40cb-9824-5463809f3bb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:12.707600 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5fb288-55ed-40cb-9824-5463809f3bb5 service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:12.716910 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1247/2494] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:33:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:33:13.002654 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dd3039-33e8-48c1-8138-eab4bc62a3e4 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:13.004944 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-f9dd3039-33e8-48c1-8138-eab4bc62a3e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:13.017182 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dd3039-33e8-48c1-8138-eab4bc62a3e4 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:13.022405 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d12d5-44c4-4f71-b232-4b8fc9f7acea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:13.023192 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d12d5-44c4-4f71-b232-4b8fc9f7acea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:13.023468 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d12d5-44c4-4f71-b232-4b8fc9f7acea admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:13.023736 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d12d5-44c4-4f71-b232-4b8fc9f7acea admin admin] PATH_INFO: `/v3/projects/2d2aca09750142f4afccf2e2290ca6df` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:13.024848 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85d12d5-44c4-4f71-b232-4b8fc9f7acea admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d2aca09750142f4afccf2e2290ca6df)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:13.026784 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85d12d5-44c4-4f71-b232-4b8fc9f7acea admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:13.089217 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-a85d12d5-44c4-4f71-b232-4b8fc9f7acea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d2aca09750142f4afccf2e2290ca6df', 'request_id': 'req-a85d12d5-44c4-4f71-b232-4b8fc9f7acea'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:13.094834 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-a85d12d5-44c4-4f71-b232-4b8fc9f7acea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d2aca09750142f4afccf2e2290ca6df', 'request_id': 'req-a85d12d5-44c4-4f71-b232-4b8fc9f7acea'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:13.105696 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-a85d12d5-44c4-4f71-b232-4b8fc9f7acea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d2aca09750142f4afccf2e2290ca6df', 'request_id': 'req-a85d12d5-44c4-4f71-b232-4b8fc9f7acea'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:13.118119 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-a85d12d5-44c4-4f71-b232-4b8fc9f7acea admin admin] The token cache is being invalidate because project 2d2aca09750142f4afccf2e2290ca6df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:33:13.118404 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-a85d12d5-44c4-4f71-b232-4b8fc9f7acea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:13.119112 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-a85d12d5-44c4-4f71-b232-4b8fc9f7acea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:13.120654 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1248/2495] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:33:13 2022] DELETE /identity/v3/projects/2d2aca09750142f4afccf2e2290ca6df => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:33:13.124778 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5fb288-55ed-40cb-9824-5463809f3bb5 service neutron] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:13.135207 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5fb288-55ed-40cb-9824-5463809f3bb5 service neutron] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:13.152953 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:33:13.194558 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4458e7d9-fd2c-44c7-ac20-ce681d8b0250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:13.195335 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4458e7d9-fd2c-44c7-ac20-ce681d8b0250 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:13.195618 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4458e7d9-fd2c-44c7-ac20-ce681d8b0250 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:13.195890 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4458e7d9-fd2c-44c7-ac20-ce681d8b0250 admin admin] PATH_INFO: `/v3/users/61822112c65a405ab52a712d5adbda0f` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:13.197022 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4458e7d9-fd2c-44c7-ac20-ce681d8b0250 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61822112c65a405ab52a712d5adbda0f)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:13.200662 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4458e7d9-fd2c-44c7-ac20-ce681d8b0250 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:13.251013 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-4458e7d9-fd2c-44c7-ac20-ce681d8b0250 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61822112c65a405ab52a712d5adbda0f'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:13.260431 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-4458e7d9-fd2c-44c7-ac20-ce681d8b0250 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61822112c65a405ab52a712d5adbda0f'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:13.261161 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-4458e7d9-fd2c-44c7-ac20-ce681d8b0250 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61822112c65a405ab52a712d5adbda0f'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:13.261879 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-4458e7d9-fd2c-44c7-ac20-ce681d8b0250 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61822112c65a405ab52a712d5adbda0f'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:13.271157 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-4458e7d9-fd2c-44c7-ac20-ce681d8b0250 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61822112c65a405ab52a712d5adbda0f'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:13.289050 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1248/2496] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:33:13 2022] DELETE /identity/v3/users/61822112c65a405ab52a712d5adbda0f => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:33:13.574958 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d12d5-44c4-4f71-b232-4b8fc9f7acea admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:13.576499 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-a85d12d5-44c4-4f71-b232-4b8fc9f7acea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:13.592571 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d12d5-44c4-4f71-b232-4b8fc9f7acea admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:13.651499 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e538bae2-a47d-4b6c-93a8-6c94b6247e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:13.652042 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e538bae2-a47d-4b6c-93a8-6c94b6247e8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:13.652317 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e538bae2-a47d-4b6c-93a8-6c94b6247e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:13.652582 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e538bae2-a47d-4b6c-93a8-6c94b6247e8b admin admin] PATH_INFO: `/v3/projects/72690527233c4734ae32ed478876874a` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:13.653679 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e538bae2-a47d-4b6c-93a8-6c94b6247e8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=72690527233c4734ae32ed478876874a)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:13.655672 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e538bae2-a47d-4b6c-93a8-6c94b6247e8b admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:13.687481 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:33:13.704971 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-e538bae2-a47d-4b6c-93a8-6c94b6247e8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72690527233c4734ae32ed478876874a', 'request_id': 'req-e538bae2-a47d-4b6c-93a8-6c94b6247e8b'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:13.710531 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-e538bae2-a47d-4b6c-93a8-6c94b6247e8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72690527233c4734ae32ed478876874a', 'request_id': 'req-e538bae2-a47d-4b6c-93a8-6c94b6247e8b'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:13.717934 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-e538bae2-a47d-4b6c-93a8-6c94b6247e8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72690527233c4734ae32ed478876874a', 'request_id': 'req-e538bae2-a47d-4b6c-93a8-6c94b6247e8b'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:13.729381 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-e538bae2-a47d-4b6c-93a8-6c94b6247e8b admin admin] The token cache is being invalidate because project 72690527233c4734ae32ed478876874a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:33:13.729664 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-e538bae2-a47d-4b6c-93a8-6c94b6247e8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:13.730311 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-e538bae2-a47d-4b6c-93a8-6c94b6247e8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:13.731791 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1249/2497] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:33:13 2022] DELETE /identity/v3/projects/72690527233c4734ae32ed478876874a => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:33:13.738037 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7406b5-9c32-42f9-8dec-d0011a65dec9 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:13.738516 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7406b5-9c32-42f9-8dec-d0011a65dec9 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:13.738610 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7406b5-9c32-42f9-8dec-d0011a65dec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:13.759465 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-0e7406b5-9c32-42f9-8dec-d0011a65dec9 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:33:13.760739 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-0e7406b5-9c32-42f9-8dec-d0011a65dec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:13.820187 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1249/2498] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:33:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:33:13.828241 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ca7c7-18e0-43bc-a5f1-07c74b4ae110 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:13.828525 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ca7c7-18e0-43bc-a5f1-07c74b4ae110 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:13.828794 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ca7c7-18e0-43bc-a5f1-07c74b4ae110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:13.849021 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-7e6ca7c7-18e0-43bc-a5f1-07c74b4ae110 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:33:13.850194 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-7e6ca7c7-18e0-43bc-a5f1-07c74b4ae110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:13.857941 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1250/2499] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:33:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:33:13.862090 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7406b5-9c32-42f9-8dec-d0011a65dec9 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:13.871901 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7406b5-9c32-42f9-8dec-d0011a65dec9 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:13.876967 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba1f3b2-39c2-4425-a6ca-8755ca347172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:13.877340 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba1f3b2-39c2-4425-a6ca-8755ca347172 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:13.877648 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba1f3b2-39c2-4425-a6ca-8755ca347172 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:13.877920 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba1f3b2-39c2-4425-a6ca-8755ca347172 admin admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:13.878589 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba1f3b2-39c2-4425-a6ca-8755ca347172 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:33:13.878926 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba1f3b2-39c2-4425-a6ca-8755ca347172 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:13.880511 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba1f3b2-39c2-4425-a6ca-8755ca347172 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:13.892148 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1250/2500] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 15 12:33:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:33:13.896962 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6ca7c7-18e0-43bc-a5f1-07c74b4ae110 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:13.906470 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6ca7c7-18e0-43bc-a5f1-07c74b4ae110 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:13.912100 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6287f314-668e-4189-8923-add237736845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:13.912732 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6287f314-668e-4189-8923-add237736845 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:13.913034 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6287f314-668e-4189-8923-add237736845 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:13.913320 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6287f314-668e-4189-8923-add237736845 admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:13.914043 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6287f314-668e-4189-8923-add237736845 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:13.916119 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6287f314-668e-4189-8923-add237736845 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:13.943528 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1251/2501] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:33:13 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:33:13.947717 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba1f3b2-39c2-4425-a6ca-8755ca347172 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:13.958246 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba1f3b2-39c2-4425-a6ca-8755ca347172 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:13.986052 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:33:14.020659 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e8c1b8-4bea-4752-a8eb-2b096cb67e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:14.021256 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e8c1b8-4bea-4752-a8eb-2b096cb67e01 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:14.021533 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e8c1b8-4bea-4752-a8eb-2b096cb67e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:14.021803 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e8c1b8-4bea-4752-a8eb-2b096cb67e01 admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:14.022432 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e8c1b8-4bea-4752-a8eb-2b096cb67e01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:14.024411 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e8c1b8-4bea-4752-a8eb-2b096cb67e01 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:14.046660 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1251/2502] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:33:13 2022] POST /identity/v3/users => generated 290 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:33:14.051292 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6287f314-668e-4189-8923-add237736845 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:14.062432 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6287f314-668e-4189-8923-add237736845 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:14.067657 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6232d2b2-71d4-4059-b598-b2de2d3670cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:14.068243 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6232d2b2-71d4-4059-b598-b2de2d3670cd admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:14.068515 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6232d2b2-71d4-4059-b598-b2de2d3670cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:14.068780 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6232d2b2-71d4-4059-b598-b2de2d3670cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:14.069408 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6232d2b2-71d4-4059-b598-b2de2d3670cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:14.071018 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6232d2b2-71d4-4059-b598-b2de2d3670cd admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:14.080647 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1252/2503] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:33:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:33:14.084595 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e8c1b8-4bea-4752-a8eb-2b096cb67e01 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:14.096908 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e8c1b8-4bea-4752-a8eb-2b096cb67e01 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:14.101593 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b689552a-ad13-460f-b17e-d82f9f8573ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:14.102217 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b689552a-ad13-460f-b17e-d82f9f8573ac admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:14.102496 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b689552a-ad13-460f-b17e-d82f9f8573ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:14.102804 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b689552a-ad13-460f-b17e-d82f9f8573ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:14.103448 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b689552a-ad13-460f-b17e-d82f9f8573ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:14.105037 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b689552a-ad13-460f-b17e-d82f9f8573ac admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:14.116457 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1252/2504] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:33:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 12:33:14.120617 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6232d2b2-71d4-4059-b598-b2de2d3670cd admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:14.131253 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6232d2b2-71d4-4059-b598-b2de2d3670cd admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:14.135762 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7030cced-97b0-4959-8ff9-87f1d92a9e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:14.136397 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7030cced-97b0-4959-8ff9-87f1d92a9e56 admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:14.136671 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7030cced-97b0-4959-8ff9-87f1d92a9e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:14.136940 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7030cced-97b0-4959-8ff9-87f1d92a9e56 admin admin] PATH_INFO: `/v3/projects/c416786624804fcab0d37a2d8609e814/users/0e619301903746d2a6068da3aace3647/roles/9371e5bbc55848949eb951a815f817f2` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:14.150956 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7030cced-97b0-4959-8ff9-87f1d92a9e56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c416786624804fcab0d37a2d8609e814, user_id=0e619301903746d2a6068da3aace3647, role_id=9371e5bbc55848949eb951a815f817f2)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:14.153556 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7030cced-97b0-4959-8ff9-87f1d92a9e56 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:14.166051 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1253/2505] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:33:14 2022] PUT /identity/v3/projects/c416786624804fcab0d37a2d8609e814/users/0e619301903746d2a6068da3aace3647/roles/9371e5bbc55848949eb951a815f817f2 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:33:14.176556 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ba386-696a-4b7a-897d-e1003e9be302 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:14.176925 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ba386-696a-4b7a-897d-e1003e9be302 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:14.177200 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ba386-696a-4b7a-897d-e1003e9be302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:14.206313 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-577ba386-696a-4b7a-897d-e1003e9be302 None None] MFA Rules not processed for user `0e619301903746d2a6068da3aace3647`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:33:14.207556 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-577ba386-696a-4b7a-897d-e1003e9be302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:14.269662 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1253/2506] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:33:14 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:33:14.274077 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7030cced-97b0-4959-8ff9-87f1d92a9e56 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:14.336328 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7030cced-97b0-4959-8ff9-87f1d92a9e56 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:14.341238 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b325ce4b-b65b-47d0-8d69-e6f788a660b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:14.341896 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b325ce4b-b65b-47d0-8d69-e6f788a660b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:14.342208 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b325ce4b-b65b-47d0-8d69-e6f788a660b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:14.342529 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b325ce4b-b65b-47d0-8d69-e6f788a660b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:14.343484 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b325ce4b-b65b-47d0-8d69-e6f788a660b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:14.345493 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b325ce4b-b65b-47d0-8d69-e6f788a660b9 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:14.373657 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1254/2507] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:33:14 2022] POST /identity/v3/projects => generated 377 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:33:14.378139 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577ba386-696a-4b7a-897d-e1003e9be302 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:14.389444 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577ba386-696a-4b7a-897d-e1003e9be302 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:14.450498 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb78132a-bb76-4bc9-bcc3-b29ec171975a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:14.451226 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78132a-bb76-4bc9-bcc3-b29ec171975a admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:14.451557 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78132a-bb76-4bc9-bcc3-b29ec171975a admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:14.451837 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78132a-bb76-4bc9-bcc3-b29ec171975a admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:14.452518 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb78132a-bb76-4bc9-bcc3-b29ec171975a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:14.454449 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb78132a-bb76-4bc9-bcc3-b29ec171975a admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:14.480918 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1254/2508] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:33:14 2022] POST /identity/v3/users => generated 295 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:33:14.482343 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b325ce4b-b65b-47d0-8d69-e6f788a660b9 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:14.494015 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b325ce4b-b65b-47d0-8d69-e6f788a660b9 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:14.499605 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a530c718-0045-4584-8f01-6ba83c54473f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:14.500215 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a530c718-0045-4584-8f01-6ba83c54473f admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:14.500490 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a530c718-0045-4584-8f01-6ba83c54473f admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:14.500761 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a530c718-0045-4584-8f01-6ba83c54473f admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:14.501718 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a530c718-0045-4584-8f01-6ba83c54473f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:14.503513 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a530c718-0045-4584-8f01-6ba83c54473f admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:14.514280 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1255/2509] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:33:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:33:14.518565 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb78132a-bb76-4bc9-bcc3-b29ec171975a admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:14.529544 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb78132a-bb76-4bc9-bcc3-b29ec171975a admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:14.535210 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818809cb-76f0-4d9c-8bad-2a58ac4566f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:14.535958 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818809cb-76f0-4d9c-8bad-2a58ac4566f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:14.536239 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818809cb-76f0-4d9c-8bad-2a58ac4566f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:14.536512 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818809cb-76f0-4d9c-8bad-2a58ac4566f2 admin admin] PATH_INFO: `/v3/projects/840ce3a4c8724030b7f556e246ffe010/users/b2cf237346214186badbf4b7d5a3b62a/roles/7f53f1c823b746529ba5057bf21b2477` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:14.553625 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818809cb-76f0-4d9c-8bad-2a58ac4566f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=840ce3a4c8724030b7f556e246ffe010, user_id=b2cf237346214186badbf4b7d5a3b62a, role_id=7f53f1c823b746529ba5057bf21b2477)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:14.556651 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818809cb-76f0-4d9c-8bad-2a58ac4566f2 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:14.571629 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1255/2510] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:33:14 2022] PUT /identity/v3/projects/840ce3a4c8724030b7f556e246ffe010/users/b2cf237346214186badbf4b7d5a3b62a/roles/7f53f1c823b746529ba5057bf21b2477 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:33:14.575772 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a530c718-0045-4584-8f01-6ba83c54473f admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:14.587430 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a530c718-0045-4584-8f01-6ba83c54473f admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:14.611454 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:33:14.661495 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a1de1b-5f8b-461f-857a-a9a6ef4450b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:14.662099 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a1de1b-5f8b-461f-857a-a9a6ef4450b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:14.662373 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a1de1b-5f8b-461f-857a-a9a6ef4450b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:14.662641 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a1de1b-5f8b-461f-857a-a9a6ef4450b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:14.663302 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a1de1b-5f8b-461f-857a-a9a6ef4450b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:14.664896 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a1de1b-5f8b-461f-857a-a9a6ef4450b4 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:14.674796 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1256/2511] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:33:14 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 12:33:14.678876 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818809cb-76f0-4d9c-8bad-2a58ac4566f2 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:14.684264 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:33:14.691359 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818809cb-76f0-4d9c-8bad-2a58ac4566f2 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:14.696271 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1449ea0f-08a6-4fd8-81e0-748ecd033a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:14.696913 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1449ea0f-08a6-4fd8-81e0-748ecd033a4c admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:14.697322 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1449ea0f-08a6-4fd8-81e0-748ecd033a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:14.697702 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1449ea0f-08a6-4fd8-81e0-748ecd033a4c admin admin] PATH_INFO: `/v3/projects/840ce3a4c8724030b7f556e246ffe010/users/b2cf237346214186badbf4b7d5a3b62a/roles/7f53f1c823b746529ba5057bf21b2477` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:14.699649 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1449ea0f-08a6-4fd8-81e0-748ecd033a4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=840ce3a4c8724030b7f556e246ffe010, user_id=b2cf237346214186badbf4b7d5a3b62a, role_id=7f53f1c823b746529ba5057bf21b2477)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:14.702335 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1449ea0f-08a6-4fd8-81e0-748ecd033a4c admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:14.714535 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1256/2512] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:33:14 2022] PUT /identity/v3/projects/840ce3a4c8724030b7f556e246ffe010/users/b2cf237346214186badbf4b7d5a3b62a/roles/7f53f1c823b746529ba5057bf21b2477 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:33:14.726896 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8828e840-b738-4c93-a39e-7381bfe591be None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:14.727189 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8828e840-b738-4c93-a39e-7381bfe591be None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:14.727458 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8828e840-b738-4c93-a39e-7381bfe591be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:14.757757 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-8828e840-b738-4c93-a39e-7381bfe591be None None] MFA Rules not processed for user `b2cf237346214186badbf4b7d5a3b62a`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:33:14.759711 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-8828e840-b738-4c93-a39e-7381bfe591be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:14.827757 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1257/2513] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:33:14 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:33:14.839673 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1449ea0f-08a6-4fd8-81e0-748ecd033a4c admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:14.841464 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-1449ea0f-08a6-4fd8-81e0-748ecd033a4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:14.902173 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1449ea0f-08a6-4fd8-81e0-748ecd033a4c admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:14.905846 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd8db3e-3e93-48b5-bdbc-2e13743a6639 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceafc5e4283841528053f01931f10293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:14.906451 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd8db3e-3e93-48b5-bdbc-2e13743a6639 service cinder] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:14.906751 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd8db3e-3e93-48b5-bdbc-2e13743a6639 service cinder] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:14.907020 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd8db3e-3e93-48b5-bdbc-2e13743a6639 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:14.972576 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd8db3e-3e93-48b5-bdbc-2e13743a6639 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:14.975709 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd8db3e-3e93-48b5-bdbc-2e13743a6639 service cinder] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:14.986360 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1257/2514] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:33:14 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:33:16.448546 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8828e840-b738-4c93-a39e-7381bfe591be None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:16.449955 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-8828e840-b738-4c93-a39e-7381bfe591be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:16.462401 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8828e840-b738-4c93-a39e-7381bfe591be None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:16.465961 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35a57b4-d625-4e8f-8588-c0ae13003f8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceafc5e4283841528053f01931f10293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:16.466562 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a57b4-d625-4e8f-8588-c0ae13003f8e service cinder] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:16.466947 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a57b4-d625-4e8f-8588-c0ae13003f8e service cinder] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:16.467223 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a57b4-d625-4e8f-8588-c0ae13003f8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:16.476540 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35a57b4-d625-4e8f-8588-c0ae13003f8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:16.477959 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35a57b4-d625-4e8f-8588-c0ae13003f8e service cinder] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:16.487548 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1258/2515] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:33:16 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:33:20.284650 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd8db3e-3e93-48b5-bdbc-2e13743a6639 service cinder] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:20.350374 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd8db3e-3e93-48b5-bdbc-2e13743a6639 service cinder] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:20.354832 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a046498-1ec5-41d9-8f23-1f8263f03589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:20.355451 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a046498-1ec5-41d9-8f23-1f8263f03589 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:20.355731 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a046498-1ec5-41d9-8f23-1f8263f03589 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:20.356003 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a046498-1ec5-41d9-8f23-1f8263f03589 admin admin] PATH_INFO: `/v3/users/0e619301903746d2a6068da3aace3647` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:20.357130 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a046498-1ec5-41d9-8f23-1f8263f03589 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e619301903746d2a6068da3aace3647)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:20.359075 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a046498-1ec5-41d9-8f23-1f8263f03589 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:20.403740 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:33:20.405330 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-8a046498-1ec5-41d9-8f23-1f8263f03589 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e619301903746d2a6068da3aace3647'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:20.414557 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-8a046498-1ec5-41d9-8f23-1f8263f03589 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e619301903746d2a6068da3aace3647'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:20.415349 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-8a046498-1ec5-41d9-8f23-1f8263f03589 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e619301903746d2a6068da3aace3647'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:20.416077 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-8a046498-1ec5-41d9-8f23-1f8263f03589 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e619301903746d2a6068da3aace3647'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:20.422968 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-8a046498-1ec5-41d9-8f23-1f8263f03589 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e619301903746d2a6068da3aace3647'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:20.446588 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1258/2516] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:33:20 2022] DELETE /identity/v3/users/0e619301903746d2a6068da3aace3647 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:33:20.451450 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe618f-87d2-49a5-a114-808cadace795 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:20.451968 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe618f-87d2-49a5-a114-808cadace795 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:20.452064 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe618f-87d2-49a5-a114-808cadace795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:20.471240 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-1bbe618f-87d2-49a5-a114-808cadace795 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:33:20.472456 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-1bbe618f-87d2-49a5-a114-808cadace795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:20.529829 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1259/2517] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:33:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:33:20.539501 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a046498-1ec5-41d9-8f23-1f8263f03589 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:20.540874 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-8a046498-1ec5-41d9-8f23-1f8263f03589 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:20.599155 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a046498-1ec5-41d9-8f23-1f8263f03589 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:20.603030 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457c9e26-eab9-4b1b-9236-7137c5a0b898 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:20.603646 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c9e26-eab9-4b1b-9236-7137c5a0b898 service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:20.603929 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c9e26-eab9-4b1b-9236-7137c5a0b898 service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:20.604204 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c9e26-eab9-4b1b-9236-7137c5a0b898 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:20.613670 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457c9e26-eab9-4b1b-9236-7137c5a0b898 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:20.615130 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457c9e26-eab9-4b1b-9236-7137c5a0b898 service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:20.624472 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1259/2518] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:33:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:33:20.906270 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbe618f-87d2-49a5-a114-808cadace795 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:20.907802 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-1bbe618f-87d2-49a5-a114-808cadace795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:20.921013 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbe618f-87d2-49a5-a114-808cadace795 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:20.926383 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4016fe9c-8e38-4e07-b9a7-e602b489aa0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:20.927068 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4016fe9c-8e38-4e07-b9a7-e602b489aa0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:20.927349 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4016fe9c-8e38-4e07-b9a7-e602b489aa0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:20.927618 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4016fe9c-8e38-4e07-b9a7-e602b489aa0c admin admin] PATH_INFO: `/v3/projects/c416786624804fcab0d37a2d8609e814` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:20.928804 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4016fe9c-8e38-4e07-b9a7-e602b489aa0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c416786624804fcab0d37a2d8609e814)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:20.930858 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4016fe9c-8e38-4e07-b9a7-e602b489aa0c admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:20.963779 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:33:20.981260 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-4016fe9c-8e38-4e07-b9a7-e602b489aa0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c416786624804fcab0d37a2d8609e814', 'request_id': 'req-4016fe9c-8e38-4e07-b9a7-e602b489aa0c'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:20.987389 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-4016fe9c-8e38-4e07-b9a7-e602b489aa0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c416786624804fcab0d37a2d8609e814', 'request_id': 'req-4016fe9c-8e38-4e07-b9a7-e602b489aa0c'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:20.995288 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-4016fe9c-8e38-4e07-b9a7-e602b489aa0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c416786624804fcab0d37a2d8609e814', 'request_id': 'req-4016fe9c-8e38-4e07-b9a7-e602b489aa0c'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:21.007995 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-4016fe9c-8e38-4e07-b9a7-e602b489aa0c admin admin] The token cache is being invalidate because project c416786624804fcab0d37a2d8609e814 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:33:21.008285 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-4016fe9c-8e38-4e07-b9a7-e602b489aa0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:21.009342 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-4016fe9c-8e38-4e07-b9a7-e602b489aa0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:21.013742 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1260/2519] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:33:20 2022] DELETE /identity/v3/projects/c416786624804fcab0d37a2d8609e814 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:33:21.014967 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457c9e26-eab9-4b1b-9236-7137c5a0b898 service neutron] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:21.025196 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457c9e26-eab9-4b1b-9236-7137c5a0b898 service neutron] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:21.086618 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9917a2-92a7-470c-ba48-a70d3c4f44e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:21.086618 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9917a2-92a7-470c-ba48-a70d3c4f44e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:21.086618 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9917a2-92a7-470c-ba48-a70d3c4f44e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:21.086618 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9917a2-92a7-470c-ba48-a70d3c4f44e4 admin admin] PATH_INFO: `/v3/users/b2cf237346214186badbf4b7d5a3b62a` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:21.087271 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9917a2-92a7-470c-ba48-a70d3c4f44e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2cf237346214186badbf4b7d5a3b62a)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:21.089147 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9917a2-92a7-470c-ba48-a70d3c4f44e4 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:21.094352 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4016fe9c-8e38-4e07-b9a7-e602b489aa0c admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:21.096032 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-4016fe9c-8e38-4e07-b9a7-e602b489aa0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:21.138176 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-0e9917a2-92a7-470c-ba48-a70d3c4f44e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2cf237346214186badbf4b7d5a3b62a'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:21.146678 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-0e9917a2-92a7-470c-ba48-a70d3c4f44e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2cf237346214186badbf4b7d5a3b62a'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:21.147590 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-0e9917a2-92a7-470c-ba48-a70d3c4f44e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2cf237346214186badbf4b7d5a3b62a'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:21.148200 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-0e9917a2-92a7-470c-ba48-a70d3c4f44e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2cf237346214186badbf4b7d5a3b62a'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:21.155583 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-0e9917a2-92a7-470c-ba48-a70d3c4f44e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2cf237346214186badbf4b7d5a3b62a'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:21.160536 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:33:21.161394 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4016fe9c-8e38-4e07-b9a7-e602b489aa0c admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:21.165420 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07be350-c46c-4877-b326-241f9fe7683b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:21.166063 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07be350-c46c-4877-b326-241f9fe7683b service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:21.166363 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07be350-c46c-4877-b326-241f9fe7683b service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:21.166641 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07be350-c46c-4877-b326-241f9fe7683b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:21.168476 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-a07be350-c46c-4877-b326-241f9fe7683b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:21.176777 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1260/2520] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:33:21 2022] DELETE /identity/v3/users/b2cf237346214186badbf4b7d5a3b62a => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:33:21.182088 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07be350-c46c-4877-b326-241f9fe7683b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:21.183641 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07be350-c46c-4877-b326-241f9fe7683b service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:21.194784 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1261/2521] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:33:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 12:33:21.612730 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9917a2-92a7-470c-ba48-a70d3c4f44e4 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:21.615039 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-0e9917a2-92a7-470c-ba48-a70d3c4f44e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:21.689861 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9917a2-92a7-470c-ba48-a70d3c4f44e4 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:21.694975 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9110b333-aa11-47b2-a7c4-c9af557e6a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:21.695600 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9110b333-aa11-47b2-a7c4-c9af557e6a47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:21.695875 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9110b333-aa11-47b2-a7c4-c9af557e6a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:21.696144 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9110b333-aa11-47b2-a7c4-c9af557e6a47 admin admin] PATH_INFO: `/v3/projects/840ce3a4c8724030b7f556e246ffe010` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:21.697347 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9110b333-aa11-47b2-a7c4-c9af557e6a47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=840ce3a4c8724030b7f556e246ffe010)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:21.699317 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9110b333-aa11-47b2-a7c4-c9af557e6a47 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:21.747559 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-9110b333-aa11-47b2-a7c4-c9af557e6a47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '840ce3a4c8724030b7f556e246ffe010', 'request_id': 'req-9110b333-aa11-47b2-a7c4-c9af557e6a47'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:21.754611 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-9110b333-aa11-47b2-a7c4-c9af557e6a47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '840ce3a4c8724030b7f556e246ffe010', 'request_id': 'req-9110b333-aa11-47b2-a7c4-c9af557e6a47'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:21.761360 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-9110b333-aa11-47b2-a7c4-c9af557e6a47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '840ce3a4c8724030b7f556e246ffe010', 'request_id': 'req-9110b333-aa11-47b2-a7c4-c9af557e6a47'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:21.777213 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-9110b333-aa11-47b2-a7c4-c9af557e6a47 admin admin] The token cache is being invalidate because project 840ce3a4c8724030b7f556e246ffe010 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:33:21.777504 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-9110b333-aa11-47b2-a7c4-c9af557e6a47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:21.778125 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-9110b333-aa11-47b2-a7c4-c9af557e6a47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:21.779879 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1261/2522] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:33:21 2022] DELETE /identity/v3/projects/840ce3a4c8724030b7f556e246ffe010 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:33:21.784651 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d0f3e1-440a-4e68-8d8a-e68b04885a17 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:21.785147 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d0f3e1-440a-4e68-8d8a-e68b04885a17 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:21.785255 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d0f3e1-440a-4e68-8d8a-e68b04885a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:21.804805 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-a5d0f3e1-440a-4e68-8d8a-e68b04885a17 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:33:21.806009 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-a5d0f3e1-440a-4e68-8d8a-e68b04885a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:21.866244 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1262/2523] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:33:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:33:21.874300 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac3cae-5f64-42a0-94c1-0f6d89d95e90 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:21.874586 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac3cae-5f64-42a0-94c1-0f6d89d95e90 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:21.874894 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac3cae-5f64-42a0-94c1-0f6d89d95e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:21.894934 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-bdac3cae-5f64-42a0-94c1-0f6d89d95e90 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:33:21.896187 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-bdac3cae-5f64-42a0-94c1-0f6d89d95e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:21.904348 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1262/2524] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:33:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:33:21.908572 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d0f3e1-440a-4e68-8d8a-e68b04885a17 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:21.918498 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d0f3e1-440a-4e68-8d8a-e68b04885a17 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:21.923035 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b9e0c1-e217-4665-b92e-d9ed372c9f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:21.923626 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9e0c1-e217-4665-b92e-d9ed372c9f27 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:21.923898 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9e0c1-e217-4665-b92e-d9ed372c9f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:21.924166 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9e0c1-e217-4665-b92e-d9ed372c9f27 admin admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:21.925363 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b9e0c1-e217-4665-b92e-d9ed372c9f27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:33:21.925660 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b9e0c1-e217-4665-b92e-d9ed372c9f27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:21.927271 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b9e0c1-e217-4665-b92e-d9ed372c9f27 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:21.939508 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1263/2525] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 15 12:33:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:33:21.944342 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac3cae-5f64-42a0-94c1-0f6d89d95e90 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:21.953890 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac3cae-5f64-42a0-94c1-0f6d89d95e90 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:21.958859 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb078f5-dffc-4a53-854e-cfb3c3af8a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:21.959456 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb078f5-dffc-4a53-854e-cfb3c3af8a4f admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:21.959730 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb078f5-dffc-4a53-854e-cfb3c3af8a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:21.959995 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb078f5-dffc-4a53-854e-cfb3c3af8a4f admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:21.960621 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb078f5-dffc-4a53-854e-cfb3c3af8a4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:21.962496 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb078f5-dffc-4a53-854e-cfb3c3af8a4f admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:21.994724 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1263/2526] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:33:21 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:33:21.996916 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b9e0c1-e217-4665-b92e-d9ed372c9f27 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:22.007236 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b9e0c1-e217-4665-b92e-d9ed372c9f27 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:22.054760 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:33:22.073682 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18414137-3111-44df-97f5-38c05fa523cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:22.074301 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18414137-3111-44df-97f5-38c05fa523cd admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:22.074584 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18414137-3111-44df-97f5-38c05fa523cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:22.074975 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18414137-3111-44df-97f5-38c05fa523cd admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:22.075637 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18414137-3111-44df-97f5-38c05fa523cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:22.077576 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18414137-3111-44df-97f5-38c05fa523cd admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:22.100320 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1264/2527] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:33:21 2022] POST /identity/v3/users => generated 289 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:33:22.104661 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb078f5-dffc-4a53-854e-cfb3c3af8a4f admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:22.115292 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb078f5-dffc-4a53-854e-cfb3c3af8a4f admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:22.119946 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6858e1e-eaf8-4152-a94a-843098197832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:22.120540 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6858e1e-eaf8-4152-a94a-843098197832 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:22.120850 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6858e1e-eaf8-4152-a94a-843098197832 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:22.121125 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6858e1e-eaf8-4152-a94a-843098197832 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:22.121787 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6858e1e-eaf8-4152-a94a-843098197832 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:22.123528 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6858e1e-eaf8-4152-a94a-843098197832 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:22.134532 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1264/2528] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:33:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:33:22.138492 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18414137-3111-44df-97f5-38c05fa523cd admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:22.149123 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18414137-3111-44df-97f5-38c05fa523cd admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:22.154710 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7e9b7b-4214-4491-ba76-7554cbd28a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:22.157123 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7e9b7b-4214-4491-ba76-7554cbd28a2e admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:22.157123 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7e9b7b-4214-4491-ba76-7554cbd28a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:22.157371 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7e9b7b-4214-4491-ba76-7554cbd28a2e admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:22.158140 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7e9b7b-4214-4491-ba76-7554cbd28a2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:22.160806 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7e9b7b-4214-4491-ba76-7554cbd28a2e admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:22.173485 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1265/2529] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:33:22 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:33:22.178176 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6858e1e-eaf8-4152-a94a-843098197832 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:22.189744 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6858e1e-eaf8-4152-a94a-843098197832 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:22.195996 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3a31e9-d0fc-4f82-b0ad-79c29c46a82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:22.196784 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3a31e9-d0fc-4f82-b0ad-79c29c46a82f admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:22.197165 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3a31e9-d0fc-4f82-b0ad-79c29c46a82f admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:22.197539 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3a31e9-d0fc-4f82-b0ad-79c29c46a82f admin admin] PATH_INFO: `/v3/projects/eceee2623e2c4851bcea5c4d7283c9da/users/918f7a49dc474f158580634b10ab8343/roles/9371e5bbc55848949eb951a815f817f2` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:22.218109 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3a31e9-d0fc-4f82-b0ad-79c29c46a82f admin admin] RBAC: Authorizing `identity:create_grant(project_id=eceee2623e2c4851bcea5c4d7283c9da, user_id=918f7a49dc474f158580634b10ab8343, role_id=9371e5bbc55848949eb951a815f817f2)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:22.220987 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3a31e9-d0fc-4f82-b0ad-79c29c46a82f admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:22.241731 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1265/2530] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:33:22 2022] PUT /identity/v3/projects/eceee2623e2c4851bcea5c4d7283c9da/users/918f7a49dc474f158580634b10ab8343/roles/9371e5bbc55848949eb951a815f817f2 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:33:22.253734 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b3172-a309-46dc-97a0-e8c9f2210c03 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:22.254031 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b3172-a309-46dc-97a0-e8c9f2210c03 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:22.254309 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b3172-a309-46dc-97a0-e8c9f2210c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:22.288242 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-7b7b3172-a309-46dc-97a0-e8c9f2210c03 None None] MFA Rules not processed for user `918f7a49dc474f158580634b10ab8343`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:33:22.289495 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-7b7b3172-a309-46dc-97a0-e8c9f2210c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:22.367478 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1266/2531] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:33:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:33:22.379926 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3a31e9-d0fc-4f82-b0ad-79c29c46a82f admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:22.381726 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-7e3a31e9-d0fc-4f82-b0ad-79c29c46a82f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:22.395753 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:33:22.444813 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3a31e9-d0fc-4f82-b0ad-79c29c46a82f admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:22.448691 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7439492d-0a23-461f-824c-b45b7ef3e7ca service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd057b651769b4ae99c1d4f2b0fc31fb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:22.449324 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7439492d-0a23-461f-824c-b45b7ef3e7ca service glance] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:22.449623 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7439492d-0a23-461f-824c-b45b7ef3e7ca service glance] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:22.449896 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7439492d-0a23-461f-824c-b45b7ef3e7ca service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:22.458923 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7439492d-0a23-461f-824c-b45b7ef3e7ca service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:22.460366 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7439492d-0a23-461f-824c-b45b7ef3e7ca service glance] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:22.469360 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1266/2532] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:33:22 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:33:24.571630 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7b3172-a309-46dc-97a0-e8c9f2210c03 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:24.573065 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-7b7b3172-a309-46dc-97a0-e8c9f2210c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:24.641904 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7b3172-a309-46dc-97a0-e8c9f2210c03 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:24.646904 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a27e687-37cc-42ca-b57b-44f2e1d55d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:24.647535 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a27e687-37cc-42ca-b57b-44f2e1d55d7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:24.647815 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a27e687-37cc-42ca-b57b-44f2e1d55d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:24.648086 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a27e687-37cc-42ca-b57b-44f2e1d55d7e admin admin] PATH_INFO: `/v3/users/983e501359234b31879e5cdfb34ea31a` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:24.649212 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a27e687-37cc-42ca-b57b-44f2e1d55d7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=983e501359234b31879e5cdfb34ea31a)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:24.651172 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a27e687-37cc-42ca-b57b-44f2e1d55d7e admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:24.700947 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-0a27e687-37cc-42ca-b57b-44f2e1d55d7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '983e501359234b31879e5cdfb34ea31a'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:24.708736 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-0a27e687-37cc-42ca-b57b-44f2e1d55d7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '983e501359234b31879e5cdfb34ea31a'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:24.709268 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-0a27e687-37cc-42ca-b57b-44f2e1d55d7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '983e501359234b31879e5cdfb34ea31a'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:24.709884 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-0a27e687-37cc-42ca-b57b-44f2e1d55d7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '983e501359234b31879e5cdfb34ea31a'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:24.713250 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:33:24.717651 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-0a27e687-37cc-42ca-b57b-44f2e1d55d7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '983e501359234b31879e5cdfb34ea31a'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:24.736226 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1267/2533] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:33:24 2022] DELETE /identity/v3/users/983e501359234b31879e5cdfb34ea31a => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:33:24.917888 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7439492d-0a23-461f-824c-b45b7ef3e7ca service glance] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:24.930730 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7439492d-0a23-461f-824c-b45b7ef3e7ca service glance] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:24.993072 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df68191e-3b48-4de1-9418-e33e178c7772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:24.993731 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df68191e-3b48-4de1-9418-e33e178c7772 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:24.994079 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df68191e-3b48-4de1-9418-e33e178c7772 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:24.994298 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df68191e-3b48-4de1-9418-e33e178c7772 admin admin] PATH_INFO: `/v3/projects/353be637e4bc48858ac4b476c00e6801` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:24.995745 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df68191e-3b48-4de1-9418-e33e178c7772 admin admin] RBAC: Authorizing `identity:delete_project(project_id=353be637e4bc48858ac4b476c00e6801)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:24.997764 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df68191e-3b48-4de1-9418-e33e178c7772 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:25.049935 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-df68191e-3b48-4de1-9418-e33e178c7772 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '353be637e4bc48858ac4b476c00e6801', 'request_id': 'req-df68191e-3b48-4de1-9418-e33e178c7772'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:25.056402 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-df68191e-3b48-4de1-9418-e33e178c7772 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '353be637e4bc48858ac4b476c00e6801', 'request_id': 'req-df68191e-3b48-4de1-9418-e33e178c7772'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:25.062060 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-df68191e-3b48-4de1-9418-e33e178c7772 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '353be637e4bc48858ac4b476c00e6801', 'request_id': 'req-df68191e-3b48-4de1-9418-e33e178c7772'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:25.078063 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-df68191e-3b48-4de1-9418-e33e178c7772 admin admin] The token cache is being invalidate because project 353be637e4bc48858ac4b476c00e6801 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:33:25.078357 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-df68191e-3b48-4de1-9418-e33e178c7772 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:25.079241 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-df68191e-3b48-4de1-9418-e33e178c7772 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:25.081589 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1267/2534] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:33:24 2022] DELETE /identity/v3/projects/353be637e4bc48858ac4b476c00e6801 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:33:25.086582 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c305f-3528-4683-8de8-ad24a1e13e21 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:25.086897 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c305f-3528-4683-8de8-ad24a1e13e21 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:25.087175 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c305f-3528-4683-8de8-ad24a1e13e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:25.107435 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-7a9c305f-3528-4683-8de8-ad24a1e13e21 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:33:25.108716 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-7a9c305f-3528-4683-8de8-ad24a1e13e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:25.171046 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1268/2535] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:33:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:33:25.179172 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af9faf-b121-4910-ac27-301d6289fc91 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:25.179508 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af9faf-b121-4910-ac27-301d6289fc91 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:25.179784 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af9faf-b121-4910-ac27-301d6289fc91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:25.199700 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-f8af9faf-b121-4910-ac27-301d6289fc91 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:33:25.200914 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-f8af9faf-b121-4910-ac27-301d6289fc91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:25.208882 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1268/2536] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:33:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:33:25.212980 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9c305f-3528-4683-8de8-ad24a1e13e21 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:25.222856 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9c305f-3528-4683-8de8-ad24a1e13e21 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:25.227942 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c440c665-d593-4304-ae60-3d18ac87cbef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:25.228133 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c440c665-d593-4304-ae60-3d18ac87cbef admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:25.228359 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c440c665-d593-4304-ae60-3d18ac87cbef admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:25.228610 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c440c665-d593-4304-ae60-3d18ac87cbef admin admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:25.229411 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c440c665-d593-4304-ae60-3d18ac87cbef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:33:25.229642 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c440c665-d593-4304-ae60-3d18ac87cbef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:25.231489 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c440c665-d593-4304-ae60-3d18ac87cbef admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:25.244597 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1269/2537] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 15 12:33:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:33:25.249060 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8af9faf-b121-4910-ac27-301d6289fc91 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:25.259332 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8af9faf-b121-4910-ac27-301d6289fc91 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:25.264111 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de720f6-eded-4fc0-8687-779b0470447f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:25.264699 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de720f6-eded-4fc0-8687-779b0470447f admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:25.264980 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de720f6-eded-4fc0-8687-779b0470447f admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:25.265253 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de720f6-eded-4fc0-8687-779b0470447f admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:25.265884 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de720f6-eded-4fc0-8687-779b0470447f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:25.267842 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de720f6-eded-4fc0-8687-779b0470447f admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:25.296458 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1269/2538] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:33:25 2022] POST /identity/v3/projects => generated 367 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:33:25.301097 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c440c665-d593-4304-ae60-3d18ac87cbef admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:25.313120 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c440c665-d593-4304-ae60-3d18ac87cbef admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:25.375417 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196b77db-2890-43f7-a5e6-c48834dca277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:25.376021 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b77db-2890-43f7-a5e6-c48834dca277 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:25.376548 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b77db-2890-43f7-a5e6-c48834dca277 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:25.376813 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b77db-2890-43f7-a5e6-c48834dca277 admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:25.377445 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196b77db-2890-43f7-a5e6-c48834dca277 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:25.379941 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196b77db-2890-43f7-a5e6-c48834dca277 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:25.410170 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1270/2539] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:33:25 2022] POST /identity/v3/users => generated 284 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:33:25.411785 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de720f6-eded-4fc0-8687-779b0470447f admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:25.422089 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de720f6-eded-4fc0-8687-779b0470447f admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:25.427187 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec775cb0-34d3-4379-b702-87b3a92e5e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:25.427780 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec775cb0-34d3-4379-b702-87b3a92e5e0a admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:25.428057 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec775cb0-34d3-4379-b702-87b3a92e5e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:25.428326 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec775cb0-34d3-4379-b702-87b3a92e5e0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:25.428992 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec775cb0-34d3-4379-b702-87b3a92e5e0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:25.430580 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec775cb0-34d3-4379-b702-87b3a92e5e0a admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:25.441632 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1270/2540] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:33:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:33:25.445422 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196b77db-2890-43f7-a5e6-c48834dca277 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:25.455933 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196b77db-2890-43f7-a5e6-c48834dca277 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:25.460555 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36da6776-23c1-41dc-bcc9-12aa6e34bd00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:25.461193 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da6776-23c1-41dc-bcc9-12aa6e34bd00 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:25.461521 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da6776-23c1-41dc-bcc9-12aa6e34bd00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:25.461796 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da6776-23c1-41dc-bcc9-12aa6e34bd00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:25.462496 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36da6776-23c1-41dc-bcc9-12aa6e34bd00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:25.464292 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36da6776-23c1-41dc-bcc9-12aa6e34bd00 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:25.476372 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1271/2541] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:33:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:33:25.480465 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec775cb0-34d3-4379-b702-87b3a92e5e0a admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:25.486834 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:33:25.491379 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec775cb0-34d3-4379-b702-87b3a92e5e0a admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:25.497132 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64403864-4608-4e4f-9e19-3b747d748734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:25.497933 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64403864-4608-4e4f-9e19-3b747d748734 admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:25.498434 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64403864-4608-4e4f-9e19-3b747d748734 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:25.498871 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64403864-4608-4e4f-9e19-3b747d748734 admin admin] PATH_INFO: `/v3/projects/9daaca2985144f4dbb203a089b3ff48a/users/383c3c0483924395b4479ded6b755b4e/roles/9371e5bbc55848949eb951a815f817f2` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:25.513805 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64403864-4608-4e4f-9e19-3b747d748734 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9daaca2985144f4dbb203a089b3ff48a, user_id=383c3c0483924395b4479ded6b755b4e, role_id=9371e5bbc55848949eb951a815f817f2)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:25.516512 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64403864-4608-4e4f-9e19-3b747d748734 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:25.529872 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1271/2542] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:33:25 2022] PUT /identity/v3/projects/9daaca2985144f4dbb203a089b3ff48a/users/383c3c0483924395b4479ded6b755b4e/roles/9371e5bbc55848949eb951a815f817f2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:33:25.541010 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f2f49-5c6c-4f74-8257-c0dd683bed97 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:25.541325 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f2f49-5c6c-4f74-8257-c0dd683bed97 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:25.541600 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f2f49-5c6c-4f74-8257-c0dd683bed97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:25.569824 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-986f2f49-5c6c-4f74-8257-c0dd683bed97 None None] MFA Rules not processed for user `383c3c0483924395b4479ded6b755b4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:33:25.571212 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-986f2f49-5c6c-4f74-8257-c0dd683bed97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:25.599214 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:33:25.643076 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1272/2543] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:33:25 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:33:25.653899 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64403864-4608-4e4f-9e19-3b747d748734 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:25.655640 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-64403864-4608-4e4f-9e19-3b747d748734 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:25.715421 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64403864-4608-4e4f-9e19-3b747d748734 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:25.719041 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2e606b-73f7-4864-b2d4-d85d66b26069 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceafc5e4283841528053f01931f10293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:25.719636 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e606b-73f7-4864-b2d4-d85d66b26069 service cinder] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:25.719915 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e606b-73f7-4864-b2d4-d85d66b26069 service cinder] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:25.720185 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e606b-73f7-4864-b2d4-d85d66b26069 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:25.728943 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2e606b-73f7-4864-b2d4-d85d66b26069 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:25.730296 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2e606b-73f7-4864-b2d4-d85d66b26069 service cinder] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:25.739581 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1272/2544] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:33:25 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:33:34.176438 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986f2f49-5c6c-4f74-8257-c0dd683bed97 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:34.266067 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986f2f49-5c6c-4f74-8257-c0dd683bed97 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:34.271086 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de98c00-a116-4d69-9fce-e48f16cd5d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:34.271710 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de98c00-a116-4d69-9fce-e48f16cd5d77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:34.271985 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de98c00-a116-4d69-9fce-e48f16cd5d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:34.272257 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de98c00-a116-4d69-9fce-e48f16cd5d77 admin admin] PATH_INFO: `/v3/users/383c3c0483924395b4479ded6b755b4e` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:34.273363 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de98c00-a116-4d69-9fce-e48f16cd5d77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=383c3c0483924395b4479ded6b755b4e)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:34.275314 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de98c00-a116-4d69-9fce-e48f16cd5d77 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:34.320304 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-4de98c00-a116-4d69-9fce-e48f16cd5d77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '383c3c0483924395b4479ded6b755b4e'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:34.327207 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-4de98c00-a116-4d69-9fce-e48f16cd5d77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '383c3c0483924395b4479ded6b755b4e'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:34.327816 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-4de98c00-a116-4d69-9fce-e48f16cd5d77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '383c3c0483924395b4479ded6b755b4e'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:34.328420 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-4de98c00-a116-4d69-9fce-e48f16cd5d77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '383c3c0483924395b4479ded6b755b4e'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:34.335857 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-4de98c00-a116-4d69-9fce-e48f16cd5d77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '383c3c0483924395b4479ded6b755b4e'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:34.352361 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1273/2545] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:33:34 2022] DELETE /identity/v3/users/383c3c0483924395b4479ded6b755b4e => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:33:34.356813 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70d1ded-a7a5-456b-bc34-e1985e9cb587 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:34.357278 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70d1ded-a7a5-456b-bc34-e1985e9cb587 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:34.357389 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70d1ded-a7a5-456b-bc34-e1985e9cb587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:34.377446 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-b70d1ded-a7a5-456b-bc34-e1985e9cb587 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:33:34.378638 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-b70d1ded-a7a5-456b-bc34-e1985e9cb587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:34.437519 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1273/2546] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:33:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:33:34.447702 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de98c00-a116-4d69-9fce-e48f16cd5d77 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:34.449142 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-4de98c00-a116-4d69-9fce-e48f16cd5d77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:34.501882 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:33:34.506372 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de98c00-a116-4d69-9fce-e48f16cd5d77 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:34.511383 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9b15c0-c758-4b0d-a0c1-8c0998e44e6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:34.512016 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b15c0-c758-4b0d-a0c1-8c0998e44e6f service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:34.512300 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b15c0-c758-4b0d-a0c1-8c0998e44e6f service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:34.512740 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b15c0-c758-4b0d-a0c1-8c0998e44e6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:34.522787 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9b15c0-c758-4b0d-a0c1-8c0998e44e6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:34.524155 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9b15c0-c758-4b0d-a0c1-8c0998e44e6f service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:34.534544 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1274/2547] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:33:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:33:34.802412 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70d1ded-a7a5-456b-bc34-e1985e9cb587 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:34.804223 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-b70d1ded-a7a5-456b-bc34-e1985e9cb587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:34.818751 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70d1ded-a7a5-456b-bc34-e1985e9cb587 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:34.827871 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a4bd76-47fa-4177-a92f-085172305d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:34.828569 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a4bd76-47fa-4177-a92f-085172305d47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:34.828908 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a4bd76-47fa-4177-a92f-085172305d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:34.829073 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a4bd76-47fa-4177-a92f-085172305d47 admin admin] PATH_INFO: `/v3/projects/9daaca2985144f4dbb203a089b3ff48a` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:34.830201 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a4bd76-47fa-4177-a92f-085172305d47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9daaca2985144f4dbb203a089b3ff48a)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:34.832217 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a4bd76-47fa-4177-a92f-085172305d47 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:34.881939 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-45a4bd76-47fa-4177-a92f-085172305d47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9daaca2985144f4dbb203a089b3ff48a', 'request_id': 'req-45a4bd76-47fa-4177-a92f-085172305d47'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:34.888057 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-45a4bd76-47fa-4177-a92f-085172305d47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9daaca2985144f4dbb203a089b3ff48a', 'request_id': 'req-45a4bd76-47fa-4177-a92f-085172305d47'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:34.893524 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-45a4bd76-47fa-4177-a92f-085172305d47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9daaca2985144f4dbb203a089b3ff48a', 'request_id': 'req-45a4bd76-47fa-4177-a92f-085172305d47'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:34.906545 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-45a4bd76-47fa-4177-a92f-085172305d47 admin admin] The token cache is being invalidate because project 9daaca2985144f4dbb203a089b3ff48a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:33:34.906865 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-45a4bd76-47fa-4177-a92f-085172305d47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:34.907517 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-45a4bd76-47fa-4177-a92f-085172305d47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:34.909141 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1274/2548] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:33:34 2022] DELETE /identity/v3/projects/9daaca2985144f4dbb203a089b3ff48a => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:33:34.913943 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f924d7-6c46-4380-8fba-8c5ba573bb5a None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:34.914252 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f924d7-6c46-4380-8fba-8c5ba573bb5a None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:34.914496 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f924d7-6c46-4380-8fba-8c5ba573bb5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:34.933530 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-16f924d7-6c46-4380-8fba-8c5ba573bb5a None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:33:34.934723 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-16f924d7-6c46-4380-8fba-8c5ba573bb5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:34.997850 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1275/2549] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:33:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:33:35.007780 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c0edf-5e05-4c7e-b1d2-f12257aacd33 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:35.008067 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c0edf-5e05-4c7e-b1d2-f12257aacd33 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:35.008342 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c0edf-5e05-4c7e-b1d2-f12257aacd33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:35.023817 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:33:35.030425 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-ec1c0edf-5e05-4c7e-b1d2-f12257aacd33 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:33:35.032258 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-ec1c0edf-5e05-4c7e-b1d2-f12257aacd33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:35.040288 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1275/2550] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:33:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:33:35.044348 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f924d7-6c46-4380-8fba-8c5ba573bb5a None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:35.053793 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f924d7-6c46-4380-8fba-8c5ba573bb5a None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:35.058388 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86390255-9af4-4e1b-b976-434a4c33aa2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:35.059036 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86390255-9af4-4e1b-b976-434a4c33aa2e admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:35.059328 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86390255-9af4-4e1b-b976-434a4c33aa2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:35.059577 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86390255-9af4-4e1b-b976-434a4c33aa2e admin admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:35.060209 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86390255-9af4-4e1b-b976-434a4c33aa2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:33:35.060510 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86390255-9af4-4e1b-b976-434a4c33aa2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:35.062098 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86390255-9af4-4e1b-b976-434a4c33aa2e admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:35.074219 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1276/2551] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 15 12:33:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:33:35.078348 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c0edf-5e05-4c7e-b1d2-f12257aacd33 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:35.088097 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c0edf-5e05-4c7e-b1d2-f12257aacd33 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:35.092615 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0878da7f-cd7d-451c-a208-bbbbc4d90d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:35.093195 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878da7f-cd7d-451c-a208-bbbbc4d90d9a admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:35.093467 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878da7f-cd7d-451c-a208-bbbbc4d90d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:35.093734 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878da7f-cd7d-451c-a208-bbbbc4d90d9a admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:35.094357 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0878da7f-cd7d-451c-a208-bbbbc4d90d9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:35.096293 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0878da7f-cd7d-451c-a208-bbbbc4d90d9a admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:35.122602 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1276/2552] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:33:35 2022] POST /identity/v3/projects => generated 403 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:33:35.127008 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86390255-9af4-4e1b-b976-434a4c33aa2e admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:35.137348 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86390255-9af4-4e1b-b976-434a4c33aa2e admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:35.193191 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c50f606-1b25-4882-885d-d3d86812fdd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:35.193805 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50f606-1b25-4882-885d-d3d86812fdd5 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:35.194054 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50f606-1b25-4882-885d-d3d86812fdd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:35.194324 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50f606-1b25-4882-885d-d3d86812fdd5 admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:35.194990 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c50f606-1b25-4882-885d-d3d86812fdd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:35.196896 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c50f606-1b25-4882-885d-d3d86812fdd5 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:35.217625 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1277/2553] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:33:35 2022] POST /identity/v3/users => generated 302 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:33:35.221667 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0878da7f-cd7d-451c-a208-bbbbc4d90d9a admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:35.231773 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0878da7f-cd7d-451c-a208-bbbbc4d90d9a admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:35.236529 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20a5db0-f2ab-413a-9c4e-960193dd5447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:35.237148 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a5db0-f2ab-413a-9c4e-960193dd5447 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:35.237426 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a5db0-f2ab-413a-9c4e-960193dd5447 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:35.237732 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a5db0-f2ab-413a-9c4e-960193dd5447 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:35.238362 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20a5db0-f2ab-413a-9c4e-960193dd5447 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:35.240482 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20a5db0-f2ab-413a-9c4e-960193dd5447 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:35.250325 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1277/2554] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:33:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:33:35.255069 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c50f606-1b25-4882-885d-d3d86812fdd5 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:35.264861 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c50f606-1b25-4882-885d-d3d86812fdd5 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:35.269485 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d8bb8f-0c03-48f6-bca3-3afe45b575a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:35.270083 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d8bb8f-0c03-48f6-bca3-3afe45b575a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:35.270364 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d8bb8f-0c03-48f6-bca3-3afe45b575a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:35.270632 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d8bb8f-0c03-48f6-bca3-3afe45b575a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:35.271302 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d8bb8f-0c03-48f6-bca3-3afe45b575a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:35.272882 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d8bb8f-0c03-48f6-bca3-3afe45b575a7 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:35.283543 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1278/2555] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:33:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:33:35.287669 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20a5db0-f2ab-413a-9c4e-960193dd5447 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:35.298360 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20a5db0-f2ab-413a-9c4e-960193dd5447 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:35.303528 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428e805d-01da-40c6-8d62-0d9f6fda1783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:35.304181 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e805d-01da-40c6-8d62-0d9f6fda1783 admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:35.304466 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e805d-01da-40c6-8d62-0d9f6fda1783 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:35.304741 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e805d-01da-40c6-8d62-0d9f6fda1783 admin admin] PATH_INFO: `/v3/projects/17025d0e82564178b9c81d470e2d073b/users/c19de59f54204ea0b44c5c411eae3b6a/roles/9371e5bbc55848949eb951a815f817f2` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:35.319884 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428e805d-01da-40c6-8d62-0d9f6fda1783 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17025d0e82564178b9c81d470e2d073b, user_id=c19de59f54204ea0b44c5c411eae3b6a, role_id=9371e5bbc55848949eb951a815f817f2)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:35.322524 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428e805d-01da-40c6-8d62-0d9f6fda1783 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:35.335469 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1278/2556] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:33:35 2022] PUT /identity/v3/projects/17025d0e82564178b9c81d470e2d073b/users/c19de59f54204ea0b44c5c411eae3b6a/roles/9371e5bbc55848949eb951a815f817f2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:33:35.345755 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4183cc81-9006-427b-a5f1-31155b56179c None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:35.346040 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4183cc81-9006-427b-a5f1-31155b56179c None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:35.346309 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4183cc81-9006-427b-a5f1-31155b56179c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:35.373620 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-4183cc81-9006-427b-a5f1-31155b56179c None None] MFA Rules not processed for user `c19de59f54204ea0b44c5c411eae3b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:33:35.374862 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-4183cc81-9006-427b-a5f1-31155b56179c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:35.419269 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:33:35.440501 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1279/2557] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:33:35 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:33:35.445496 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428e805d-01da-40c6-8d62-0d9f6fda1783 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:35.505343 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428e805d-01da-40c6-8d62-0d9f6fda1783 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:35.509846 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29331d76-9740-424f-acb1-9a8ee3e877c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:35.510434 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29331d76-9740-424f-acb1-9a8ee3e877c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:35.510736 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29331d76-9740-424f-acb1-9a8ee3e877c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:35.511009 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29331d76-9740-424f-acb1-9a8ee3e877c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:35.511659 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29331d76-9740-424f-acb1-9a8ee3e877c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:35.513523 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29331d76-9740-424f-acb1-9a8ee3e877c4 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:35.539240 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1279/2558] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:33:35 2022] POST /identity/v3/projects => generated 403 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:33:35.543384 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4183cc81-9006-427b-a5f1-31155b56179c None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:35.554530 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4183cc81-9006-427b-a5f1-31155b56179c None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:35.611592 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87a2e00-40fb-4e98-a724-31f5717b4a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:35.612208 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87a2e00-40fb-4e98-a724-31f5717b4a06 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:35.612513 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87a2e00-40fb-4e98-a724-31f5717b4a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:35.612788 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87a2e00-40fb-4e98-a724-31f5717b4a06 admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:35.613412 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87a2e00-40fb-4e98-a724-31f5717b4a06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:35.616152 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87a2e00-40fb-4e98-a724-31f5717b4a06 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:35.637742 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1280/2559] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:33:35 2022] POST /identity/v3/users => generated 308 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:33:35.645377 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29331d76-9740-424f-acb1-9a8ee3e877c4 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:35.656545 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29331d76-9740-424f-acb1-9a8ee3e877c4 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:35.662585 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d251771-8b18-4a38-84c2-ba1e12443e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:35.663261 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d251771-8b18-4a38-84c2-ba1e12443e89 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:35.663577 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d251771-8b18-4a38-84c2-ba1e12443e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:35.663877 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d251771-8b18-4a38-84c2-ba1e12443e89 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:35.666008 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d251771-8b18-4a38-84c2-ba1e12443e89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:35.668939 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d251771-8b18-4a38-84c2-ba1e12443e89 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:35.680706 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1280/2560] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:33:35 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 12:33:35.684919 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87a2e00-40fb-4e98-a724-31f5717b4a06 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:35.694825 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87a2e00-40fb-4e98-a724-31f5717b4a06 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:35.699236 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef8a813-5e0b-44cb-b369-12cfcd12e22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:35.699874 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef8a813-5e0b-44cb-b369-12cfcd12e22d admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:35.700151 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef8a813-5e0b-44cb-b369-12cfcd12e22d admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:35.700420 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef8a813-5e0b-44cb-b369-12cfcd12e22d admin admin] PATH_INFO: `/v3/projects/78bc7b8188b2407ab1107639319ffe72/users/950a065756eb444a8977cf950b1e43f4/roles/7f53f1c823b746529ba5057bf21b2477` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:35.714707 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef8a813-5e0b-44cb-b369-12cfcd12e22d admin admin] RBAC: Authorizing `identity:create_grant(project_id=78bc7b8188b2407ab1107639319ffe72, user_id=950a065756eb444a8977cf950b1e43f4, role_id=7f53f1c823b746529ba5057bf21b2477)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:35.717330 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef8a813-5e0b-44cb-b369-12cfcd12e22d admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:35.730160 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1281/2561] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:33:35 2022] PUT /identity/v3/projects/78bc7b8188b2407ab1107639319ffe72/users/950a065756eb444a8977cf950b1e43f4/roles/7f53f1c823b746529ba5057bf21b2477 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:33:35.734033 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d251771-8b18-4a38-84c2-ba1e12443e89 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:35.748852 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d251771-8b18-4a38-84c2-ba1e12443e89 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:35.805206 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e6dc7e-3074-4673-a576-c82a0205ba49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:35.805722 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e6dc7e-3074-4673-a576-c82a0205ba49 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:35.805998 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e6dc7e-3074-4673-a576-c82a0205ba49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:35.806263 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e6dc7e-3074-4673-a576-c82a0205ba49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:35.807051 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e6dc7e-3074-4673-a576-c82a0205ba49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:35.808621 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e6dc7e-3074-4673-a576-c82a0205ba49 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:35.819240 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1281/2562] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:33:35 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:33:35.823296 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef8a813-5e0b-44cb-b369-12cfcd12e22d admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:35.833963 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef8a813-5e0b-44cb-b369-12cfcd12e22d admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:35.838505 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9355f0f3-2eff-4e84-9112-ee35aa1a04ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:35.839177 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9355f0f3-2eff-4e84-9112-ee35aa1a04ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:35.839453 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9355f0f3-2eff-4e84-9112-ee35aa1a04ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:35.839724 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9355f0f3-2eff-4e84-9112-ee35aa1a04ce admin admin] PATH_INFO: `/v3/projects/78bc7b8188b2407ab1107639319ffe72/users/950a065756eb444a8977cf950b1e43f4/roles/7f53f1c823b746529ba5057bf21b2477` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:35.841614 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9355f0f3-2eff-4e84-9112-ee35aa1a04ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=78bc7b8188b2407ab1107639319ffe72, user_id=950a065756eb444a8977cf950b1e43f4, role_id=7f53f1c823b746529ba5057bf21b2477)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:35.844313 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9355f0f3-2eff-4e84-9112-ee35aa1a04ce admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:35.854186 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1282/2563] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:33:35 2022] PUT /identity/v3/projects/78bc7b8188b2407ab1107639319ffe72/users/950a065756eb444a8977cf950b1e43f4/roles/7f53f1c823b746529ba5057bf21b2477 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:33:35.864044 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53df4259-2655-4abc-865e-2de291f500d6 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:35.864353 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53df4259-2655-4abc-865e-2de291f500d6 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:35.864683 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53df4259-2655-4abc-865e-2de291f500d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:35.889972 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:33:35.893198 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-53df4259-2655-4abc-865e-2de291f500d6 None None] MFA Rules not processed for user `950a065756eb444a8977cf950b1e43f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:33:35.895550 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-53df4259-2655-4abc-865e-2de291f500d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:35.969337 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1282/2564] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:33:35 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:33:35.980194 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9355f0f3-2eff-4e84-9112-ee35aa1a04ce admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:35.981960 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-9355f0f3-2eff-4e84-9112-ee35aa1a04ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:36.039157 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9355f0f3-2eff-4e84-9112-ee35aa1a04ce admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:36.042761 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57222fa-17ae-4383-9a22-8dcd09e024b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceafc5e4283841528053f01931f10293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:36.043350 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57222fa-17ae-4383-9a22-8dcd09e024b2 service cinder] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:36.043623 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57222fa-17ae-4383-9a22-8dcd09e024b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:36.043887 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57222fa-17ae-4383-9a22-8dcd09e024b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:36.053155 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57222fa-17ae-4383-9a22-8dcd09e024b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:36.054560 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57222fa-17ae-4383-9a22-8dcd09e024b2 service cinder] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:36.063855 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1283/2565] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:33:35 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:33:36.341404 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53df4259-2655-4abc-865e-2de291f500d6 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:36.402087 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53df4259-2655-4abc-865e-2de291f500d6 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:36.406563 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72caf71c-59ae-43f7-9503-09a510948eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:36.407212 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72caf71c-59ae-43f7-9503-09a510948eee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:36.407492 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72caf71c-59ae-43f7-9503-09a510948eee admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:36.407763 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72caf71c-59ae-43f7-9503-09a510948eee admin admin] PATH_INFO: `/v3/users/c19de59f54204ea0b44c5c411eae3b6a` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:36.408862 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72caf71c-59ae-43f7-9503-09a510948eee admin admin] RBAC: Authorizing `identity:delete_user(user_id=c19de59f54204ea0b44c5c411eae3b6a)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:36.411292 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72caf71c-59ae-43f7-9503-09a510948eee admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:36.457608 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-72caf71c-59ae-43f7-9503-09a510948eee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c19de59f54204ea0b44c5c411eae3b6a'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:36.467042 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-72caf71c-59ae-43f7-9503-09a510948eee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c19de59f54204ea0b44c5c411eae3b6a'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:36.467737 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-72caf71c-59ae-43f7-9503-09a510948eee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c19de59f54204ea0b44c5c411eae3b6a'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:36.468346 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-72caf71c-59ae-43f7-9503-09a510948eee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c19de59f54204ea0b44c5c411eae3b6a'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:36.476243 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-72caf71c-59ae-43f7-9503-09a510948eee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c19de59f54204ea0b44c5c411eae3b6a'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:36.493754 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1283/2566] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:33:36 2022] DELETE /identity/v3/users/c19de59f54204ea0b44c5c411eae3b6a => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:33:36.498251 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2919075-bfc7-4ba9-8f5f-e78bf41dc40c None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:36.498728 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2919075-bfc7-4ba9-8f5f-e78bf41dc40c None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:36.498948 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2919075-bfc7-4ba9-8f5f-e78bf41dc40c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:36.517726 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-c2919075-bfc7-4ba9-8f5f-e78bf41dc40c None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:33:36.518994 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-c2919075-bfc7-4ba9-8f5f-e78bf41dc40c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:36.557502 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:33:36.578484 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1284/2567] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:33:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:33:36.588262 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72caf71c-59ae-43f7-9503-09a510948eee admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:36.589601 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-72caf71c-59ae-43f7-9503-09a510948eee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:36.610451 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:33:36.651457 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72caf71c-59ae-43f7-9503-09a510948eee admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:36.655205 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d113a7bd-6df1-4607-ac78-885f68014d9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:36.655812 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d113a7bd-6df1-4607-ac78-885f68014d9e service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:36.656093 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d113a7bd-6df1-4607-ac78-885f68014d9e service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:36.656365 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d113a7bd-6df1-4607-ac78-885f68014d9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:36.666223 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d113a7bd-6df1-4607-ac78-885f68014d9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:36.667668 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d113a7bd-6df1-4607-ac78-885f68014d9e service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:36.677740 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1284/2568] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:33:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:33:36.956393 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2919075-bfc7-4ba9-8f5f-e78bf41dc40c None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:36.958329 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-c2919075-bfc7-4ba9-8f5f-e78bf41dc40c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:36.973712 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2919075-bfc7-4ba9-8f5f-e78bf41dc40c None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:36.976803 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc07bab9-e49a-4d44-a2ce-a57fdc39b35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:36.977454 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc07bab9-e49a-4d44-a2ce-a57fdc39b35e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:36.977735 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc07bab9-e49a-4d44-a2ce-a57fdc39b35e admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:36.978037 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc07bab9-e49a-4d44-a2ce-a57fdc39b35e admin admin] PATH_INFO: `/v3/projects/17025d0e82564178b9c81d470e2d073b` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:36.979170 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc07bab9-e49a-4d44-a2ce-a57fdc39b35e admin admin] RBAC: Authorizing `identity:delete_project(project_id=17025d0e82564178b9c81d470e2d073b)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:36.981069 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc07bab9-e49a-4d44-a2ce-a57fdc39b35e admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:37.028423 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-fc07bab9-e49a-4d44-a2ce-a57fdc39b35e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17025d0e82564178b9c81d470e2d073b', 'request_id': 'req-fc07bab9-e49a-4d44-a2ce-a57fdc39b35e'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:37.033761 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-fc07bab9-e49a-4d44-a2ce-a57fdc39b35e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17025d0e82564178b9c81d470e2d073b', 'request_id': 'req-fc07bab9-e49a-4d44-a2ce-a57fdc39b35e'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:37.041609 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-fc07bab9-e49a-4d44-a2ce-a57fdc39b35e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17025d0e82564178b9c81d470e2d073b', 'request_id': 'req-fc07bab9-e49a-4d44-a2ce-a57fdc39b35e'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:37.052811 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-fc07bab9-e49a-4d44-a2ce-a57fdc39b35e admin admin] The token cache is being invalidate because project 17025d0e82564178b9c81d470e2d073b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:33:37.053097 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-fc07bab9-e49a-4d44-a2ce-a57fdc39b35e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:37.053722 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-fc07bab9-e49a-4d44-a2ce-a57fdc39b35e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:37.055233 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1285/2569] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:33:36 2022] DELETE /identity/v3/projects/17025d0e82564178b9c81d470e2d073b => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:33:37.059226 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d113a7bd-6df1-4607-ac78-885f68014d9e service neutron] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:37.069546 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d113a7bd-6df1-4607-ac78-885f68014d9e service neutron] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:37.124716 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92010642-f1e0-4cbe-8bc9-cc220e6c6095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:37.125247 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92010642-f1e0-4cbe-8bc9-cc220e6c6095 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:37.125523 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92010642-f1e0-4cbe-8bc9-cc220e6c6095 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:37.125792 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92010642-f1e0-4cbe-8bc9-cc220e6c6095 admin admin] PATH_INFO: `/v3/users/950a065756eb444a8977cf950b1e43f4` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:37.127156 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92010642-f1e0-4cbe-8bc9-cc220e6c6095 admin admin] RBAC: Authorizing `identity:delete_user(user_id=950a065756eb444a8977cf950b1e43f4)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:37.129051 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92010642-f1e0-4cbe-8bc9-cc220e6c6095 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:37.173832 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-92010642-f1e0-4cbe-8bc9-cc220e6c6095 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '950a065756eb444a8977cf950b1e43f4'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:37.180974 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-92010642-f1e0-4cbe-8bc9-cc220e6c6095 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '950a065756eb444a8977cf950b1e43f4'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:37.181598 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-92010642-f1e0-4cbe-8bc9-cc220e6c6095 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '950a065756eb444a8977cf950b1e43f4'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:37.182190 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-92010642-f1e0-4cbe-8bc9-cc220e6c6095 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '950a065756eb444a8977cf950b1e43f4'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:37.189017 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-92010642-f1e0-4cbe-8bc9-cc220e6c6095 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '950a065756eb444a8977cf950b1e43f4'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:37.207029 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1285/2570] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:33:37 2022] DELETE /identity/v3/users/950a065756eb444a8977cf950b1e43f4 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:33:37.468759 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc07bab9-e49a-4d44-a2ce-a57fdc39b35e admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:37.470178 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-fc07bab9-e49a-4d44-a2ce-a57fdc39b35e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:37.482886 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc07bab9-e49a-4d44-a2ce-a57fdc39b35e admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:37.542376 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8347288a-0dd3-4805-9593-7d1a1ba593c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:37.543044 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347288a-0dd3-4805-9593-7d1a1ba593c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:37.543300 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347288a-0dd3-4805-9593-7d1a1ba593c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:37.543573 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347288a-0dd3-4805-9593-7d1a1ba593c6 admin admin] PATH_INFO: `/v3/projects/78bc7b8188b2407ab1107639319ffe72` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:37.544685 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8347288a-0dd3-4805-9593-7d1a1ba593c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78bc7b8188b2407ab1107639319ffe72)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:37.546578 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8347288a-0dd3-4805-9593-7d1a1ba593c6 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:37.591641 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-8347288a-0dd3-4805-9593-7d1a1ba593c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78bc7b8188b2407ab1107639319ffe72', 'request_id': 'req-8347288a-0dd3-4805-9593-7d1a1ba593c6'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:37.597157 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-8347288a-0dd3-4805-9593-7d1a1ba593c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78bc7b8188b2407ab1107639319ffe72', 'request_id': 'req-8347288a-0dd3-4805-9593-7d1a1ba593c6'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:37.604933 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-8347288a-0dd3-4805-9593-7d1a1ba593c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78bc7b8188b2407ab1107639319ffe72', 'request_id': 'req-8347288a-0dd3-4805-9593-7d1a1ba593c6'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:37.606970 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:33:37.618429 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-8347288a-0dd3-4805-9593-7d1a1ba593c6 admin admin] The token cache is being invalidate because project 78bc7b8188b2407ab1107639319ffe72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:33:37.618905 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-8347288a-0dd3-4805-9593-7d1a1ba593c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:37.619898 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-8347288a-0dd3-4805-9593-7d1a1ba593c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:37.621612 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1286/2571] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:33:37 2022] DELETE /identity/v3/projects/78bc7b8188b2407ab1107639319ffe72 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:33:37.626736 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08df199-d65e-47d8-806e-c2dce591d228 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:37.627248 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08df199-d65e-47d8-806e-c2dce591d228 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:37.627347 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08df199-d65e-47d8-806e-c2dce591d228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:37.647475 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-a08df199-d65e-47d8-806e-c2dce591d228 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:33:37.648616 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-a08df199-d65e-47d8-806e-c2dce591d228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:37.681690 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:33:37.709647 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1286/2572] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:33:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:33:37.718507 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb29a505-461c-4127-bc3f-cbdc9cf28a83 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:37.718830 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb29a505-461c-4127-bc3f-cbdc9cf28a83 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:37.719112 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb29a505-461c-4127-bc3f-cbdc9cf28a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:37.739198 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-eb29a505-461c-4127-bc3f-cbdc9cf28a83 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:33:37.740385 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-eb29a505-461c-4127-bc3f-cbdc9cf28a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:37.748613 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1287/2573] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:33:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:33:37.752928 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08df199-d65e-47d8-806e-c2dce591d228 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:37.763575 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08df199-d65e-47d8-806e-c2dce591d228 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:37.768226 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddac2f6-17e5-4c6a-9095-d64fcc57d66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:37.768813 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddac2f6-17e5-4c6a-9095-d64fcc57d66e admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:37.769087 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddac2f6-17e5-4c6a-9095-d64fcc57d66e admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:37.769352 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddac2f6-17e5-4c6a-9095-d64fcc57d66e admin admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:37.770548 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddac2f6-17e5-4c6a-9095-d64fcc57d66e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:33:37.770873 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddac2f6-17e5-4c6a-9095-d64fcc57d66e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:37.772472 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddac2f6-17e5-4c6a-9095-d64fcc57d66e admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:37.783917 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1287/2574] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 15 12:33:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:33:37.788657 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb29a505-461c-4127-bc3f-cbdc9cf28a83 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:37.797634 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb29a505-461c-4127-bc3f-cbdc9cf28a83 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:37.802475 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbfcd2b-5441-4cbb-8979-03206400d1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:37.803112 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbfcd2b-5441-4cbb-8979-03206400d1bb admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:37.803391 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbfcd2b-5441-4cbb-8979-03206400d1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:37.803661 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbfcd2b-5441-4cbb-8979-03206400d1bb admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:37.804291 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbfcd2b-5441-4cbb-8979-03206400d1bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:37.806208 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbfcd2b-5441-4cbb-8979-03206400d1bb admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:37.836371 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1288/2575] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:33:37 2022] POST /identity/v3/projects => generated 363 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:33:37.840554 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddac2f6-17e5-4c6a-9095-d64fcc57d66e admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:37.850770 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddac2f6-17e5-4c6a-9095-d64fcc57d66e admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:37.906100 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f4e23-3867-4cac-a55d-6c96ea29ff7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:37.906626 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f4e23-3867-4cac-a55d-6c96ea29ff7e admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:37.906936 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f4e23-3867-4cac-a55d-6c96ea29ff7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:37.907207 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f4e23-3867-4cac-a55d-6c96ea29ff7e admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:37.907836 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84f4e23-3867-4cac-a55d-6c96ea29ff7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:37.909742 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84f4e23-3867-4cac-a55d-6c96ea29ff7e admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:37.929844 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1288/2576] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:33:37 2022] POST /identity/v3/users => generated 282 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:33:37.933936 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbfcd2b-5441-4cbb-8979-03206400d1bb admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:37.944670 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbfcd2b-5441-4cbb-8979-03206400d1bb admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:37.949198 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e15f352-ed83-42d3-9f2e-1cee43b3db08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:37.949786 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15f352-ed83-42d3-9f2e-1cee43b3db08 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:37.950061 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15f352-ed83-42d3-9f2e-1cee43b3db08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:37.950326 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15f352-ed83-42d3-9f2e-1cee43b3db08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:37.951020 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e15f352-ed83-42d3-9f2e-1cee43b3db08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:37.952622 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e15f352-ed83-42d3-9f2e-1cee43b3db08 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:37.962797 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1289/2577] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:33:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:33:37.966644 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f4e23-3867-4cac-a55d-6c96ea29ff7e admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:37.977048 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f4e23-3867-4cac-a55d-6c96ea29ff7e admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:37.981683 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ec6efa-7fe9-4a2a-aba9-01dbeb4188cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:37.982280 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec6efa-7fe9-4a2a-aba9-01dbeb4188cb admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:37.982595 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec6efa-7fe9-4a2a-aba9-01dbeb4188cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:37.982890 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec6efa-7fe9-4a2a-aba9-01dbeb4188cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:37.983536 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ec6efa-7fe9-4a2a-aba9-01dbeb4188cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:37.985119 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ec6efa-7fe9-4a2a-aba9-01dbeb4188cb admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:37.995842 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1289/2578] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:33:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:33:38.000041 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e15f352-ed83-42d3-9f2e-1cee43b3db08 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:38.010896 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e15f352-ed83-42d3-9f2e-1cee43b3db08 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:38.015375 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef979a2-10ce-40b5-8369-4749d0a6913e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:38.016015 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef979a2-10ce-40b5-8369-4749d0a6913e admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:38.016290 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef979a2-10ce-40b5-8369-4749d0a6913e admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:38.016556 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef979a2-10ce-40b5-8369-4749d0a6913e admin admin] PATH_INFO: `/v3/projects/ecf4e837ba664bb28c3520d5705b6454/users/dfa324989a63448780ed615ac694b337/roles/9371e5bbc55848949eb951a815f817f2` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:38.031263 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef979a2-10ce-40b5-8369-4749d0a6913e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecf4e837ba664bb28c3520d5705b6454, user_id=dfa324989a63448780ed615ac694b337, role_id=9371e5bbc55848949eb951a815f817f2)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:38.034080 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef979a2-10ce-40b5-8369-4749d0a6913e admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:38.047075 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1290/2579] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:33:37 2022] PUT /identity/v3/projects/ecf4e837ba664bb28c3520d5705b6454/users/dfa324989a63448780ed615ac694b337/roles/9371e5bbc55848949eb951a815f817f2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:33:38.057233 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c1bc6-39fd-4ab2-a8dc-c101bab1eca0 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:38.057547 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c1bc6-39fd-4ab2-a8dc-c101bab1eca0 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:38.057823 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c1bc6-39fd-4ab2-a8dc-c101bab1eca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:38.085776 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-bc9c1bc6-39fd-4ab2-a8dc-c101bab1eca0 None None] MFA Rules not processed for user `dfa324989a63448780ed615ac694b337`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:33:38.087019 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-bc9c1bc6-39fd-4ab2-a8dc-c101bab1eca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:38.151433 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1290/2580] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:33:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:33:38.155817 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef979a2-10ce-40b5-8369-4749d0a6913e admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:38.216560 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef979a2-10ce-40b5-8369-4749d0a6913e admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:38.221178 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6496a82-71cf-4c49-b043-3a5db74c6184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:38.221771 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6496a82-71cf-4c49-b043-3a5db74c6184 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:38.222047 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6496a82-71cf-4c49-b043-3a5db74c6184 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:38.222313 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6496a82-71cf-4c49-b043-3a5db74c6184 admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:38.222975 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6496a82-71cf-4c49-b043-3a5db74c6184 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:38.224878 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6496a82-71cf-4c49-b043-3a5db74c6184 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:38.250822 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1291/2581] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:33:38 2022] POST /identity/v3/projects => generated 365 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:33:38.255820 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9c1bc6-39fd-4ab2-a8dc-c101bab1eca0 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:38.267398 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9c1bc6-39fd-4ab2-a8dc-c101bab1eca0 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:38.299186 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:33:38.325001 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cba16ca-1666-48e5-8568-2c76f93f4e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:38.325635 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cba16ca-1666-48e5-8568-2c76f93f4e6a admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:38.325905 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cba16ca-1666-48e5-8568-2c76f93f4e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:38.326169 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cba16ca-1666-48e5-8568-2c76f93f4e6a admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:38.326861 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cba16ca-1666-48e5-8568-2c76f93f4e6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:38.328740 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cba16ca-1666-48e5-8568-2c76f93f4e6a admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:38.348065 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1291/2582] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:33:38 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:33:38.352001 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6496a82-71cf-4c49-b043-3a5db74c6184 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:38.362195 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6496a82-71cf-4c49-b043-3a5db74c6184 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:38.367412 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee2f102-533e-4471-a4d8-f46bbc523c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:38.368002 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee2f102-533e-4471-a4d8-f46bbc523c15 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:38.368279 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee2f102-533e-4471-a4d8-f46bbc523c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:38.368548 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee2f102-533e-4471-a4d8-f46bbc523c15 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:38.369182 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee2f102-533e-4471-a4d8-f46bbc523c15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:38.370808 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee2f102-533e-4471-a4d8-f46bbc523c15 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:38.381920 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1292/2583] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:33:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:33:38.385690 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cba16ca-1666-48e5-8568-2c76f93f4e6a admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:38.395410 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cba16ca-1666-48e5-8568-2c76f93f4e6a admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:38.399933 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fa4c9f-f9bc-4a04-b9c8-36727926e3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:38.400563 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa4c9f-f9bc-4a04-b9c8-36727926e3d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:38.400839 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa4c9f-f9bc-4a04-b9c8-36727926e3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:38.401108 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa4c9f-f9bc-4a04-b9c8-36727926e3d7 admin admin] PATH_INFO: `/v3/projects/c69694871d4c4d10bbdf68ba808a8e11/users/259772dec9b74089b1a19bf7cf579046/roles/7f53f1c823b746529ba5057bf21b2477` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:38.415405 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fa4c9f-f9bc-4a04-b9c8-36727926e3d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c69694871d4c4d10bbdf68ba808a8e11, user_id=259772dec9b74089b1a19bf7cf579046, role_id=7f53f1c823b746529ba5057bf21b2477)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:38.418026 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fa4c9f-f9bc-4a04-b9c8-36727926e3d7 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:38.431318 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1292/2584] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:33:38 2022] PUT /identity/v3/projects/c69694871d4c4d10bbdf68ba808a8e11/users/259772dec9b74089b1a19bf7cf579046/roles/7f53f1c823b746529ba5057bf21b2477 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:33:38.435102 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee2f102-533e-4471-a4d8-f46bbc523c15 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:38.445421 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee2f102-533e-4471-a4d8-f46bbc523c15 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:38.498678 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e7b052-31a6-4fc7-83de-5d6c667a3151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:38.499230 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7b052-31a6-4fc7-83de-5d6c667a3151 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:38.499505 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7b052-31a6-4fc7-83de-5d6c667a3151 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:38.499771 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7b052-31a6-4fc7-83de-5d6c667a3151 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:38.500390 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e7b052-31a6-4fc7-83de-5d6c667a3151 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:38.502214 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e7b052-31a6-4fc7-83de-5d6c667a3151 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:38.512199 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1293/2585] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:33:38 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:33:38.516242 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fa4c9f-f9bc-4a04-b9c8-36727926e3d7 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:38.526464 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fa4c9f-f9bc-4a04-b9c8-36727926e3d7 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:38.531024 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30e7d07-970e-4508-930b-95f27baebb94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:38.531657 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30e7d07-970e-4508-930b-95f27baebb94 admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:38.531933 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30e7d07-970e-4508-930b-95f27baebb94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:38.532202 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30e7d07-970e-4508-930b-95f27baebb94 admin admin] PATH_INFO: `/v3/projects/c69694871d4c4d10bbdf68ba808a8e11/users/259772dec9b74089b1a19bf7cf579046/roles/7f53f1c823b746529ba5057bf21b2477` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:38.534215 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30e7d07-970e-4508-930b-95f27baebb94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c69694871d4c4d10bbdf68ba808a8e11, user_id=259772dec9b74089b1a19bf7cf579046, role_id=7f53f1c823b746529ba5057bf21b2477)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:38.537494 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30e7d07-970e-4508-930b-95f27baebb94 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:38.547467 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1293/2586] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:33:38 2022] PUT /identity/v3/projects/c69694871d4c4d10bbdf68ba808a8e11/users/259772dec9b74089b1a19bf7cf579046/roles/7f53f1c823b746529ba5057bf21b2477 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:33:38.558016 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f636dd8f-057a-48b8-96f0-6d5160e7866f None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:38.558498 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f636dd8f-057a-48b8-96f0-6d5160e7866f None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:38.558615 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f636dd8f-057a-48b8-96f0-6d5160e7866f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:38.565582 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:33:38.586982 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-f636dd8f-057a-48b8-96f0-6d5160e7866f None None] MFA Rules not processed for user `259772dec9b74089b1a19bf7cf579046`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:33:38.588193 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-f636dd8f-057a-48b8-96f0-6d5160e7866f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:38.654468 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1294/2587] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:33:38 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:33:38.666049 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30e7d07-970e-4508-930b-95f27baebb94 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:38.667766 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-b30e7d07-970e-4508-930b-95f27baebb94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:38.847761 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30e7d07-970e-4508-930b-95f27baebb94 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:38.853931 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd4d0cc-b4d5-4631-8039-2a28d23edf7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceafc5e4283841528053f01931f10293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:38.854557 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd4d0cc-b4d5-4631-8039-2a28d23edf7a service cinder] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:38.854948 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd4d0cc-b4d5-4631-8039-2a28d23edf7a service cinder] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:38.855247 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd4d0cc-b4d5-4631-8039-2a28d23edf7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:38.864760 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd4d0cc-b4d5-4631-8039-2a28d23edf7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:38.866162 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd4d0cc-b4d5-4631-8039-2a28d23edf7a service cinder] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:38.875651 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1294/2588] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:33:38 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:33:39.280883 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f636dd8f-057a-48b8-96f0-6d5160e7866f None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:39.342230 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f636dd8f-057a-48b8-96f0-6d5160e7866f None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:39.346765 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787201f6-1283-4e30-a830-6c82ebc6ce97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:39.347399 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787201f6-1283-4e30-a830-6c82ebc6ce97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:39.347674 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787201f6-1283-4e30-a830-6c82ebc6ce97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:39.347945 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787201f6-1283-4e30-a830-6c82ebc6ce97 admin admin] PATH_INFO: `/v3/users/dfa324989a63448780ed615ac694b337` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:39.349068 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787201f6-1283-4e30-a830-6c82ebc6ce97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfa324989a63448780ed615ac694b337)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:39.351036 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787201f6-1283-4e30-a830-6c82ebc6ce97 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:39.394133 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-787201f6-1283-4e30-a830-6c82ebc6ce97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfa324989a63448780ed615ac694b337'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:39.401950 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-787201f6-1283-4e30-a830-6c82ebc6ce97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfa324989a63448780ed615ac694b337'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:39.402576 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-787201f6-1283-4e30-a830-6c82ebc6ce97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfa324989a63448780ed615ac694b337'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:39.403211 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-787201f6-1283-4e30-a830-6c82ebc6ce97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfa324989a63448780ed615ac694b337'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:39.410030 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-787201f6-1283-4e30-a830-6c82ebc6ce97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfa324989a63448780ed615ac694b337'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:39.427452 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1295/2589] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:33:39 2022] DELETE /identity/v3/users/dfa324989a63448780ed615ac694b337 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:33:39.431948 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b036711-1f45-4f6d-b743-a706aa8101a8 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:39.432333 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b036711-1f45-4f6d-b743-a706aa8101a8 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:39.432607 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b036711-1f45-4f6d-b743-a706aa8101a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:39.451127 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-0b036711-1f45-4f6d-b743-a706aa8101a8 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:33:39.452295 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-0b036711-1f45-4f6d-b743-a706aa8101a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:39.508679 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1295/2590] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:33:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:33:39.518214 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787201f6-1283-4e30-a830-6c82ebc6ce97 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:39.519618 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-787201f6-1283-4e30-a830-6c82ebc6ce97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:39.529705 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:33:39.579551 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787201f6-1283-4e30-a830-6c82ebc6ce97 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:39.583209 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81df80b0-030d-42a3-b9f0-e3a8fc190d2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:39.583802 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df80b0-030d-42a3-b9f0-e3a8fc190d2d service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:39.584079 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df80b0-030d-42a3-b9f0-e3a8fc190d2d service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:39.584346 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df80b0-030d-42a3-b9f0-e3a8fc190d2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:39.593151 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81df80b0-030d-42a3-b9f0-e3a8fc190d2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:39.594564 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81df80b0-030d-42a3-b9f0-e3a8fc190d2d service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:39.604238 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1296/2591] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:33:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 12:33:39.878092 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b036711-1f45-4f6d-b743-a706aa8101a8 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:39.879560 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-0b036711-1f45-4f6d-b743-a706aa8101a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:39.893866 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b036711-1f45-4f6d-b743-a706aa8101a8 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:39.899516 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011e5c53-e716-4bf8-8217-334d7aae959a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:39.900241 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e5c53-e716-4bf8-8217-334d7aae959a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:39.900584 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e5c53-e716-4bf8-8217-334d7aae959a admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:39.900924 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e5c53-e716-4bf8-8217-334d7aae959a admin admin] PATH_INFO: `/v3/projects/ecf4e837ba664bb28c3520d5705b6454` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:39.902037 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011e5c53-e716-4bf8-8217-334d7aae959a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecf4e837ba664bb28c3520d5705b6454)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:39.903960 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011e5c53-e716-4bf8-8217-334d7aae959a admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:39.934595 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:33:39.952324 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-011e5c53-e716-4bf8-8217-334d7aae959a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecf4e837ba664bb28c3520d5705b6454', 'request_id': 'req-011e5c53-e716-4bf8-8217-334d7aae959a'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:39.958770 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-011e5c53-e716-4bf8-8217-334d7aae959a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecf4e837ba664bb28c3520d5705b6454', 'request_id': 'req-011e5c53-e716-4bf8-8217-334d7aae959a'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:39.964169 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-011e5c53-e716-4bf8-8217-334d7aae959a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecf4e837ba664bb28c3520d5705b6454', 'request_id': 'req-011e5c53-e716-4bf8-8217-334d7aae959a'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:39.979891 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-011e5c53-e716-4bf8-8217-334d7aae959a admin admin] The token cache is being invalidate because project ecf4e837ba664bb28c3520d5705b6454 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:33:39.980199 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-011e5c53-e716-4bf8-8217-334d7aae959a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:39.980817 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-011e5c53-e716-4bf8-8217-334d7aae959a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:39.982282 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1296/2592] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:33:39 2022] DELETE /identity/v3/projects/ecf4e837ba664bb28c3520d5705b6454 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:33:39.986183 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81df80b0-030d-42a3-b9f0-e3a8fc190d2d service neutron] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:39.995573 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81df80b0-030d-42a3-b9f0-e3a8fc190d2d service neutron] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:40.052014 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcf9ce0-e0d7-4743-9d14-8e3b46886564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:40.052593 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf9ce0-e0d7-4743-9d14-8e3b46886564 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:40.052872 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf9ce0-e0d7-4743-9d14-8e3b46886564 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:40.053139 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf9ce0-e0d7-4743-9d14-8e3b46886564 admin admin] PATH_INFO: `/v3/users/259772dec9b74089b1a19bf7cf579046` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:40.054236 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcf9ce0-e0d7-4743-9d14-8e3b46886564 admin admin] RBAC: Authorizing `identity:delete_user(user_id=259772dec9b74089b1a19bf7cf579046)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:40.056177 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcf9ce0-e0d7-4743-9d14-8e3b46886564 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:40.101576 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-1dcf9ce0-e0d7-4743-9d14-8e3b46886564 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '259772dec9b74089b1a19bf7cf579046'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:40.108403 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-1dcf9ce0-e0d7-4743-9d14-8e3b46886564 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '259772dec9b74089b1a19bf7cf579046'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:40.109059 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-1dcf9ce0-e0d7-4743-9d14-8e3b46886564 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '259772dec9b74089b1a19bf7cf579046'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:40.109670 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-1dcf9ce0-e0d7-4743-9d14-8e3b46886564 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '259772dec9b74089b1a19bf7cf579046'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:40.116484 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-1dcf9ce0-e0d7-4743-9d14-8e3b46886564 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '259772dec9b74089b1a19bf7cf579046'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:40.134121 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1297/2593] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:33:39 2022] DELETE /identity/v3/users/259772dec9b74089b1a19bf7cf579046 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:33:40.396464 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011e5c53-e716-4bf8-8217-334d7aae959a admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:40.397996 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-011e5c53-e716-4bf8-8217-334d7aae959a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:40.411286 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011e5c53-e716-4bf8-8217-334d7aae959a admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:40.468196 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e81ad7-98bf-41d2-9fa4-86157d05aa70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:40.468805 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e81ad7-98bf-41d2-9fa4-86157d05aa70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:40.469085 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e81ad7-98bf-41d2-9fa4-86157d05aa70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:40.469347 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e81ad7-98bf-41d2-9fa4-86157d05aa70 admin admin] PATH_INFO: `/v3/projects/c69694871d4c4d10bbdf68ba808a8e11` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:40.470433 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e81ad7-98bf-41d2-9fa4-86157d05aa70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c69694871d4c4d10bbdf68ba808a8e11)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:40.472321 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e81ad7-98bf-41d2-9fa4-86157d05aa70 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:40.518576 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-c1e81ad7-98bf-41d2-9fa4-86157d05aa70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c69694871d4c4d10bbdf68ba808a8e11', 'request_id': 'req-c1e81ad7-98bf-41d2-9fa4-86157d05aa70'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:40.524458 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-c1e81ad7-98bf-41d2-9fa4-86157d05aa70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c69694871d4c4d10bbdf68ba808a8e11', 'request_id': 'req-c1e81ad7-98bf-41d2-9fa4-86157d05aa70'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:40.529826 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-c1e81ad7-98bf-41d2-9fa4-86157d05aa70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c69694871d4c4d10bbdf68ba808a8e11', 'request_id': 'req-c1e81ad7-98bf-41d2-9fa4-86157d05aa70'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:40.541749 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-c1e81ad7-98bf-41d2-9fa4-86157d05aa70 admin admin] The token cache is being invalidate because project c69694871d4c4d10bbdf68ba808a8e11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:33:40.542216 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-c1e81ad7-98bf-41d2-9fa4-86157d05aa70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:40.542862 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-c1e81ad7-98bf-41d2-9fa4-86157d05aa70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:40.544294 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1297/2594] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:33:40 2022] DELETE /identity/v3/projects/c69694871d4c4d10bbdf68ba808a8e11 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:33:40.549056 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b172354c-a731-4126-a6b1-fa91ae895ae4 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:40.549365 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b172354c-a731-4126-a6b1-fa91ae895ae4 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:40.549641 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b172354c-a731-4126-a6b1-fa91ae895ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:40.569837 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-b172354c-a731-4126-a6b1-fa91ae895ae4 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:33:40.571067 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-b172354c-a731-4126-a6b1-fa91ae895ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:40.594116 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:33:40.631067 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1298/2595] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:33:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:33:40.638911 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd918d57-22e8-4405-b9f6-2f70b4ce90ad None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:40.639192 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd918d57-22e8-4405-b9f6-2f70b4ce90ad None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:40.639462 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd918d57-22e8-4405-b9f6-2f70b4ce90ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:40.658297 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-bd918d57-22e8-4405-b9f6-2f70b4ce90ad None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:33:40.659542 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-bd918d57-22e8-4405-b9f6-2f70b4ce90ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:40.667221 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1298/2596] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:33:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:33:40.671137 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b172354c-a731-4126-a6b1-fa91ae895ae4 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:40.681004 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b172354c-a731-4126-a6b1-fa91ae895ae4 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:40.685494 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e937c4c-70d0-4a35-b90e-6d800635e74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:40.686087 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e937c4c-70d0-4a35-b90e-6d800635e74a admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:40.686364 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e937c4c-70d0-4a35-b90e-6d800635e74a admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:40.686648 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e937c4c-70d0-4a35-b90e-6d800635e74a admin admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:40.687301 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e937c4c-70d0-4a35-b90e-6d800635e74a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:33:40.687603 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e937c4c-70d0-4a35-b90e-6d800635e74a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:40.689186 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e937c4c-70d0-4a35-b90e-6d800635e74a admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:40.701122 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1299/2597] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 15 12:33:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:33:40.705087 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd918d57-22e8-4405-b9f6-2f70b4ce90ad None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:40.714584 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd918d57-22e8-4405-b9f6-2f70b4ce90ad None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:40.719185 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77c6576-7924-4daf-80e5-0aec7e3014ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:40.719763 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77c6576-7924-4daf-80e5-0aec7e3014ce admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:40.720036 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77c6576-7924-4daf-80e5-0aec7e3014ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:40.720300 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77c6576-7924-4daf-80e5-0aec7e3014ce admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:40.720922 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77c6576-7924-4daf-80e5-0aec7e3014ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:40.723547 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77c6576-7924-4daf-80e5-0aec7e3014ce admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:40.749170 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1299/2598] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:33:40 2022] POST /identity/v3/projects => generated 367 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 12:33:40.753572 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e937c4c-70d0-4a35-b90e-6d800635e74a admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:40.763854 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e937c4c-70d0-4a35-b90e-6d800635e74a admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:40.820262 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85e2d1f-3374-4c16-858e-d565f9c8db7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:40.820860 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e2d1f-3374-4c16-858e-d565f9c8db7e admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:40.821133 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e2d1f-3374-4c16-858e-d565f9c8db7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:40.821396 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e2d1f-3374-4c16-858e-d565f9c8db7e admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:40.822047 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85e2d1f-3374-4c16-858e-d565f9c8db7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:40.823952 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85e2d1f-3374-4c16-858e-d565f9c8db7e admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:40.845406 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1300/2599] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:33:40 2022] POST /identity/v3/users => generated 284 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:33:40.849422 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77c6576-7924-4daf-80e5-0aec7e3014ce admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:40.859600 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77c6576-7924-4daf-80e5-0aec7e3014ce admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:40.864152 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741c357f-7207-4cdd-953e-6bc706d826d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:40.864767 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741c357f-7207-4cdd-953e-6bc706d826d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:40.865041 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741c357f-7207-4cdd-953e-6bc706d826d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:40.865309 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741c357f-7207-4cdd-953e-6bc706d826d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:40.866020 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741c357f-7207-4cdd-953e-6bc706d826d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:40.867636 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741c357f-7207-4cdd-953e-6bc706d826d5 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:40.881261 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1300/2600] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:33:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:33:40.882611 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85e2d1f-3374-4c16-858e-d565f9c8db7e admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:40.892639 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85e2d1f-3374-4c16-858e-d565f9c8db7e admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:40.897817 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef5c39e-c009-4283-afd2-340d31d97276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:40.898405 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef5c39e-c009-4283-afd2-340d31d97276 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:40.898682 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef5c39e-c009-4283-afd2-340d31d97276 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:40.898979 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef5c39e-c009-4283-afd2-340d31d97276 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:40.899692 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef5c39e-c009-4283-afd2-340d31d97276 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:40.901201 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef5c39e-c009-4283-afd2-340d31d97276 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:40.914851 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1301/2601] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:33:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 12:33:40.916155 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741c357f-7207-4cdd-953e-6bc706d826d5 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:40.922505 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:33:40.926661 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741c357f-7207-4cdd-953e-6bc706d826d5 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:40.932624 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570c067f-35cb-449e-b98f-399a361d390b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:40.933460 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570c067f-35cb-449e-b98f-399a361d390b admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:40.933903 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570c067f-35cb-449e-b98f-399a361d390b admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:40.934186 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570c067f-35cb-449e-b98f-399a361d390b admin admin] PATH_INFO: `/v3/projects/b3b03e2976c64447a5c10c6dae4c937c/users/a84b879140154d5297c94cc398f1c3e7/roles/9371e5bbc55848949eb951a815f817f2` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:40.949174 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570c067f-35cb-449e-b98f-399a361d390b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3b03e2976c64447a5c10c6dae4c937c, user_id=a84b879140154d5297c94cc398f1c3e7, role_id=9371e5bbc55848949eb951a815f817f2)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:40.951829 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570c067f-35cb-449e-b98f-399a361d390b admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:40.964963 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1301/2602] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:33:40 2022] PUT /identity/v3/projects/b3b03e2976c64447a5c10c6dae4c937c/users/a84b879140154d5297c94cc398f1c3e7/roles/9371e5bbc55848949eb951a815f817f2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:33:40.975786 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b859c8-1f17-42a3-9994-c947dcd3d340 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:40.976070 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b859c8-1f17-42a3-9994-c947dcd3d340 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:40.976339 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b859c8-1f17-42a3-9994-c947dcd3d340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:41.004292 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-f4b859c8-1f17-42a3-9994-c947dcd3d340 None None] MFA Rules not processed for user `a84b879140154d5297c94cc398f1c3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:33:41.005504 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-f4b859c8-1f17-42a3-9994-c947dcd3d340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:41.068653 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1302/2603] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:33:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:33:41.073111 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570c067f-35cb-449e-b98f-399a361d390b admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:41.135694 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570c067f-35cb-449e-b98f-399a361d390b admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:41.140239 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb13248-eb9d-4479-aed8-deddef5a661e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:41.140836 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb13248-eb9d-4479-aed8-deddef5a661e admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:41.141127 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb13248-eb9d-4479-aed8-deddef5a661e admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:41.141397 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb13248-eb9d-4479-aed8-deddef5a661e admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:41.142069 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb13248-eb9d-4479-aed8-deddef5a661e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:41.144245 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb13248-eb9d-4479-aed8-deddef5a661e admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:41.174437 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1302/2604] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:33:41 2022] POST /identity/v3/projects => generated 367 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:33:41.179225 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b859c8-1f17-42a3-9994-c947dcd3d340 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:41.190322 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b859c8-1f17-42a3-9994-c947dcd3d340 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:41.211855 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:33:41.250827 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5773cd3-bf31-4ddc-bcaa-ea54fb5e1287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:41.251520 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5773cd3-bf31-4ddc-bcaa-ea54fb5e1287 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:41.251798 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5773cd3-bf31-4ddc-bcaa-ea54fb5e1287 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:41.252067 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5773cd3-bf31-4ddc-bcaa-ea54fb5e1287 admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:41.252718 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5773cd3-bf31-4ddc-bcaa-ea54fb5e1287 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:41.254644 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5773cd3-bf31-4ddc-bcaa-ea54fb5e1287 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:41.275591 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1303/2605] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:33:41 2022] POST /identity/v3/users => generated 290 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:33:41.279549 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb13248-eb9d-4479-aed8-deddef5a661e admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:41.290254 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb13248-eb9d-4479-aed8-deddef5a661e admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:41.294927 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b384254-a970-4058-aed6-38d4fbe6dc87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:41.295513 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b384254-a970-4058-aed6-38d4fbe6dc87 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:41.295790 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b384254-a970-4058-aed6-38d4fbe6dc87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:41.296064 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b384254-a970-4058-aed6-38d4fbe6dc87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:41.296691 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b384254-a970-4058-aed6-38d4fbe6dc87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:41.298265 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b384254-a970-4058-aed6-38d4fbe6dc87 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:41.308120 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1303/2606] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:33:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:33:41.312277 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5773cd3-bf31-4ddc-bcaa-ea54fb5e1287 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:41.322204 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5773cd3-bf31-4ddc-bcaa-ea54fb5e1287 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:41.326852 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdb8fbc-42bb-4fd3-8703-fed6e2a939ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:41.327590 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdb8fbc-42bb-4fd3-8703-fed6e2a939ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:41.327868 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdb8fbc-42bb-4fd3-8703-fed6e2a939ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:41.328138 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdb8fbc-42bb-4fd3-8703-fed6e2a939ad admin admin] PATH_INFO: `/v3/projects/e23d51fba7cb4634b0c8f33eaa3f3123/users/f2bf23b40a664864a6f0adb7a69b80b2/roles/7f53f1c823b746529ba5057bf21b2477` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:41.343324 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdb8fbc-42bb-4fd3-8703-fed6e2a939ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=e23d51fba7cb4634b0c8f33eaa3f3123, user_id=f2bf23b40a664864a6f0adb7a69b80b2, role_id=7f53f1c823b746529ba5057bf21b2477)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:41.345965 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdb8fbc-42bb-4fd3-8703-fed6e2a939ad admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:41.358890 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1304/2607] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:33:41 2022] PUT /identity/v3/projects/e23d51fba7cb4634b0c8f33eaa3f3123/users/f2bf23b40a664864a6f0adb7a69b80b2/roles/7f53f1c823b746529ba5057bf21b2477 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:33:41.362828 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b384254-a970-4058-aed6-38d4fbe6dc87 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:41.372514 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b384254-a970-4058-aed6-38d4fbe6dc87 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:41.428187 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e189e25-d9cd-465d-a0c1-c64a5c56781e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:41.428700 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e189e25-d9cd-465d-a0c1-c64a5c56781e admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:41.428973 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e189e25-d9cd-465d-a0c1-c64a5c56781e admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:41.429286 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e189e25-d9cd-465d-a0c1-c64a5c56781e admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:41.429965 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e189e25-d9cd-465d-a0c1-c64a5c56781e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:41.431552 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e189e25-d9cd-465d-a0c1-c64a5c56781e admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:41.440999 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1304/2608] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:33:41 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:33:41.445259 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdb8fbc-42bb-4fd3-8703-fed6e2a939ad admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:41.455332 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdb8fbc-42bb-4fd3-8703-fed6e2a939ad admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:41.460423 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0a9569-4d1a-440f-a971-36f6fdc59eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:41.461061 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a9569-4d1a-440f-a971-36f6fdc59eb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:41.461338 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a9569-4d1a-440f-a971-36f6fdc59eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:41.461609 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a9569-4d1a-440f-a971-36f6fdc59eb9 admin admin] PATH_INFO: `/v3/projects/e23d51fba7cb4634b0c8f33eaa3f3123/users/f2bf23b40a664864a6f0adb7a69b80b2/roles/7f53f1c823b746529ba5057bf21b2477` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:41.463546 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0a9569-4d1a-440f-a971-36f6fdc59eb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e23d51fba7cb4634b0c8f33eaa3f3123, user_id=f2bf23b40a664864a6f0adb7a69b80b2, role_id=7f53f1c823b746529ba5057bf21b2477)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:41.466143 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0a9569-4d1a-440f-a971-36f6fdc59eb9 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:41.476644 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1305/2609] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:33:41 2022] PUT /identity/v3/projects/e23d51fba7cb4634b0c8f33eaa3f3123/users/f2bf23b40a664864a6f0adb7a69b80b2/roles/7f53f1c823b746529ba5057bf21b2477 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:33:41.487356 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea8607-9a28-4fcd-bce8-dffe21bbac7e None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:41.487640 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea8607-9a28-4fcd-bce8-dffe21bbac7e None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:41.487909 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea8607-9a28-4fcd-bce8-dffe21bbac7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:41.514584 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-34ea8607-9a28-4fcd-bce8-dffe21bbac7e None None] MFA Rules not processed for user `f2bf23b40a664864a6f0adb7a69b80b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:33:41.515803 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-34ea8607-9a28-4fcd-bce8-dffe21bbac7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:41.555115 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:33:41.584774 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1305/2610] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:33:41 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:33:41.595490 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0a9569-4d1a-440f-a971-36f6fdc59eb9 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:41.597276 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-7a0a9569-4d1a-440f-a971-36f6fdc59eb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:41.653428 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0a9569-4d1a-440f-a971-36f6fdc59eb9 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:41.656983 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8f21c5-8d1b-4e3f-96b6-4f0216baae09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceafc5e4283841528053f01931f10293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:41.657572 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f21c5-8d1b-4e3f-96b6-4f0216baae09 service cinder] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:41.657844 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f21c5-8d1b-4e3f-96b6-4f0216baae09 service cinder] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:41.658108 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f21c5-8d1b-4e3f-96b6-4f0216baae09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:41.666746 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8f21c5-8d1b-4e3f-96b6-4f0216baae09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:41.668157 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8f21c5-8d1b-4e3f-96b6-4f0216baae09 service cinder] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:41.677259 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1306/2611] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:33:41 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:33:43.064609 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ea8607-9a28-4fcd-bce8-dffe21bbac7e None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:43.127096 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ea8607-9a28-4fcd-bce8-dffe21bbac7e None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:43.131635 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff29bcdc-e66d-4bce-aa49-206109fe61e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:43.132249 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29bcdc-e66d-4bce-aa49-206109fe61e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:43.132536 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29bcdc-e66d-4bce-aa49-206109fe61e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:43.132806 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29bcdc-e66d-4bce-aa49-206109fe61e7 admin admin] PATH_INFO: `/v3/users/a84b879140154d5297c94cc398f1c3e7` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:43.133912 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff29bcdc-e66d-4bce-aa49-206109fe61e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a84b879140154d5297c94cc398f1c3e7)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:43.135844 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff29bcdc-e66d-4bce-aa49-206109fe61e7 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:43.180960 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-ff29bcdc-e66d-4bce-aa49-206109fe61e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a84b879140154d5297c94cc398f1c3e7'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:43.188009 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-ff29bcdc-e66d-4bce-aa49-206109fe61e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a84b879140154d5297c94cc398f1c3e7'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:43.188620 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-ff29bcdc-e66d-4bce-aa49-206109fe61e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a84b879140154d5297c94cc398f1c3e7'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:43.189222 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-ff29bcdc-e66d-4bce-aa49-206109fe61e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a84b879140154d5297c94cc398f1c3e7'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:43.196392 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-ff29bcdc-e66d-4bce-aa49-206109fe61e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a84b879140154d5297c94cc398f1c3e7'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:43.213556 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1306/2612] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:33:43 2022] DELETE /identity/v3/users/a84b879140154d5297c94cc398f1c3e7 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:33:43.218525 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b419cd-3e4c-426f-8925-995076ddfc27 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:43.219044 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b419cd-3e4c-426f-8925-995076ddfc27 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:43.219158 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b419cd-3e4c-426f-8925-995076ddfc27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:43.238209 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-b8b419cd-3e4c-426f-8925-995076ddfc27 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:33:43.240034 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-b8b419cd-3e4c-426f-8925-995076ddfc27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:43.296302 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1307/2613] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:33:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:33:43.306483 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff29bcdc-e66d-4bce-aa49-206109fe61e7 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:43.307952 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-ff29bcdc-e66d-4bce-aa49-206109fe61e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:43.365933 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff29bcdc-e66d-4bce-aa49-206109fe61e7 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:43.371978 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e6361c-72a0-42c9-8224-a8069b34c446 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:43.372595 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e6361c-72a0-42c9-8224-a8069b34c446 service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:43.372873 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e6361c-72a0-42c9-8224-a8069b34c446 service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:43.373144 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e6361c-72a0-42c9-8224-a8069b34c446 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:43.381017 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b419cd-3e4c-426f-8925-995076ddfc27 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:43.382412 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-b8b419cd-3e4c-426f-8925-995076ddfc27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:43.386592 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e6361c-72a0-42c9-8224-a8069b34c446 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:43.388049 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e6361c-72a0-42c9-8224-a8069b34c446 service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:43.392164 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:33:43.395633 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b419cd-3e4c-426f-8925-995076ddfc27 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:43.400478 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad77fd-6dd9-46e7-9470-e4d7861126c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:43.401167 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad77fd-6dd9-46e7-9470-e4d7861126c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:43.401444 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad77fd-6dd9-46e7-9470-e4d7861126c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:43.401712 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad77fd-6dd9-46e7-9470-e4d7861126c9 admin admin] PATH_INFO: `/v3/users/918f7a49dc474f158580634b10ab8343` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:43.402852 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1307/2614] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:33:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:33:43.402997 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ad77fd-6dd9-46e7-9470-e4d7861126c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=918f7a49dc474f158580634b10ab8343)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:43.404861 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ad77fd-6dd9-46e7-9470-e4d7861126c9 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:43.419892 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:33:43.456463 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-46ad77fd-6dd9-46e7-9470-e4d7861126c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '918f7a49dc474f158580634b10ab8343'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:43.465018 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-46ad77fd-6dd9-46e7-9470-e4d7861126c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '918f7a49dc474f158580634b10ab8343'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:43.465739 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-46ad77fd-6dd9-46e7-9470-e4d7861126c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '918f7a49dc474f158580634b10ab8343'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:43.466749 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-46ad77fd-6dd9-46e7-9470-e4d7861126c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '918f7a49dc474f158580634b10ab8343'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:43.475535 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-46ad77fd-6dd9-46e7-9470-e4d7861126c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '918f7a49dc474f158580634b10ab8343'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:43.493851 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1308/2615] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:33:43 2022] DELETE /identity/v3/users/918f7a49dc474f158580634b10ab8343 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:33:43.498319 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7194ad-afdf-4ba0-8509-639856d77c6d None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:43.498602 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7194ad-afdf-4ba0-8509-639856d77c6d None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:43.498910 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7194ad-afdf-4ba0-8509-639856d77c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:43.520105 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-cc7194ad-afdf-4ba0-8509-639856d77c6d None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:33:43.521590 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-cc7194ad-afdf-4ba0-8509-639856d77c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:43.588044 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1308/2616] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:33:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:33:43.598788 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad77fd-6dd9-46e7-9470-e4d7861126c9 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:43.600531 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-46ad77fd-6dd9-46e7-9470-e4d7861126c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:43.661344 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad77fd-6dd9-46e7-9470-e4d7861126c9 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:43.665520 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3527c30c-b08c-4ed1-ba20-ef34b2895ed8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:43.666157 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3527c30c-b08c-4ed1-ba20-ef34b2895ed8 service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:43.666468 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3527c30c-b08c-4ed1-ba20-ef34b2895ed8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:43.666760 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3527c30c-b08c-4ed1-ba20-ef34b2895ed8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:43.676787 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3527c30c-b08c-4ed1-ba20-ef34b2895ed8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:43.678220 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3527c30c-b08c-4ed1-ba20-ef34b2895ed8 service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:43.683572 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7194ad-afdf-4ba0-8509-639856d77c6d None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:43.685420 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-cc7194ad-afdf-4ba0-8509-639856d77c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:43.690450 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1309/2617] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:33:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:33:43.698505 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7194ad-afdf-4ba0-8509-639856d77c6d None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:43.705725 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafbde51-a0d8-4c6d-a760-244747c93f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:43.706372 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafbde51-a0d8-4c6d-a760-244747c93f69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:43.706647 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafbde51-a0d8-4c6d-a760-244747c93f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:43.707544 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafbde51-a0d8-4c6d-a760-244747c93f69 admin admin] PATH_INFO: `/v3/projects/b3b03e2976c64447a5c10c6dae4c937c` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:43.710036 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafbde51-a0d8-4c6d-a760-244747c93f69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3b03e2976c64447a5c10c6dae4c937c)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:43.711600 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafbde51-a0d8-4c6d-a760-244747c93f69 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:43.768601 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-eafbde51-a0d8-4c6d-a760-244747c93f69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3b03e2976c64447a5c10c6dae4c937c', 'request_id': 'req-eafbde51-a0d8-4c6d-a760-244747c93f69'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:43.776648 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-eafbde51-a0d8-4c6d-a760-244747c93f69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3b03e2976c64447a5c10c6dae4c937c', 'request_id': 'req-eafbde51-a0d8-4c6d-a760-244747c93f69'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:43.782850 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-eafbde51-a0d8-4c6d-a760-244747c93f69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3b03e2976c64447a5c10c6dae4c937c', 'request_id': 'req-eafbde51-a0d8-4c6d-a760-244747c93f69'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:43.796211 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-eafbde51-a0d8-4c6d-a760-244747c93f69 admin admin] The token cache is being invalidate because project b3b03e2976c64447a5c10c6dae4c937c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:33:43.796495 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-eafbde51-a0d8-4c6d-a760-244747c93f69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:43.797123 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-eafbde51-a0d8-4c6d-a760-244747c93f69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:43.798666 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1309/2618] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:33:43 2022] DELETE /identity/v3/projects/b3b03e2976c64447a5c10c6dae4c937c => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:33:43.803730 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3527c30c-b08c-4ed1-ba20-ef34b2895ed8 service neutron] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:43.813874 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3527c30c-b08c-4ed1-ba20-ef34b2895ed8 service neutron] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:43.878094 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fe39b1-896b-4e41-9b1d-53007ef58750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:43.878893 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe39b1-896b-4e41-9b1d-53007ef58750 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:43.879260 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe39b1-896b-4e41-9b1d-53007ef58750 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:43.879466 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe39b1-896b-4e41-9b1d-53007ef58750 admin admin] PATH_INFO: `/v3/users/f2bf23b40a664864a6f0adb7a69b80b2` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:43.880634 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fe39b1-896b-4e41-9b1d-53007ef58750 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2bf23b40a664864a6f0adb7a69b80b2)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:43.882546 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fe39b1-896b-4e41-9b1d-53007ef58750 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:43.928013 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:33:43.939919 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-d3fe39b1-896b-4e41-9b1d-53007ef58750 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2bf23b40a664864a6f0adb7a69b80b2'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:43.948237 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-d3fe39b1-896b-4e41-9b1d-53007ef58750 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2bf23b40a664864a6f0adb7a69b80b2'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:43.949035 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-d3fe39b1-896b-4e41-9b1d-53007ef58750 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2bf23b40a664864a6f0adb7a69b80b2'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:43.949753 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-d3fe39b1-896b-4e41-9b1d-53007ef58750 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2bf23b40a664864a6f0adb7a69b80b2'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:43.960198 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-d3fe39b1-896b-4e41-9b1d-53007ef58750 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2bf23b40a664864a6f0adb7a69b80b2'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:43.989106 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafbde51-a0d8-4c6d-a760-244747c93f69 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:43.989890 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1310/2619] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:33:43 2022] DELETE /identity/v3/users/f2bf23b40a664864a6f0adb7a69b80b2 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:33:43.991448 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-eafbde51-a0d8-4c6d-a760-244747c93f69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:44.016124 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafbde51-a0d8-4c6d-a760-244747c93f69 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:44.084454 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d063d20a-868f-4060-bc4b-1d6fe93bfff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:44.085122 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d063d20a-868f-4060-bc4b-1d6fe93bfff6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:44.085350 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d063d20a-868f-4060-bc4b-1d6fe93bfff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:44.085616 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d063d20a-868f-4060-bc4b-1d6fe93bfff6 admin admin] PATH_INFO: `/v3/projects/eceee2623e2c4851bcea5c4d7283c9da` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:44.086771 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d063d20a-868f-4060-bc4b-1d6fe93bfff6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eceee2623e2c4851bcea5c4d7283c9da)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:44.088847 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d063d20a-868f-4060-bc4b-1d6fe93bfff6 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:44.116282 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:33:44.140350 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-d063d20a-868f-4060-bc4b-1d6fe93bfff6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eceee2623e2c4851bcea5c4d7283c9da', 'request_id': 'req-d063d20a-868f-4060-bc4b-1d6fe93bfff6'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:44.146559 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-d063d20a-868f-4060-bc4b-1d6fe93bfff6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eceee2623e2c4851bcea5c4d7283c9da', 'request_id': 'req-d063d20a-868f-4060-bc4b-1d6fe93bfff6'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:44.152493 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-d063d20a-868f-4060-bc4b-1d6fe93bfff6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eceee2623e2c4851bcea5c4d7283c9da', 'request_id': 'req-d063d20a-868f-4060-bc4b-1d6fe93bfff6'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:44.168109 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-d063d20a-868f-4060-bc4b-1d6fe93bfff6 admin admin] The token cache is being invalidate because project eceee2623e2c4851bcea5c4d7283c9da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:33:44.168445 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-d063d20a-868f-4060-bc4b-1d6fe93bfff6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:44.169169 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-d063d20a-868f-4060-bc4b-1d6fe93bfff6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:44.170734 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1310/2620] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:33:43 2022] DELETE /identity/v3/projects/eceee2623e2c4851bcea5c4d7283c9da => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:33:44.176834 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31468c7b-e7b3-408a-a407-62d7d22350e9 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:44.177201 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31468c7b-e7b3-408a-a407-62d7d22350e9 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:44.177549 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31468c7b-e7b3-408a-a407-62d7d22350e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:44.198775 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-31468c7b-e7b3-408a-a407-62d7d22350e9 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:33:44.200218 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-31468c7b-e7b3-408a-a407-62d7d22350e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:44.261703 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1311/2621] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:33:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:33:44.270498 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f57cb13-6c43-4040-8cf5-e16db5d33f8f None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:44.270845 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f57cb13-6c43-4040-8cf5-e16db5d33f8f None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:44.271163 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f57cb13-6c43-4040-8cf5-e16db5d33f8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:44.291673 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-9f57cb13-6c43-4040-8cf5-e16db5d33f8f None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:33:44.292798 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-9f57cb13-6c43-4040-8cf5-e16db5d33f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:44.295113 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31468c7b-e7b3-408a-a407-62d7d22350e9 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:44.296460 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-31468c7b-e7b3-408a-a407-62d7d22350e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:44.306883 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1311/2622] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:33:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:33:44.308688 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31468c7b-e7b3-408a-a407-62d7d22350e9 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:44.310800 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f57cb13-6c43-4040-8cf5-e16db5d33f8f None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:44.313763 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaefbb94-3482-489c-9f61-1df6da6d8b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:44.314462 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaefbb94-3482-489c-9f61-1df6da6d8b86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:44.314856 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaefbb94-3482-489c-9f61-1df6da6d8b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:44.315304 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaefbb94-3482-489c-9f61-1df6da6d8b86 admin admin] PATH_INFO: `/v3/projects/e23d51fba7cb4634b0c8f33eaa3f3123` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:44.316339 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaefbb94-3482-489c-9f61-1df6da6d8b86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e23d51fba7cb4634b0c8f33eaa3f3123)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:44.318328 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaefbb94-3482-489c-9f61-1df6da6d8b86 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:44.321756 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f57cb13-6c43-4040-8cf5-e16db5d33f8f None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:44.327453 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c635f30-4bb1-4fa6-bcca-19aaa7c6dbc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:44.328047 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c635f30-4bb1-4fa6-bcca-19aaa7c6dbc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:44.328321 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c635f30-4bb1-4fa6-bcca-19aaa7c6dbc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:44.328585 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c635f30-4bb1-4fa6-bcca-19aaa7c6dbc5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:44.329220 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c635f30-4bb1-4fa6-bcca-19aaa7c6dbc5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:33:44.329515 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c635f30-4bb1-4fa6-bcca-19aaa7c6dbc5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:44.331114 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c635f30-4bb1-4fa6-bcca-19aaa7c6dbc5 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:44.343724 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1312/2623] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 15 12:33:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:33:44.349129 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c635f30-4bb1-4fa6-bcca-19aaa7c6dbc5 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:44.363530 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c635f30-4bb1-4fa6-bcca-19aaa7c6dbc5 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:44.377106 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-aaefbb94-3482-489c-9f61-1df6da6d8b86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e23d51fba7cb4634b0c8f33eaa3f3123', 'request_id': 'req-aaefbb94-3482-489c-9f61-1df6da6d8b86'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:44.383433 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-aaefbb94-3482-489c-9f61-1df6da6d8b86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e23d51fba7cb4634b0c8f33eaa3f3123', 'request_id': 'req-aaefbb94-3482-489c-9f61-1df6da6d8b86'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:44.393779 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-aaefbb94-3482-489c-9f61-1df6da6d8b86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e23d51fba7cb4634b0c8f33eaa3f3123', 'request_id': 'req-aaefbb94-3482-489c-9f61-1df6da6d8b86'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:44.405575 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-aaefbb94-3482-489c-9f61-1df6da6d8b86 admin admin] The token cache is being invalidate because project e23d51fba7cb4634b0c8f33eaa3f3123 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:33:44.405886 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-aaefbb94-3482-489c-9f61-1df6da6d8b86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:44.406525 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-aaefbb94-3482-489c-9f61-1df6da6d8b86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:44.408088 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1312/2624] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:33:44 2022] DELETE /identity/v3/projects/e23d51fba7cb4634b0c8f33eaa3f3123 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:33:44.413326 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4270c-db0e-4112-bff6-d26ed0d78e96 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:44.413608 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4270c-db0e-4112-bff6-d26ed0d78e96 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:44.413880 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4270c-db0e-4112-bff6-d26ed0d78e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:44.433564 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-b7a4270c-db0e-4112-bff6-d26ed0d78e96 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:33:44.434391 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f38a72-6727-47ec-ac5f-5fef4f0e0515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:44.434900 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-b7a4270c-db0e-4112-bff6-d26ed0d78e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:44.435038 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f38a72-6727-47ec-ac5f-5fef4f0e0515 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:44.435286 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f38a72-6727-47ec-ac5f-5fef4f0e0515 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:44.435555 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f38a72-6727-47ec-ac5f-5fef4f0e0515 admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:44.436184 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f38a72-6727-47ec-ac5f-5fef4f0e0515 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:44.438037 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f38a72-6727-47ec-ac5f-5fef4f0e0515 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:44.443525 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1313/2625] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:33:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:33:44.451039 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b338302-e58b-4dee-bfbb-0786c247fe5b None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:44.451326 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b338302-e58b-4dee-bfbb-0786c247fe5b None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:44.451604 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b338302-e58b-4dee-bfbb-0786c247fe5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:44.467619 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1313/2626] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:33:44 2022] POST /identity/v3/projects => generated 383 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 12:33:44.471676 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f38a72-6727-47ec-ac5f-5fef4f0e0515 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:44.473525 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-1b338302-e58b-4dee-bfbb-0786c247fe5b None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:33:44.473849 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-22f38a72-6727-47ec-ac5f-5fef4f0e0515 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:44.474705 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-1b338302-e58b-4dee-bfbb-0786c247fe5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:44.501765 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:33:44.537309 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f38a72-6727-47ec-ac5f-5fef4f0e0515 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:44.538101 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1314/2627] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:33:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:33:44.542519 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b338302-e58b-4dee-bfbb-0786c247fe5b None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:44.542870 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab57a4c-7831-4ffd-a916-44ef6a14490c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:44.543479 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab57a4c-7831-4ffd-a916-44ef6a14490c admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:44.543761 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab57a4c-7831-4ffd-a916-44ef6a14490c admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:44.544030 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab57a4c-7831-4ffd-a916-44ef6a14490c admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:44.544678 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab57a4c-7831-4ffd-a916-44ef6a14490c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:44.547451 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab57a4c-7831-4ffd-a916-44ef6a14490c admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:44.552067 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b338302-e58b-4dee-bfbb-0786c247fe5b None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:44.556797 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b741ed-7b37-4001-b86b-9027b306d84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:44.557393 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b741ed-7b37-4001-b86b-9027b306d84b admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:44.557669 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b741ed-7b37-4001-b86b-9027b306d84b admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:44.558269 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b741ed-7b37-4001-b86b-9027b306d84b admin admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:44.558602 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b741ed-7b37-4001-b86b-9027b306d84b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:33:44.559267 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b741ed-7b37-4001-b86b-9027b306d84b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:44.560527 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b741ed-7b37-4001-b86b-9027b306d84b admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:44.569837 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1314/2628] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:33:44 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:33:44.573622 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1315/2629] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 15 12:33:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:33:44.574062 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab57a4c-7831-4ffd-a916-44ef6a14490c admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:44.577665 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b741ed-7b37-4001-b86b-9027b306d84b admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:44.584501 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab57a4c-7831-4ffd-a916-44ef6a14490c admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:44.588788 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b741ed-7b37-4001-b86b-9027b306d84b admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:44.589170 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5cde02-bd1d-46ec-82f5-f1fa6aebed94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:44.589767 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5cde02-bd1d-46ec-82f5-f1fa6aebed94 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:44.590048 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5cde02-bd1d-46ec-82f5-f1fa6aebed94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:44.590319 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5cde02-bd1d-46ec-82f5-f1fa6aebed94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:44.590989 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5cde02-bd1d-46ec-82f5-f1fa6aebed94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:44.592573 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5cde02-bd1d-46ec-82f5-f1fa6aebed94 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:44.593405 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb15eb46-e42e-44bf-947d-a119104938d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:44.593879 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=89,keystone:DELETE=6,keystone:INSERT=5 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:33:44.593991 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb15eb46-e42e-44bf-947d-a119104938d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:44.594252 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb15eb46-e42e-44bf-947d-a119104938d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:44.594524 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb15eb46-e42e-44bf-947d-a119104938d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:44.595187 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb15eb46-e42e-44bf-947d-a119104938d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:44.597324 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb15eb46-e42e-44bf-947d-a119104938d3 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:44.605598 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1315/2630] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:33:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 12:33:44.608374 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5cde02-bd1d-46ec-82f5-f1fa6aebed94 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:44.618203 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5cde02-bd1d-46ec-82f5-f1fa6aebed94 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:44.623006 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62fe1e8-b88b-4ca3-babe-dde720cb9f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:44.623586 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62fe1e8-b88b-4ca3-babe-dde720cb9f7d admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:44.623863 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62fe1e8-b88b-4ca3-babe-dde720cb9f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:44.624145 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62fe1e8-b88b-4ca3-babe-dde720cb9f7d admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:44.624760 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62fe1e8-b88b-4ca3-babe-dde720cb9f7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:44.626613 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62fe1e8-b88b-4ca3-babe-dde720cb9f7d admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:44.630827 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1316/2631] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:33:44 2022] POST /identity/v3/projects => generated 387 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 12:33:44.631776 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb15eb46-e42e-44bf-947d-a119104938d3 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:44.637894 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1316/2632] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:33:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 12:33:44.641839 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62fe1e8-b88b-4ca3-babe-dde720cb9f7d admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:44.651749 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62fe1e8-b88b-4ca3-babe-dde720cb9f7d admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:44.695582 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb15eb46-e42e-44bf-947d-a119104938d3 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:44.700482 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65901766-18e9-4435-be12-5d5cbde17136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:44.701083 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65901766-18e9-4435-be12-5d5cbde17136 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:44.701363 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65901766-18e9-4435-be12-5d5cbde17136 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:44.701631 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65901766-18e9-4435-be12-5d5cbde17136 admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:44.702255 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65901766-18e9-4435-be12-5d5cbde17136 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:44.704194 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65901766-18e9-4435-be12-5d5cbde17136 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:44.706282 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927aca46-e5c5-44fe-9e3c-14e227bde775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:44.707078 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927aca46-e5c5-44fe-9e3c-14e227bde775 admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:44.707822 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927aca46-e5c5-44fe-9e3c-14e227bde775 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:44.708091 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927aca46-e5c5-44fe-9e3c-14e227bde775 admin admin] PATH_INFO: `/v3/projects/e0c29881dc0a44f88197d42072018980/users/3fed38aa25304fdb9d2c55c85d7acd34/roles/9371e5bbc55848949eb951a815f817f2` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:44.722748 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927aca46-e5c5-44fe-9e3c-14e227bde775 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0c29881dc0a44f88197d42072018980, user_id=3fed38aa25304fdb9d2c55c85d7acd34, role_id=9371e5bbc55848949eb951a815f817f2)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:44.725360 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927aca46-e5c5-44fe-9e3c-14e227bde775 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:44.726039 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1317/2633] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:33:44 2022] POST /identity/v3/users => generated 294 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 12:33:44.730340 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65901766-18e9-4435-be12-5d5cbde17136 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:44.739431 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1317/2634] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:33:44 2022] PUT /identity/v3/projects/e0c29881dc0a44f88197d42072018980/users/3fed38aa25304fdb9d2c55c85d7acd34/roles/9371e5bbc55848949eb951a815f817f2 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:33:44.740239 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65901766-18e9-4435-be12-5d5cbde17136 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:44.749663 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e72bf8-d06d-4d5f-aa4b-859c4f6b6898 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:44.749963 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e72bf8-d06d-4d5f-aa4b-859c4f6b6898 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:44.750236 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e72bf8-d06d-4d5f-aa4b-859c4f6b6898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:44.779352 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-48e72bf8-d06d-4d5f-aa4b-859c4f6b6898 None None] MFA Rules not processed for user `3fed38aa25304fdb9d2c55c85d7acd34`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:33:44.780489 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-48e72bf8-d06d-4d5f-aa4b-859c4f6b6898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:44.797006 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd769343-287c-4c50-b0dd-cee2f2de3142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:44.797608 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd769343-287c-4c50-b0dd-cee2f2de3142 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:44.797888 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd769343-287c-4c50-b0dd-cee2f2de3142 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:44.798155 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd769343-287c-4c50-b0dd-cee2f2de3142 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:44.798815 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd769343-287c-4c50-b0dd-cee2f2de3142 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:44.800400 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd769343-287c-4c50-b0dd-cee2f2de3142 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:44.810023 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1318/2635] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:33:44 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 12:33:44.813878 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd769343-287c-4c50-b0dd-cee2f2de3142 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:44.824136 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd769343-287c-4c50-b0dd-cee2f2de3142 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:44.828732 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5cd7f8-a38d-43f9-bfb6-ac707b2d9bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:44.829328 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5cd7f8-a38d-43f9-bfb6-ac707b2d9bc7 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:44.829601 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5cd7f8-a38d-43f9-bfb6-ac707b2d9bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:44.829868 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5cd7f8-a38d-43f9-bfb6-ac707b2d9bc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:44.830482 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5cd7f8-a38d-43f9-bfb6-ac707b2d9bc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:44.832680 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5cd7f8-a38d-43f9-bfb6-ac707b2d9bc7 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:44.842358 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1319/2636] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:33:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 12:33:44.846240 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1318/2637] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:33:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:33:44.846433 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5cd7f8-a38d-43f9-bfb6-ac707b2d9bc7 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:44.850720 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e72bf8-d06d-4d5f-aa4b-859c4f6b6898 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:44.856216 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5cd7f8-a38d-43f9-bfb6-ac707b2d9bc7 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:44.860727 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e72bf8-d06d-4d5f-aa4b-859c4f6b6898 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:44.860866 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146bec2b-e6a4-4867-bb4a-812f3a25c05e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:44.861355 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146bec2b-e6a4-4867-bb4a-812f3a25c05e admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:44.861681 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146bec2b-e6a4-4867-bb4a-812f3a25c05e admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:44.861895 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146bec2b-e6a4-4867-bb4a-812f3a25c05e admin admin] PATH_INFO: `/v3/projects/63a51931e75e4b86b69a06dc37db6208/users/b7c4a781c4aa4c6dbcca1bd0c51f1466/roles/9371e5bbc55848949eb951a815f817f2` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:44.865322 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5aa956-9e85-4e39-b836-ba4e33639036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:44.865920 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5aa956-9e85-4e39-b836-ba4e33639036 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:44.866183 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5aa956-9e85-4e39-b836-ba4e33639036 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:44.866454 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5aa956-9e85-4e39-b836-ba4e33639036 admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:44.867107 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5aa956-9e85-4e39-b836-ba4e33639036 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:44.868971 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5aa956-9e85-4e39-b836-ba4e33639036 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:44.871833 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:33:44.880426 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146bec2b-e6a4-4867-bb4a-812f3a25c05e admin admin] RBAC: Authorizing `identity:create_grant(project_id=63a51931e75e4b86b69a06dc37db6208, user_id=b7c4a781c4aa4c6dbcca1bd0c51f1466, role_id=9371e5bbc55848949eb951a815f817f2)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:44.883519 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146bec2b-e6a4-4867-bb4a-812f3a25c05e admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:44.896858 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1319/2638] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:33:44 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:33:44.903598 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1320/2639] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:33:44 2022] PUT /identity/v3/projects/63a51931e75e4b86b69a06dc37db6208/users/b7c4a781c4aa4c6dbcca1bd0c51f1466/roles/9371e5bbc55848949eb951a815f817f2 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:33:44.903764 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5aa956-9e85-4e39-b836-ba4e33639036 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:44.907147 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3415b2-7c96-4bdd-b8af-ef96749efc38 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:44.907502 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3415b2-7c96-4bdd-b8af-ef96749efc38 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:44.907778 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3415b2-7c96-4bdd-b8af-ef96749efc38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:44.936604 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-1d3415b2-7c96-4bdd-b8af-ef96749efc38 None None] MFA Rules not processed for user `b7c4a781c4aa4c6dbcca1bd0c51f1466`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:33:44.937977 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-1d3415b2-7c96-4bdd-b8af-ef96749efc38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:44.941059 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:33:44.966469 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5aa956-9e85-4e39-b836-ba4e33639036 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:44.971647 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf21109-6017-4ec8-98ea-a0f4eda85f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:44.972100 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf21109-6017-4ec8-98ea-a0f4eda85f5c admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:44.972383 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf21109-6017-4ec8-98ea-a0f4eda85f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:44.972689 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf21109-6017-4ec8-98ea-a0f4eda85f5c admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:44.973381 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf21109-6017-4ec8-98ea-a0f4eda85f5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:44.975322 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf21109-6017-4ec8-98ea-a0f4eda85f5c admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:44.998842 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1320/2640] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:33:44 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 12:33:45.003077 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf21109-6017-4ec8-98ea-a0f4eda85f5c admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:45.011753 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1321/2641] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:33:44 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:33:45.013564 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf21109-6017-4ec8-98ea-a0f4eda85f5c admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:45.016034 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3415b2-7c96-4bdd-b8af-ef96749efc38 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:45.018473 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b918074-3bfb-48e9-ad04-3bd7ed9808f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:45.019098 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b918074-3bfb-48e9-ad04-3bd7ed9808f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:45.019379 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b918074-3bfb-48e9-ad04-3bd7ed9808f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:45.019703 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b918074-3bfb-48e9-ad04-3bd7ed9808f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:45.020338 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b918074-3bfb-48e9-ad04-3bd7ed9808f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:45.022112 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b918074-3bfb-48e9-ad04-3bd7ed9808f6 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:45.026019 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3415b2-7c96-4bdd-b8af-ef96749efc38 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:45.031262 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36f44b8-d7d4-4f72-9d1f-23fe3288fb2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:45.031787 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f44b8-d7d4-4f72-9d1f-23fe3288fb2e admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:45.032061 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f44b8-d7d4-4f72-9d1f-23fe3288fb2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:45.032328 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f44b8-d7d4-4f72-9d1f-23fe3288fb2e admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:45.032583 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1321/2642] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:33:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:33:45.032952 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36f44b8-d7d4-4f72-9d1f-23fe3288fb2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:45.034870 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36f44b8-d7d4-4f72-9d1f-23fe3288fb2e admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:45.036632 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b918074-3bfb-48e9-ad04-3bd7ed9808f6 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:45.045999 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b918074-3bfb-48e9-ad04-3bd7ed9808f6 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:45.050656 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5d8a17-eed3-4cd9-8810-89157f58ae81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:45.051783 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5d8a17-eed3-4cd9-8810-89157f58ae81 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:45.052066 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5d8a17-eed3-4cd9-8810-89157f58ae81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:45.052421 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5d8a17-eed3-4cd9-8810-89157f58ae81 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:45.053212 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5d8a17-eed3-4cd9-8810-89157f58ae81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:45.055080 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5d8a17-eed3-4cd9-8810-89157f58ae81 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:45.063817 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1322/2643] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:33:45 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 12:33:45.065839 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1322/2644] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:33:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 12:33:45.068263 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36f44b8-d7d4-4f72-9d1f-23fe3288fb2e admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:45.070495 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5d8a17-eed3-4cd9-8810-89157f58ae81 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:45.080319 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5d8a17-eed3-4cd9-8810-89157f58ae81 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:45.129535 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36f44b8-d7d4-4f72-9d1f-23fe3288fb2e admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:45.134573 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0217a605-1a5a-4737-b9fd-b45e8169e342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:45.135281 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217a605-1a5a-4737-b9fd-b45e8169e342 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:45.135556 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217a605-1a5a-4737-b9fd-b45e8169e342 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:45.135823 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217a605-1a5a-4737-b9fd-b45e8169e342 admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:45.136444 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0217a605-1a5a-4737-b9fd-b45e8169e342 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:45.138348 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0217a605-1a5a-4737-b9fd-b45e8169e342 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:45.140982 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b629c0-9cb2-4807-a680-59e09e1cf52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:45.141641 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b629c0-9cb2-4807-a680-59e09e1cf52b admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:45.141920 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b629c0-9cb2-4807-a680-59e09e1cf52b admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:45.142191 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b629c0-9cb2-4807-a680-59e09e1cf52b admin admin] PATH_INFO: `/v3/projects/aede7460a72a47cc9a3611604e4eb472/users/abac0682af8d40c3a8861943f463c210/roles/9371e5bbc55848949eb951a815f817f2` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:45.158725 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b629c0-9cb2-4807-a680-59e09e1cf52b admin admin] RBAC: Authorizing `identity:create_grant(project_id=aede7460a72a47cc9a3611604e4eb472, user_id=abac0682af8d40c3a8861943f463c210, role_id=9371e5bbc55848949eb951a815f817f2)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:45.159408 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1323/2645] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:33:45 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 12:33:45.162113 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b629c0-9cb2-4807-a680-59e09e1cf52b admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:45.163917 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0217a605-1a5a-4737-b9fd-b45e8169e342 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:45.174163 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0217a605-1a5a-4737-b9fd-b45e8169e342 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:45.175051 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1323/2646] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:33:45 2022] PUT /identity/v3/projects/aede7460a72a47cc9a3611604e4eb472/users/abac0682af8d40c3a8861943f463c210/roles/9371e5bbc55848949eb951a815f817f2 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:33:45.185810 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b7a62a-45f9-454a-b583-a7d0fc4e0525 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:45.186106 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b7a62a-45f9-454a-b583-a7d0fc4e0525 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:45.186375 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b7a62a-45f9-454a-b583-a7d0fc4e0525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:45.213548 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-c5b7a62a-45f9-454a-b583-a7d0fc4e0525 None None] MFA Rules not processed for user `abac0682af8d40c3a8861943f463c210`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:33:45.214806 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-c5b7a62a-45f9-454a-b583-a7d0fc4e0525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:45.223321 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:33:45.240569 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92d7a31-5c3c-4adc-8165-e195275bb49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:45.241205 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d7a31-5c3c-4adc-8165-e195275bb49c admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:45.241506 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d7a31-5c3c-4adc-8165-e195275bb49c admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:45.241778 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d7a31-5c3c-4adc-8165-e195275bb49c admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:45.242416 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92d7a31-5c3c-4adc-8165-e195275bb49c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:45.244031 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92d7a31-5c3c-4adc-8165-e195275bb49c admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:45.256870 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1324/2647] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:33:45 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 12:33:45.257887 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92d7a31-5c3c-4adc-8165-e195275bb49c admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:45.267273 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92d7a31-5c3c-4adc-8165-e195275bb49c admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:45.272375 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6d13f4-9bc8-4d16-b5c8-672b3377b86f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:45.272984 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d13f4-9bc8-4d16-b5c8-672b3377b86f admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:45.273431 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d13f4-9bc8-4d16-b5c8-672b3377b86f admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:45.273587 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d13f4-9bc8-4d16-b5c8-672b3377b86f admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:45.274294 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6d13f4-9bc8-4d16-b5c8-672b3377b86f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:45.275990 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6d13f4-9bc8-4d16-b5c8-672b3377b86f admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:45.282194 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1324/2648] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:33:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:33:45.286640 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1325/2649] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:33:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:33:45.287128 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b7a62a-45f9-454a-b583-a7d0fc4e0525 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:45.290358 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6d13f4-9bc8-4d16-b5c8-672b3377b86f admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:45.300017 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6d13f4-9bc8-4d16-b5c8-672b3377b86f admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:45.300568 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b7a62a-45f9-454a-b583-a7d0fc4e0525 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:45.305067 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12226ca-d2b5-4723-8b1a-ab45abfc59f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:45.305501 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e54e1a1-2d73-4cd2-8799-36afebe61035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:45.305846 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12226ca-d2b5-4723-8b1a-ab45abfc59f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:45.306097 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54e1a1-2d73-4cd2-8799-36afebe61035 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:45.306231 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12226ca-d2b5-4723-8b1a-ab45abfc59f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:45.306386 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54e1a1-2d73-4cd2-8799-36afebe61035 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:45.306617 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12226ca-d2b5-4723-8b1a-ab45abfc59f1 admin admin] PATH_INFO: `/v3/projects/67e4fbeaff1b4c2e9c6bf111633b0373/users/4fdbb8e76d6f42348dbaf3d53d02c40d/roles/9371e5bbc55848949eb951a815f817f2` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:45.306754 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54e1a1-2d73-4cd2-8799-36afebe61035 admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:45.307630 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e54e1a1-2d73-4cd2-8799-36afebe61035 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:45.309727 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e54e1a1-2d73-4cd2-8799-36afebe61035 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:45.322728 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12226ca-d2b5-4723-8b1a-ab45abfc59f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67e4fbeaff1b4c2e9c6bf111633b0373, user_id=4fdbb8e76d6f42348dbaf3d53d02c40d, role_id=9371e5bbc55848949eb951a815f817f2)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:45.325391 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12226ca-d2b5-4723-8b1a-ab45abfc59f1 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:45.327005 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:33:45.340319 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1325/2650] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:33:45 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 12:33:45.340475 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1326/2651] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:33:45 2022] PUT /identity/v3/projects/67e4fbeaff1b4c2e9c6bf111633b0373/users/4fdbb8e76d6f42348dbaf3d53d02c40d/roles/9371e5bbc55848949eb951a815f817f2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:33:45.344446 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e54e1a1-2d73-4cd2-8799-36afebe61035 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:45.351526 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c2c8c-9beb-4a86-b830-db17d717f645 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:45.351810 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c2c8c-9beb-4a86-b830-db17d717f645 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:45.352078 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c2c8c-9beb-4a86-b830-db17d717f645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:45.379795 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-041c2c8c-9beb-4a86-b830-db17d717f645 None None] MFA Rules not processed for user `4fdbb8e76d6f42348dbaf3d53d02c40d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:33:45.380990 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-041c2c8c-9beb-4a86-b830-db17d717f645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:45.406891 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e54e1a1-2d73-4cd2-8799-36afebe61035 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:45.411703 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5280e472-5bf5-45bd-8f82-1b2a7c74b2ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:45.412291 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280e472-5bf5-45bd-8f82-1b2a7c74b2ad admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:45.412566 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280e472-5bf5-45bd-8f82-1b2a7c74b2ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:45.412832 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280e472-5bf5-45bd-8f82-1b2a7c74b2ad admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:45.413447 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5280e472-5bf5-45bd-8f82-1b2a7c74b2ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:45.415386 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5280e472-5bf5-45bd-8f82-1b2a7c74b2ad admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:45.436609 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1326/2652] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:33:45 2022] POST /identity/v3/users => generated 298 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:33:45.440344 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5280e472-5bf5-45bd-8f82-1b2a7c74b2ad admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:45.444689 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1327/2653] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:33:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:33:45.448918 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041c2c8c-9beb-4a86-b830-db17d717f645 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:45.450726 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5280e472-5bf5-45bd-8f82-1b2a7c74b2ad admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:45.455304 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a004240-de4f-488f-8eb4-8d4964fe76cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:45.455884 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a004240-de4f-488f-8eb4-8d4964fe76cc admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:45.456157 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a004240-de4f-488f-8eb4-8d4964fe76cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:45.456425 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a004240-de4f-488f-8eb4-8d4964fe76cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:45.457616 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a004240-de4f-488f-8eb4-8d4964fe76cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:45.459216 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a004240-de4f-488f-8eb4-8d4964fe76cc admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:45.459357 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041c2c8c-9beb-4a86-b830-db17d717f645 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:45.463849 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03034269-d17c-4b25-92c7-43d18a670a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:45.464427 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03034269-d17c-4b25-92c7-43d18a670a7f admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:45.464711 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03034269-d17c-4b25-92c7-43d18a670a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:45.464974 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03034269-d17c-4b25-92c7-43d18a670a7f admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:45.465585 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03034269-d17c-4b25-92c7-43d18a670a7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:45.467489 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03034269-d17c-4b25-92c7-43d18a670a7f admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:45.469416 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1327/2654] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:33:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:33:45.473828 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a004240-de4f-488f-8eb4-8d4964fe76cc admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:45.483194 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a004240-de4f-488f-8eb4-8d4964fe76cc admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:45.487923 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d705c1e2-19c9-46e8-84ae-2bcb5e705b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:45.488792 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d705c1e2-19c9-46e8-84ae-2bcb5e705b9d admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:45.489145 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d705c1e2-19c9-46e8-84ae-2bcb5e705b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:45.489489 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d705c1e2-19c9-46e8-84ae-2bcb5e705b9d admin admin] PATH_INFO: `/v3/projects/0bcf0f5c83fc484b880d820e9e2b0eda/users/9cdd2a1fdc5c4503b200ef5dd1890e36/roles/7f53f1c823b746529ba5057bf21b2477` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:45.499570 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1328/2655] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:33:45 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 12:33:45.500861 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03034269-d17c-4b25-92c7-43d18a670a7f admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:45.504999 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d705c1e2-19c9-46e8-84ae-2bcb5e705b9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bcf0f5c83fc484b880d820e9e2b0eda, user_id=9cdd2a1fdc5c4503b200ef5dd1890e36, role_id=7f53f1c823b746529ba5057bf21b2477)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:45.508432 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d705c1e2-19c9-46e8-84ae-2bcb5e705b9d admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:45.521585 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1328/2656] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:33:45 2022] PUT /identity/v3/projects/0bcf0f5c83fc484b880d820e9e2b0eda/users/9cdd2a1fdc5c4503b200ef5dd1890e36/roles/7f53f1c823b746529ba5057bf21b2477 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:33:45.525425 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d705c1e2-19c9-46e8-84ae-2bcb5e705b9d admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:45.565424 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03034269-d17c-4b25-92c7-43d18a670a7f admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:45.582628 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:33:45.585859 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d705c1e2-19c9-46e8-84ae-2bcb5e705b9d admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:45.590504 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b7ffe2-6e80-44b0-89fe-f5994763dc32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:45.591128 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b7ffe2-6e80-44b0-89fe-f5994763dc32 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:45.591405 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b7ffe2-6e80-44b0-89fe-f5994763dc32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:45.591693 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b7ffe2-6e80-44b0-89fe-f5994763dc32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:45.592320 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b7ffe2-6e80-44b0-89fe-f5994763dc32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:45.593884 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b7ffe2-6e80-44b0-89fe-f5994763dc32 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:45.603689 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1329/2657] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:33:45 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 12:33:45.607817 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b7ffe2-6e80-44b0-89fe-f5994763dc32 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:45.617002 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b7ffe2-6e80-44b0-89fe-f5994763dc32 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:45.621779 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648a5685-5492-4ae4-8d0d-0c56ff88ad1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:45.622402 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a5685-5492-4ae4-8d0d-0c56ff88ad1f admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:45.622683 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a5685-5492-4ae4-8d0d-0c56ff88ad1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:45.622981 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a5685-5492-4ae4-8d0d-0c56ff88ad1f admin admin] PATH_INFO: `/v3/projects/0bcf0f5c83fc484b880d820e9e2b0eda/users/9cdd2a1fdc5c4503b200ef5dd1890e36/roles/7f53f1c823b746529ba5057bf21b2477` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:45.624835 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648a5685-5492-4ae4-8d0d-0c56ff88ad1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bcf0f5c83fc484b880d820e9e2b0eda, user_id=9cdd2a1fdc5c4503b200ef5dd1890e36, role_id=7f53f1c823b746529ba5057bf21b2477)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:45.625212 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109f1f51-0cb0-467c-a5fb-17d676f2fef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:45.625814 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f1f51-0cb0-467c-a5fb-17d676f2fef2 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:45.626090 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f1f51-0cb0-467c-a5fb-17d676f2fef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:45.626612 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f1f51-0cb0-467c-a5fb-17d676f2fef2 admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:45.627259 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109f1f51-0cb0-467c-a5fb-17d676f2fef2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:45.627744 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648a5685-5492-4ae4-8d0d-0c56ff88ad1f admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:45.629695 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109f1f51-0cb0-467c-a5fb-17d676f2fef2 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:45.638341 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1330/2658] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:33:45 2022] PUT /identity/v3/projects/0bcf0f5c83fc484b880d820e9e2b0eda/users/9cdd2a1fdc5c4503b200ef5dd1890e36/roles/7f53f1c823b746529ba5057bf21b2477 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:33:45.649272 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d55a3-1847-4936-b96d-ba6230dc04a4 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:45.649553 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d55a3-1847-4936-b96d-ba6230dc04a4 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:45.649967 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d55a3-1847-4936-b96d-ba6230dc04a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:45.653273 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1329/2659] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:33:45 2022] POST /identity/v3/users => generated 299 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 12:33:45.656950 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109f1f51-0cb0-467c-a5fb-17d676f2fef2 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:45.667591 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109f1f51-0cb0-467c-a5fb-17d676f2fef2 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:45.678105 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-8a5d55a3-1847-4936-b96d-ba6230dc04a4 None None] MFA Rules not processed for user `9cdd2a1fdc5c4503b200ef5dd1890e36`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:33:45.679330 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-8a5d55a3-1847-4936-b96d-ba6230dc04a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:45.696815 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:33:45.724888 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbfa126-ed11-403e-ae97-f7c46383e7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:45.725493 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbfa126-ed11-403e-ae97-f7c46383e7b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:45.725771 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbfa126-ed11-403e-ae97-f7c46383e7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:45.726041 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbfa126-ed11-403e-ae97-f7c46383e7b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:45.726676 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbfa126-ed11-403e-ae97-f7c46383e7b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:45.728294 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbfa126-ed11-403e-ae97-f7c46383e7b2 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:45.737762 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1330/2660] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:33:45 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 12:33:45.742742 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbfa126-ed11-403e-ae97-f7c46383e7b2 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:45.748176 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1331/2661] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:33:45 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:33:45.753410 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbfa126-ed11-403e-ae97-f7c46383e7b2 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:45.758948 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77084333-6380-4a8d-8999-fa39f5ad9cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:45.759827 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77084333-6380-4a8d-8999-fa39f5ad9cf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:45.760160 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77084333-6380-4a8d-8999-fa39f5ad9cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:45.760270 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5d55a3-1847-4936-b96d-ba6230dc04a4 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:45.760361 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77084333-6380-4a8d-8999-fa39f5ad9cf0 admin admin] PATH_INFO: `/v3/projects/1503757889a140ffa5092d97758e0b5b/users/0533e65ef9074d70910601cbdda9cabc/roles/7f53f1c823b746529ba5057bf21b2477` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:45.761751 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-8a5d55a3-1847-4936-b96d-ba6230dc04a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:45.776252 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77084333-6380-4a8d-8999-fa39f5ad9cf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1503757889a140ffa5092d97758e0b5b, user_id=0533e65ef9074d70910601cbdda9cabc, role_id=7f53f1c823b746529ba5057bf21b2477)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:45.778922 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77084333-6380-4a8d-8999-fa39f5ad9cf0 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:45.792756 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1331/2662] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:33:45 2022] PUT /identity/v3/projects/1503757889a140ffa5092d97758e0b5b/users/0533e65ef9074d70910601cbdda9cabc/roles/7f53f1c823b746529ba5057bf21b2477 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:33:45.796524 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77084333-6380-4a8d-8999-fa39f5ad9cf0 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:45.819736 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5d55a3-1847-4936-b96d-ba6230dc04a4 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:45.858390 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77084333-6380-4a8d-8999-fa39f5ad9cf0 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:45.863125 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d1144c-7ac2-4b42-8b77-91b2eec871d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:45.864240 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d1144c-7ac2-4b42-8b77-91b2eec871d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:45.864519 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d1144c-7ac2-4b42-8b77-91b2eec871d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:45.864789 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d1144c-7ac2-4b42-8b77-91b2eec871d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:45.865442 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d1144c-7ac2-4b42-8b77-91b2eec871d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:45.867067 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d1144c-7ac2-4b42-8b77-91b2eec871d1 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:45.867707 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c346643-e022-4ff0-9d4c-c1785fec8c27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceafc5e4283841528053f01931f10293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:45.868432 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c346643-e022-4ff0-9d4c-c1785fec8c27 service cinder] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:45.868705 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c346643-e022-4ff0-9d4c-c1785fec8c27 service cinder] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:45.868979 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c346643-e022-4ff0-9d4c-c1785fec8c27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:45.877251 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1332/2663] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:33:45 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 12:33:45.881861 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d1144c-7ac2-4b42-8b77-91b2eec871d1 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:45.891039 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d1144c-7ac2-4b42-8b77-91b2eec871d1 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:45.895735 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473b55cf-afcd-4622-8d53-acc33245b4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:45.896362 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b55cf-afcd-4622-8d53-acc33245b4fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:45.896639 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b55cf-afcd-4622-8d53-acc33245b4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:45.896908 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b55cf-afcd-4622-8d53-acc33245b4fa admin admin] PATH_INFO: `/v3/projects/1503757889a140ffa5092d97758e0b5b/users/0533e65ef9074d70910601cbdda9cabc/roles/7f53f1c823b746529ba5057bf21b2477` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:45.898828 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473b55cf-afcd-4622-8d53-acc33245b4fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=1503757889a140ffa5092d97758e0b5b, user_id=0533e65ef9074d70910601cbdda9cabc, role_id=7f53f1c823b746529ba5057bf21b2477)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:45.901442 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473b55cf-afcd-4622-8d53-acc33245b4fa admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:45.911876 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1333/2664] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:33:45 2022] PUT /identity/v3/projects/1503757889a140ffa5092d97758e0b5b/users/0533e65ef9074d70910601cbdda9cabc/roles/7f53f1c823b746529ba5057bf21b2477 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:33:45.921850 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e66dff-f2a3-40dc-af60-766ba9e4a055 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:45.922130 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e66dff-f2a3-40dc-af60-766ba9e4a055 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:45.922401 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e66dff-f2a3-40dc-af60-766ba9e4a055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:45.927514 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c346643-e022-4ff0-9d4c-c1785fec8c27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:45.928951 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c346643-e022-4ff0-9d4c-c1785fec8c27 service cinder] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:45.932331 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:33:45.938995 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1332/2665] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:33:45 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:33:45.953125 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-36e66dff-f2a3-40dc-af60-766ba9e4a055 None None] MFA Rules not processed for user `0533e65ef9074d70910601cbdda9cabc`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:33:45.954359 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-36e66dff-f2a3-40dc-af60-766ba9e4a055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:46.032262 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1334/2666] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:33:45 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:33:46.043498 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c346643-e022-4ff0-9d4c-c1785fec8c27 service cinder] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:46.044892 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-4c346643-e022-4ff0-9d4c-c1785fec8c27 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:46.056135 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c346643-e022-4ff0-9d4c-c1785fec8c27 service cinder] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:46.084746 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:33:46.112070 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5804b01e-2b26-4c01-8f26-f8f047c230d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceafc5e4283841528053f01931f10293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:46.112680 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5804b01e-2b26-4c01-8f26-f8f047c230d7 service cinder] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:46.112960 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5804b01e-2b26-4c01-8f26-f8f047c230d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:46.113315 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5804b01e-2b26-4c01-8f26-f8f047c230d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:46.123303 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5804b01e-2b26-4c01-8f26-f8f047c230d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:46.124909 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5804b01e-2b26-4c01-8f26-f8f047c230d7 service cinder] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:46.135291 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1333/2667] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:33:46 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:33:46.642414 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e66dff-f2a3-40dc-af60-766ba9e4a055 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:46.652499 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e66dff-f2a3-40dc-af60-766ba9e4a055 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:46.656048 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc68327d-9fc0-4b0f-afc5-a9658d1e8ecb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceafc5e4283841528053f01931f10293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:46.656640 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc68327d-9fc0-4b0f-afc5-a9658d1e8ecb service cinder] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:46.656918 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc68327d-9fc0-4b0f-afc5-a9658d1e8ecb service cinder] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:46.657187 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc68327d-9fc0-4b0f-afc5-a9658d1e8ecb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:46.711985 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc68327d-9fc0-4b0f-afc5-a9658d1e8ecb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:46.713404 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc68327d-9fc0-4b0f-afc5-a9658d1e8ecb service cinder] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:46.722085 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1335/2668] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:33:46 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:33:47.463846 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5804b01e-2b26-4c01-8f26-f8f047c230d7 service cinder] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:47.472194 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5804b01e-2b26-4c01-8f26-f8f047c230d7 service cinder] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:47.475818 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64f98a0-d712-47c4-85b6-e7c6668a55cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceafc5e4283841528053f01931f10293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:47.476392 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64f98a0-d712-47c4-85b6-e7c6668a55cb service cinder] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:47.476665 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64f98a0-d712-47c4-85b6-e7c6668a55cb service cinder] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:47.476929 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64f98a0-d712-47c4-85b6-e7c6668a55cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:47.535815 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64f98a0-d712-47c4-85b6-e7c6668a55cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:47.537203 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64f98a0-d712-47c4-85b6-e7c6668a55cb service cinder] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:47.546744 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1334/2669] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:33:47 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:33:48.067502 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc68327d-9fc0-4b0f-afc5-a9658d1e8ecb service cinder] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:48.076865 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc68327d-9fc0-4b0f-afc5-a9658d1e8ecb service cinder] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:48.080825 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9f6aad-2f43-4e0e-a482-4b67ae4cb50b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceafc5e4283841528053f01931f10293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:48.081591 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f6aad-2f43-4e0e-a482-4b67ae4cb50b service cinder] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:48.082407 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f6aad-2f43-4e0e-a482-4b67ae4cb50b service cinder] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:48.082675 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9f6aad-2f43-4e0e-a482-4b67ae4cb50b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:48.145797 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9f6aad-2f43-4e0e-a482-4b67ae4cb50b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:48.147707 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9f6aad-2f43-4e0e-a482-4b67ae4cb50b service cinder] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:48.157373 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1336/2670] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:33:48 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:33:50.747265 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64f98a0-d712-47c4-85b6-e7c6668a55cb service cinder] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:50.756397 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64f98a0-d712-47c4-85b6-e7c6668a55cb service cinder] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:50.760330 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525fb420-c5e0-4fe3-b1ce-c174dd2b59e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceafc5e4283841528053f01931f10293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:50.761025 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525fb420-c5e0-4fe3-b1ce-c174dd2b59e5 service cinder] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:50.761408 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525fb420-c5e0-4fe3-b1ce-c174dd2b59e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:50.761727 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525fb420-c5e0-4fe3-b1ce-c174dd2b59e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:50.820995 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525fb420-c5e0-4fe3-b1ce-c174dd2b59e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:50.822398 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525fb420-c5e0-4fe3-b1ce-c174dd2b59e5 service cinder] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:50.831516 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1335/2671] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:33:50 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:33:52.053463 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9f6aad-2f43-4e0e-a482-4b67ae4cb50b service cinder] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:52.078225 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:33:52.115841 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9f6aad-2f43-4e0e-a482-4b67ae4cb50b service cinder] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:52.120400 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72b0052-8d26-4ffa-b908-46d89f62f5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:52.121046 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b0052-8d26-4ffa-b908-46d89f62f5dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:52.121324 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b0052-8d26-4ffa-b908-46d89f62f5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:52.121595 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b0052-8d26-4ffa-b908-46d89f62f5dd admin admin] PATH_INFO: `/v3/users/3fed38aa25304fdb9d2c55c85d7acd34` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:52.122710 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72b0052-8d26-4ffa-b908-46d89f62f5dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fed38aa25304fdb9d2c55c85d7acd34)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:52.124726 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72b0052-8d26-4ffa-b908-46d89f62f5dd admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:52.168812 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-b72b0052-8d26-4ffa-b908-46d89f62f5dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fed38aa25304fdb9d2c55c85d7acd34'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:52.175848 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-b72b0052-8d26-4ffa-b908-46d89f62f5dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fed38aa25304fdb9d2c55c85d7acd34'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:52.177034 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-b72b0052-8d26-4ffa-b908-46d89f62f5dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fed38aa25304fdb9d2c55c85d7acd34'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:52.177647 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-b72b0052-8d26-4ffa-b908-46d89f62f5dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fed38aa25304fdb9d2c55c85d7acd34'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:52.184616 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-b72b0052-8d26-4ffa-b908-46d89f62f5dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fed38aa25304fdb9d2c55c85d7acd34'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:52.201276 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1337/2672] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:33:52 2022] DELETE /identity/v3/users/3fed38aa25304fdb9d2c55c85d7acd34 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:33:52.205896 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce256584-3875-454e-a11c-2d9936489f19 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:52.206374 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce256584-3875-454e-a11c-2d9936489f19 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:52.206486 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce256584-3875-454e-a11c-2d9936489f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:52.226483 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-ce256584-3875-454e-a11c-2d9936489f19 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:33:52.227701 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-ce256584-3875-454e-a11c-2d9936489f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:52.284775 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1336/2673] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:33:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:33:52.294840 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72b0052-8d26-4ffa-b908-46d89f62f5dd admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:52.296263 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-b72b0052-8d26-4ffa-b908-46d89f62f5dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:52.351737 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72b0052-8d26-4ffa-b908-46d89f62f5dd admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:52.355393 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34160a6f-f6a5-471f-8b79-5eacf33f7463 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:52.355990 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34160a6f-f6a5-471f-8b79-5eacf33f7463 service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:52.356269 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34160a6f-f6a5-471f-8b79-5eacf33f7463 service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:52.356540 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34160a6f-f6a5-471f-8b79-5eacf33f7463 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:52.366210 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34160a6f-f6a5-471f-8b79-5eacf33f7463 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:52.367699 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34160a6f-f6a5-471f-8b79-5eacf33f7463 service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:52.377306 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1338/2674] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:33:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:33:52.639864 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce256584-3875-454e-a11c-2d9936489f19 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:52.641683 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-ce256584-3875-454e-a11c-2d9936489f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:52.664275 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce256584-3875-454e-a11c-2d9936489f19 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:52.670112 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a2cca0-6150-49cc-b30b-ca7e5b18da64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:52.676668 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a2cca0-6150-49cc-b30b-ca7e5b18da64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:52.677029 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a2cca0-6150-49cc-b30b-ca7e5b18da64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:52.677357 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a2cca0-6150-49cc-b30b-ca7e5b18da64 admin admin] PATH_INFO: `/v3/projects/e0c29881dc0a44f88197d42072018980` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:52.679151 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a2cca0-6150-49cc-b30b-ca7e5b18da64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0c29881dc0a44f88197d42072018980)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:52.681291 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a2cca0-6150-49cc-b30b-ca7e5b18da64 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:52.683528 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:33:52.731782 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-77a2cca0-6150-49cc-b30b-ca7e5b18da64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0c29881dc0a44f88197d42072018980', 'request_id': 'req-77a2cca0-6150-49cc-b30b-ca7e5b18da64'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:52.738714 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-77a2cca0-6150-49cc-b30b-ca7e5b18da64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0c29881dc0a44f88197d42072018980', 'request_id': 'req-77a2cca0-6150-49cc-b30b-ca7e5b18da64'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:52.747089 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-77a2cca0-6150-49cc-b30b-ca7e5b18da64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0c29881dc0a44f88197d42072018980', 'request_id': 'req-77a2cca0-6150-49cc-b30b-ca7e5b18da64'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:52.760846 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-77a2cca0-6150-49cc-b30b-ca7e5b18da64 admin admin] The token cache is being invalidate because project e0c29881dc0a44f88197d42072018980 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:33:52.761164 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-77a2cca0-6150-49cc-b30b-ca7e5b18da64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:52.762040 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-77a2cca0-6150-49cc-b30b-ca7e5b18da64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:52.763908 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1337/2675] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:33:52 2022] DELETE /identity/v3/projects/e0c29881dc0a44f88197d42072018980 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:33:52.767943 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34160a6f-f6a5-471f-8b79-5eacf33f7463 service neutron] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:52.778177 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34160a6f-f6a5-471f-8b79-5eacf33f7463 service neutron] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:52.820013 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:33:52.837307 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b450a4f-5058-41a6-bcad-be45ff8d5e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:52.837936 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b450a4f-5058-41a6-bcad-be45ff8d5e99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:52.838215 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b450a4f-5058-41a6-bcad-be45ff8d5e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:52.838488 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b450a4f-5058-41a6-bcad-be45ff8d5e99 admin admin] PATH_INFO: `/v3/users/abac0682af8d40c3a8861943f463c210` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:52.839631 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b450a4f-5058-41a6-bcad-be45ff8d5e99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abac0682af8d40c3a8861943f463c210)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:52.841624 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b450a4f-5058-41a6-bcad-be45ff8d5e99 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:52.892759 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-3b450a4f-5058-41a6-bcad-be45ff8d5e99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abac0682af8d40c3a8861943f463c210'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:52.900207 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-3b450a4f-5058-41a6-bcad-be45ff8d5e99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abac0682af8d40c3a8861943f463c210'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:52.900892 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-3b450a4f-5058-41a6-bcad-be45ff8d5e99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abac0682af8d40c3a8861943f463c210'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:52.901506 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-3b450a4f-5058-41a6-bcad-be45ff8d5e99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abac0682af8d40c3a8861943f463c210'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:52.908814 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-3b450a4f-5058-41a6-bcad-be45ff8d5e99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abac0682af8d40c3a8861943f463c210'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:52.928908 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1339/2676] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:33:52 2022] DELETE /identity/v3/users/abac0682af8d40c3a8861943f463c210 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:33:52.982321 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a2cca0-6150-49cc-b30b-ca7e5b18da64 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:52.984031 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-77a2cca0-6150-49cc-b30b-ca7e5b18da64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:52.998015 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a2cca0-6150-49cc-b30b-ca7e5b18da64 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:53.057576 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e2f17b-7e09-472e-9a1a-f38ac18c9c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:53.058206 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e2f17b-7e09-472e-9a1a-f38ac18c9c50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:53.058487 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e2f17b-7e09-472e-9a1a-f38ac18c9c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:53.058787 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e2f17b-7e09-472e-9a1a-f38ac18c9c50 admin admin] PATH_INFO: `/v3/users/b7c4a781c4aa4c6dbcca1bd0c51f1466` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:53.059891 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e2f17b-7e09-472e-9a1a-f38ac18c9c50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7c4a781c4aa4c6dbcca1bd0c51f1466)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:53.061814 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e2f17b-7e09-472e-9a1a-f38ac18c9c50 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:53.112527 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-10e2f17b-7e09-472e-9a1a-f38ac18c9c50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7c4a781c4aa4c6dbcca1bd0c51f1466'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:53.121914 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-10e2f17b-7e09-472e-9a1a-f38ac18c9c50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7c4a781c4aa4c6dbcca1bd0c51f1466'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:53.122537 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-10e2f17b-7e09-472e-9a1a-f38ac18c9c50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7c4a781c4aa4c6dbcca1bd0c51f1466'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:53.123208 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-10e2f17b-7e09-472e-9a1a-f38ac18c9c50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7c4a781c4aa4c6dbcca1bd0c51f1466'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:53.130976 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-10e2f17b-7e09-472e-9a1a-f38ac18c9c50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7c4a781c4aa4c6dbcca1bd0c51f1466'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:53.150721 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1338/2677] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:33:52 2022] DELETE /identity/v3/users/b7c4a781c4aa4c6dbcca1bd0c51f1466 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:33:53.154512 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9519ee88-271d-498b-aa76-dad7d0b368fb None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:53.155002 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9519ee88-271d-498b-aa76-dad7d0b368fb None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:53.155242 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9519ee88-271d-498b-aa76-dad7d0b368fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:53.175465 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-9519ee88-271d-498b-aa76-dad7d0b368fb None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:33:53.176693 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-9519ee88-271d-498b-aa76-dad7d0b368fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:53.211273 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e2f17b-7e09-472e-9a1a-f38ac18c9c50 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:53.212693 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-10e2f17b-7e09-472e-9a1a-f38ac18c9c50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:53.224641 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:33:53.245496 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1340/2678] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:33:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:33:53.255305 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9519ee88-271d-498b-aa76-dad7d0b368fb None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:53.257236 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-9519ee88-271d-498b-aa76-dad7d0b368fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:53.291543 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e2f17b-7e09-472e-9a1a-f38ac18c9c50 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:53.297201 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6292c5d-3455-4cbb-ad09-f7758c05180e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:53.297838 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6292c5d-3455-4cbb-ad09-f7758c05180e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:53.298120 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6292c5d-3455-4cbb-ad09-f7758c05180e admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:53.298407 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6292c5d-3455-4cbb-ad09-f7758c05180e admin admin] PATH_INFO: `/v3/projects/aede7460a72a47cc9a3611604e4eb472` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:53.300129 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6292c5d-3455-4cbb-ad09-f7758c05180e admin admin] RBAC: Authorizing `identity:delete_project(project_id=aede7460a72a47cc9a3611604e4eb472)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:53.302464 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6292c5d-3455-4cbb-ad09-f7758c05180e admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:53.318191 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9519ee88-271d-498b-aa76-dad7d0b368fb None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:53.321900 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a22def-d05c-44e9-90ff-3eda12acc0cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:53.322567 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a22def-d05c-44e9-90ff-3eda12acc0cf service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:53.322878 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a22def-d05c-44e9-90ff-3eda12acc0cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:53.323146 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a22def-d05c-44e9-90ff-3eda12acc0cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:53.332505 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a22def-d05c-44e9-90ff-3eda12acc0cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:53.335101 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a22def-d05c-44e9-90ff-3eda12acc0cf service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:53.345454 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1341/2679] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:33:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 12:33:53.352112 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-d6292c5d-3455-4cbb-ad09-f7758c05180e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aede7460a72a47cc9a3611604e4eb472', 'request_id': 'req-d6292c5d-3455-4cbb-ad09-f7758c05180e'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:53.358387 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-d6292c5d-3455-4cbb-ad09-f7758c05180e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aede7460a72a47cc9a3611604e4eb472', 'request_id': 'req-d6292c5d-3455-4cbb-ad09-f7758c05180e'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:53.365050 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-d6292c5d-3455-4cbb-ad09-f7758c05180e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aede7460a72a47cc9a3611604e4eb472', 'request_id': 'req-d6292c5d-3455-4cbb-ad09-f7758c05180e'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:53.378736 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-d6292c5d-3455-4cbb-ad09-f7758c05180e admin admin] The token cache is being invalidate because project aede7460a72a47cc9a3611604e4eb472 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:33:53.379031 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-d6292c5d-3455-4cbb-ad09-f7758c05180e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:53.380277 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-d6292c5d-3455-4cbb-ad09-f7758c05180e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:53.381912 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1339/2680] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:33:53 2022] DELETE /identity/v3/projects/aede7460a72a47cc9a3611604e4eb472 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:33:53.386069 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a22def-d05c-44e9-90ff-3eda12acc0cf service neutron] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:53.396269 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a22def-d05c-44e9-90ff-3eda12acc0cf service neutron] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:53.400179 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:33:53.458837 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55082be3-c430-4af9-a9ff-5a6b4be882ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:53.459478 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55082be3-c430-4af9-a9ff-5a6b4be882ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:53.459754 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55082be3-c430-4af9-a9ff-5a6b4be882ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:53.460023 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55082be3-c430-4af9-a9ff-5a6b4be882ad admin admin] PATH_INFO: `/v3/users/9cdd2a1fdc5c4503b200ef5dd1890e36` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:53.461194 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55082be3-c430-4af9-a9ff-5a6b4be882ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cdd2a1fdc5c4503b200ef5dd1890e36)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:53.463135 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55082be3-c430-4af9-a9ff-5a6b4be882ad admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:53.513268 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-55082be3-c430-4af9-a9ff-5a6b4be882ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cdd2a1fdc5c4503b200ef5dd1890e36'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:53.521019 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-55082be3-c430-4af9-a9ff-5a6b4be882ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cdd2a1fdc5c4503b200ef5dd1890e36'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:53.521837 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-55082be3-c430-4af9-a9ff-5a6b4be882ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cdd2a1fdc5c4503b200ef5dd1890e36'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:53.522461 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-55082be3-c430-4af9-a9ff-5a6b4be882ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cdd2a1fdc5c4503b200ef5dd1890e36'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:53.531039 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-55082be3-c430-4af9-a9ff-5a6b4be882ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cdd2a1fdc5c4503b200ef5dd1890e36'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:53.554983 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1342/2681] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:33:53 2022] DELETE /identity/v3/users/9cdd2a1fdc5c4503b200ef5dd1890e36 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:33:53.630041 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6292c5d-3455-4cbb-ad09-f7758c05180e admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:53.631835 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-d6292c5d-3455-4cbb-ad09-f7758c05180e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:53.664338 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6292c5d-3455-4cbb-ad09-f7758c05180e admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:53.726322 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154cd910-402a-40f3-ba75-6d37ee880f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:53.727025 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154cd910-402a-40f3-ba75-6d37ee880f0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:53.727301 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154cd910-402a-40f3-ba75-6d37ee880f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:53.727566 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154cd910-402a-40f3-ba75-6d37ee880f0a admin admin] PATH_INFO: `/v3/projects/63a51931e75e4b86b69a06dc37db6208` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:53.728789 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154cd910-402a-40f3-ba75-6d37ee880f0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=63a51931e75e4b86b69a06dc37db6208)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:53.730756 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154cd910-402a-40f3-ba75-6d37ee880f0a admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:53.773451 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:33:53.781116 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-154cd910-402a-40f3-ba75-6d37ee880f0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63a51931e75e4b86b69a06dc37db6208', 'request_id': 'req-154cd910-402a-40f3-ba75-6d37ee880f0a'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:53.788115 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-154cd910-402a-40f3-ba75-6d37ee880f0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63a51931e75e4b86b69a06dc37db6208', 'request_id': 'req-154cd910-402a-40f3-ba75-6d37ee880f0a'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:53.794049 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-154cd910-402a-40f3-ba75-6d37ee880f0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63a51931e75e4b86b69a06dc37db6208', 'request_id': 'req-154cd910-402a-40f3-ba75-6d37ee880f0a'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:53.807751 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-154cd910-402a-40f3-ba75-6d37ee880f0a admin admin] The token cache is being invalidate because project 63a51931e75e4b86b69a06dc37db6208 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:33:53.808041 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-154cd910-402a-40f3-ba75-6d37ee880f0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:53.808656 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-154cd910-402a-40f3-ba75-6d37ee880f0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:53.810149 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1340/2682] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:33:53 2022] DELETE /identity/v3/projects/63a51931e75e4b86b69a06dc37db6208 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:33:53.814504 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55082be3-c430-4af9-a9ff-5a6b4be882ad admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:53.816210 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-55082be3-c430-4af9-a9ff-5a6b4be882ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:53.830240 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55082be3-c430-4af9-a9ff-5a6b4be882ad admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:53.837278 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154cd910-402a-40f3-ba75-6d37ee880f0a admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:53.838791 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-154cd910-402a-40f3-ba75-6d37ee880f0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:53.897050 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b04f1e-8d28-4e92-8571-93751752c20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:53.897605 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b04f1e-8d28-4e92-8571-93751752c20b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:53.897884 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b04f1e-8d28-4e92-8571-93751752c20b admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:53.898158 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b04f1e-8d28-4e92-8571-93751752c20b admin admin] PATH_INFO: `/v3/users/4fdbb8e76d6f42348dbaf3d53d02c40d` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:53.899294 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b04f1e-8d28-4e92-8571-93751752c20b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fdbb8e76d6f42348dbaf3d53d02c40d)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:53.901214 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b04f1e-8d28-4e92-8571-93751752c20b admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:53.907849 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154cd910-402a-40f3-ba75-6d37ee880f0a admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:53.912580 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca12209b-90fe-4b55-bdac-3425ac6487f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:53.913195 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca12209b-90fe-4b55-bdac-3425ac6487f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:53.913492 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca12209b-90fe-4b55-bdac-3425ac6487f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:53.913743 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca12209b-90fe-4b55-bdac-3425ac6487f9 admin admin] PATH_INFO: `/v3/projects/0bcf0f5c83fc484b880d820e9e2b0eda` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:53.914877 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca12209b-90fe-4b55-bdac-3425ac6487f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bcf0f5c83fc484b880d820e9e2b0eda)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:53.916739 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca12209b-90fe-4b55-bdac-3425ac6487f9 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:53.930597 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:33:53.954248 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-32b04f1e-8d28-4e92-8571-93751752c20b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fdbb8e76d6f42348dbaf3d53d02c40d'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:53.962018 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-32b04f1e-8d28-4e92-8571-93751752c20b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fdbb8e76d6f42348dbaf3d53d02c40d'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:53.962718 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-32b04f1e-8d28-4e92-8571-93751752c20b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fdbb8e76d6f42348dbaf3d53d02c40d'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:53.963380 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-32b04f1e-8d28-4e92-8571-93751752c20b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fdbb8e76d6f42348dbaf3d53d02c40d'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:53.966339 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-ca12209b-90fe-4b55-bdac-3425ac6487f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bcf0f5c83fc484b880d820e9e2b0eda', 'request_id': 'req-ca12209b-90fe-4b55-bdac-3425ac6487f9'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:53.972871 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-ca12209b-90fe-4b55-bdac-3425ac6487f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bcf0f5c83fc484b880d820e9e2b0eda', 'request_id': 'req-ca12209b-90fe-4b55-bdac-3425ac6487f9'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:53.973358 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-32b04f1e-8d28-4e92-8571-93751752c20b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fdbb8e76d6f42348dbaf3d53d02c40d'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:53.982609 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-ca12209b-90fe-4b55-bdac-3425ac6487f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bcf0f5c83fc484b880d820e9e2b0eda', 'request_id': 'req-ca12209b-90fe-4b55-bdac-3425ac6487f9'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:53.992655 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1343/2683] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:33:53 2022] DELETE /identity/v3/users/4fdbb8e76d6f42348dbaf3d53d02c40d => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:33:53.995816 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-ca12209b-90fe-4b55-bdac-3425ac6487f9 admin admin] The token cache is being invalidate because project 0bcf0f5c83fc484b880d820e9e2b0eda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:33:53.996114 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-ca12209b-90fe-4b55-bdac-3425ac6487f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:53.996722 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-ca12209b-90fe-4b55-bdac-3425ac6487f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:53.998240 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1341/2684] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:33:53 2022] DELETE /identity/v3/projects/0bcf0f5c83fc484b880d820e9e2b0eda => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:33:54.003435 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b8946-93fd-405a-a731-c5cd71c933ad None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:54.003794 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b8946-93fd-405a-a731-c5cd71c933ad None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:54.004076 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b8946-93fd-405a-a731-c5cd71c933ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:54.024584 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-543b8946-93fd-405a-a731-c5cd71c933ad None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:33:54.025795 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-543b8946-93fd-405a-a731-c5cd71c933ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:54.091731 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1344/2685] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:33:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:33:54.101277 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33585a-2a59-4e78-acbd-ebc7ad963e24 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:54.101913 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33585a-2a59-4e78-acbd-ebc7ad963e24 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:54.102305 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33585a-2a59-4e78-acbd-ebc7ad963e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:54.123978 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-0f33585a-2a59-4e78-acbd-ebc7ad963e24 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:33:54.125187 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-0f33585a-2a59-4e78-acbd-ebc7ad963e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:54.133711 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1342/2686] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:33:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:33:54.138265 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543b8946-93fd-405a-a731-c5cd71c933ad None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:54.151290 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543b8946-93fd-405a-a731-c5cd71c933ad None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:54.156205 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9ca1b0-9fb8-4d29-8772-f34daa982b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:54.156817 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ca1b0-9fb8-4d29-8772-f34daa982b52 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:54.157090 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ca1b0-9fb8-4d29-8772-f34daa982b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:54.157355 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ca1b0-9fb8-4d29-8772-f34daa982b52 admin admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:54.157991 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9ca1b0-9fb8-4d29-8772-f34daa982b52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:33:54.158292 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9ca1b0-9fb8-4d29-8772-f34daa982b52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:54.159907 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9ca1b0-9fb8-4d29-8772-f34daa982b52 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:54.175564 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1345/2687] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 15 12:33:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:33:54.177004 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f33585a-2a59-4e78-acbd-ebc7ad963e24 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:54.186392 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f33585a-2a59-4e78-acbd-ebc7ad963e24 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:54.191354 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e45ac9-44ec-40a0-9128-7c837d574b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:54.191983 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e45ac9-44ec-40a0-9128-7c837d574b10 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:54.192261 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e45ac9-44ec-40a0-9128-7c837d574b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:54.192667 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e45ac9-44ec-40a0-9128-7c837d574b10 admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:54.193300 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e45ac9-44ec-40a0-9128-7c837d574b10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:54.195238 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e45ac9-44ec-40a0-9128-7c837d574b10 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:54.223194 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1343/2688] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:33:54 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:33:54.227989 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9ca1b0-9fb8-4d29-8772-f34daa982b52 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:54.237976 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9ca1b0-9fb8-4d29-8772-f34daa982b52 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:54.269522 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e45ac9-44ec-40a0-9128-7c837d574b10 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:54.272019 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-66e45ac9-44ec-40a0-9128-7c837d574b10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:54.302744 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73527078-5104-46cc-a138-2bb4b0b40e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:54.303332 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73527078-5104-46cc-a138-2bb4b0b40e18 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:54.303611 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73527078-5104-46cc-a138-2bb4b0b40e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:54.303879 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73527078-5104-46cc-a138-2bb4b0b40e18 admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:54.304502 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73527078-5104-46cc-a138-2bb4b0b40e18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:54.306399 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73527078-5104-46cc-a138-2bb4b0b40e18 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:54.327609 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1346/2689] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:33:54 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 12:33:54.328966 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:33:54.333323 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73527078-5104-46cc-a138-2bb4b0b40e18 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:54.343831 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73527078-5104-46cc-a138-2bb4b0b40e18 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:54.349056 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402ae62a-f704-42e0-8061-b37a83c6117f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:54.349651 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ae62a-f704-42e0-8061-b37a83c6117f admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:54.349928 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ae62a-f704-42e0-8061-b37a83c6117f admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:54.350203 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ae62a-f704-42e0-8061-b37a83c6117f admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:54.351440 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402ae62a-f704-42e0-8061-b37a83c6117f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:54.353027 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402ae62a-f704-42e0-8061-b37a83c6117f admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:54.362177 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e45ac9-44ec-40a0-9128-7c837d574b10 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:54.363024 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1347/2690] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:33:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 12:33:54.367505 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402ae62a-f704-42e0-8061-b37a83c6117f admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:54.367692 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0cdb43-08da-425d-b700-bf1e6878d8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:54.368319 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0cdb43-08da-425d-b700-bf1e6878d8b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:54.368593 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0cdb43-08da-425d-b700-bf1e6878d8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:54.368861 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0cdb43-08da-425d-b700-bf1e6878d8b2 admin admin] PATH_INFO: `/v3/projects/67e4fbeaff1b4c2e9c6bf111633b0373` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:54.369980 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0cdb43-08da-425d-b700-bf1e6878d8b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67e4fbeaff1b4c2e9c6bf111633b0373)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:54.371868 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0cdb43-08da-425d-b700-bf1e6878d8b2 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:54.377695 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402ae62a-f704-42e0-8061-b37a83c6117f admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:54.383140 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ee60e7-7b8d-4551-a939-7c5acf17fa1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:54.383739 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee60e7-7b8d-4551-a939-7c5acf17fa1f admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:54.384020 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee60e7-7b8d-4551-a939-7c5acf17fa1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:54.384289 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee60e7-7b8d-4551-a939-7c5acf17fa1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:54.384911 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ee60e7-7b8d-4551-a939-7c5acf17fa1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:54.386467 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ee60e7-7b8d-4551-a939-7c5acf17fa1f admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:54.391715 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:33:54.398649 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1348/2691] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:33:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 12:33:54.403016 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ee60e7-7b8d-4551-a939-7c5acf17fa1f admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:54.413431 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ee60e7-7b8d-4551-a939-7c5acf17fa1f admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:54.419699 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-ea0cdb43-08da-425d-b700-bf1e6878d8b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67e4fbeaff1b4c2e9c6bf111633b0373', 'request_id': 'req-ea0cdb43-08da-425d-b700-bf1e6878d8b2'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:54.425800 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-ea0cdb43-08da-425d-b700-bf1e6878d8b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67e4fbeaff1b4c2e9c6bf111633b0373', 'request_id': 'req-ea0cdb43-08da-425d-b700-bf1e6878d8b2'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:54.431758 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-ea0cdb43-08da-425d-b700-bf1e6878d8b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67e4fbeaff1b4c2e9c6bf111633b0373', 'request_id': 'req-ea0cdb43-08da-425d-b700-bf1e6878d8b2'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:54.444788 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-ea0cdb43-08da-425d-b700-bf1e6878d8b2 admin admin] The token cache is being invalidate because project 67e4fbeaff1b4c2e9c6bf111633b0373 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:33:54.445077 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-ea0cdb43-08da-425d-b700-bf1e6878d8b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:54.445706 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-ea0cdb43-08da-425d-b700-bf1e6878d8b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:54.447301 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1344/2692] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:33:54 2022] DELETE /identity/v3/projects/67e4fbeaff1b4c2e9c6bf111633b0373 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:33:54.451290 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0cdb43-08da-425d-b700-bf1e6878d8b2 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:54.452975 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-ea0cdb43-08da-425d-b700-bf1e6878d8b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:54.470287 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844c4087-3e7b-4ea5-982f-a526b87ea634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:54.470985 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c4087-3e7b-4ea5-982f-a526b87ea634 admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:54.471266 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c4087-3e7b-4ea5-982f-a526b87ea634 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:54.471535 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c4087-3e7b-4ea5-982f-a526b87ea634 admin admin] PATH_INFO: `/v3/projects/6476601994bf43ae971336652d210d7f/users/a95a7ef041db4e67ba77a0b1530ab6df/roles/9371e5bbc55848949eb951a815f817f2` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:54.485787 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844c4087-3e7b-4ea5-982f-a526b87ea634 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6476601994bf43ae971336652d210d7f, user_id=a95a7ef041db4e67ba77a0b1530ab6df, role_id=9371e5bbc55848949eb951a815f817f2)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:54.488511 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844c4087-3e7b-4ea5-982f-a526b87ea634 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:54.503170 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1349/2693] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:33:54 2022] PUT /identity/v3/projects/6476601994bf43ae971336652d210d7f/users/a95a7ef041db4e67ba77a0b1530ab6df/roles/9371e5bbc55848949eb951a815f817f2 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:33:54.519509 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0cdb43-08da-425d-b700-bf1e6878d8b2 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:54.570412 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1d3ea-1f69-4565-8532-649e481e1473 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:54.570766 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1d3ea-1f69-4565-8532-649e481e1473 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:54.571005 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1d3ea-1f69-4565-8532-649e481e1473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:54.581723 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff08f74e-72b1-431d-937e-2032833eb3e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:54.583278 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff08f74e-72b1-431d-937e-2032833eb3e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:54.583735 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff08f74e-72b1-431d-937e-2032833eb3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:54.584170 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff08f74e-72b1-431d-937e-2032833eb3e1 admin admin] PATH_INFO: `/v3/users/0533e65ef9074d70910601cbdda9cabc` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:54.585296 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff08f74e-72b1-431d-937e-2032833eb3e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0533e65ef9074d70910601cbdda9cabc)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:54.587258 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff08f74e-72b1-431d-937e-2032833eb3e1 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:54.597306 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:33:54.599053 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-f3c1d3ea-1f69-4565-8532-649e481e1473 None None] MFA Rules not processed for user `a95a7ef041db4e67ba77a0b1530ab6df`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:33:54.600417 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-f3c1d3ea-1f69-4565-8532-649e481e1473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:54.636744 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-ff08f74e-72b1-431d-937e-2032833eb3e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0533e65ef9074d70910601cbdda9cabc'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:54.644981 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-ff08f74e-72b1-431d-937e-2032833eb3e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0533e65ef9074d70910601cbdda9cabc'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:54.646350 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-ff08f74e-72b1-431d-937e-2032833eb3e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0533e65ef9074d70910601cbdda9cabc'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:54.646989 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-ff08f74e-72b1-431d-937e-2032833eb3e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0533e65ef9074d70910601cbdda9cabc'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:54.654478 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-ff08f74e-72b1-431d-937e-2032833eb3e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0533e65ef9074d70910601cbdda9cabc'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:54.670476 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1350/2694] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:33:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:33:54.671684 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1345/2695] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:33:54 2022] DELETE /identity/v3/users/0533e65ef9074d70910601cbdda9cabc => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:33:54.675371 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c1d3ea-1f69-4565-8532-649e481e1473 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:54.676966 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-f3c1d3ea-1f69-4565-8532-649e481e1473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:54.690101 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c1d3ea-1f69-4565-8532-649e481e1473 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:54.752099 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd09f5c1-e50e-4a3f-9bed-96ecd2f2edfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:54.752707 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd09f5c1-e50e-4a3f-9bed-96ecd2f2edfd admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:54.752981 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd09f5c1-e50e-4a3f-9bed-96ecd2f2edfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:54.753240 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd09f5c1-e50e-4a3f-9bed-96ecd2f2edfd admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:54.753878 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd09f5c1-e50e-4a3f-9bed-96ecd2f2edfd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:54.755822 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd09f5c1-e50e-4a3f-9bed-96ecd2f2edfd admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:54.779879 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:33:54.791743 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1351/2696] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:33:54 2022] POST /identity/v3/projects => generated 385 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 12:33:54.793095 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff08f74e-72b1-431d-937e-2032833eb3e1 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:54.803418 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff08f74e-72b1-431d-937e-2032833eb3e1 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:54.865436 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3addd1f1-b1b5-47c7-853c-e786dde05fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:54.866158 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3addd1f1-b1b5-47c7-853c-e786dde05fa4 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:54.866591 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3addd1f1-b1b5-47c7-853c-e786dde05fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:54.866892 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3addd1f1-b1b5-47c7-853c-e786dde05fa4 admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:54.867612 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3addd1f1-b1b5-47c7-853c-e786dde05fa4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:54.869506 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3addd1f1-b1b5-47c7-853c-e786dde05fa4 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:54.892001 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1346/2697] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:33:54 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:33:54.895972 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd09f5c1-e50e-4a3f-9bed-96ecd2f2edfd admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:54.906984 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd09f5c1-e50e-4a3f-9bed-96ecd2f2edfd admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:54.911761 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a91c2b-6e05-452d-853c-36ef2a756f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:54.912355 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a91c2b-6e05-452d-853c-36ef2a756f28 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:54.912629 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a91c2b-6e05-452d-853c-36ef2a756f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:54.912900 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a91c2b-6e05-452d-853c-36ef2a756f28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:54.913534 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a91c2b-6e05-452d-853c-36ef2a756f28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:54.915167 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a91c2b-6e05-452d-853c-36ef2a756f28 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:54.930157 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1352/2698] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:33:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:33:54.931507 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3addd1f1-b1b5-47c7-853c-e786dde05fa4 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:54.943117 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3addd1f1-b1b5-47c7-853c-e786dde05fa4 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:54.947973 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a91c2b-6e05-452d-853c-36ef2a756f28 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:54.949275 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f6830d-5f63-452e-a431-a2eb689b7703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:54.949751 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-39a91c2b-6e05-452d-853c-36ef2a756f28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:54.950448 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f6830d-5f63-452e-a431-a2eb689b7703 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:54.950772 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f6830d-5f63-452e-a431-a2eb689b7703 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:54.951223 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f6830d-5f63-452e-a431-a2eb689b7703 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:54.951906 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f6830d-5f63-452e-a431-a2eb689b7703 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:54.953677 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f6830d-5f63-452e-a431-a2eb689b7703 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:54.968334 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1347/2699] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:33:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:33:54.974000 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f6830d-5f63-452e-a431-a2eb689b7703 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:54.982300 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a91c2b-6e05-452d-853c-36ef2a756f28 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:54.985198 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f6830d-5f63-452e-a431-a2eb689b7703 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:54.987232 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c4e8ff-1c7a-40be-ac22-212a0dd2357d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:54.987869 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c4e8ff-1c7a-40be-ac22-212a0dd2357d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:54.988149 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c4e8ff-1c7a-40be-ac22-212a0dd2357d admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:54.988419 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c4e8ff-1c7a-40be-ac22-212a0dd2357d admin admin] PATH_INFO: `/v3/projects/1503757889a140ffa5092d97758e0b5b` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:54.989707 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c4e8ff-1c7a-40be-ac22-212a0dd2357d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1503757889a140ffa5092d97758e0b5b)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:54.990158 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bcada7-5f9b-4ed4-882f-e6fe19966f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:54.990850 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bcada7-5f9b-4ed4-882f-e6fe19966f36 admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:54.991128 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bcada7-5f9b-4ed4-882f-e6fe19966f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:54.991399 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bcada7-5f9b-4ed4-882f-e6fe19966f36 admin admin] PATH_INFO: `/v3/projects/2f1a4e956ae54d998785b1d56d490bf2/users/8a51dd9983e34a5fb38d3f1771f0036e/roles/9371e5bbc55848949eb951a815f817f2` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:54.991625 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c4e8ff-1c7a-40be-ac22-212a0dd2357d admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:55.009015 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bcada7-5f9b-4ed4-882f-e6fe19966f36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f1a4e956ae54d998785b1d56d490bf2, user_id=8a51dd9983e34a5fb38d3f1771f0036e, role_id=9371e5bbc55848949eb951a815f817f2)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:55.011706 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bcada7-5f9b-4ed4-882f-e6fe19966f36 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:55.026376 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1348/2700] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:33:54 2022] PUT /identity/v3/projects/2f1a4e956ae54d998785b1d56d490bf2/users/8a51dd9983e34a5fb38d3f1771f0036e/roles/9371e5bbc55848949eb951a815f817f2 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:33:55.037111 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de76be-2233-4358-877d-f62f1eb292b9 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:55.037396 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de76be-2233-4358-877d-f62f1eb292b9 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:55.037666 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de76be-2233-4358-877d-f62f1eb292b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:55.040804 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-a0c4e8ff-1c7a-40be-ac22-212a0dd2357d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1503757889a140ffa5092d97758e0b5b', 'request_id': 'req-a0c4e8ff-1c7a-40be-ac22-212a0dd2357d'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:55.046534 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-a0c4e8ff-1c7a-40be-ac22-212a0dd2357d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1503757889a140ffa5092d97758e0b5b', 'request_id': 'req-a0c4e8ff-1c7a-40be-ac22-212a0dd2357d'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:55.054554 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-a0c4e8ff-1c7a-40be-ac22-212a0dd2357d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1503757889a140ffa5092d97758e0b5b', 'request_id': 'req-a0c4e8ff-1c7a-40be-ac22-212a0dd2357d'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:55.065762 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-a0c4e8ff-1c7a-40be-ac22-212a0dd2357d admin admin] The token cache is being invalidate because project 1503757889a140ffa5092d97758e0b5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:33:55.066048 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-a0c4e8ff-1c7a-40be-ac22-212a0dd2357d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:55.066718 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-a0c4e8ff-1c7a-40be-ac22-212a0dd2357d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:33:55.067814 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-31de76be-2233-4358-877d-f62f1eb292b9 None None] MFA Rules not processed for user `8a51dd9983e34a5fb38d3f1771f0036e`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:33:55.068486 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1353/2701] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:33:54 2022] DELETE /identity/v3/projects/1503757889a140ffa5092d97758e0b5b => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:33:55.069032 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-31de76be-2233-4358-877d-f62f1eb292b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:55.073992 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c97f8-5ea4-4a7c-a033-9601ffa6aad1 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:55.074273 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c97f8-5ea4-4a7c-a033-9601ffa6aad1 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:55.074543 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c97f8-5ea4-4a7c-a033-9601ffa6aad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:55.094854 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-db9c97f8-5ea4-4a7c-a033-9601ffa6aad1 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:33:55.096037 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-db9c97f8-5ea4-4a7c-a033-9601ffa6aad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:55.101277 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:DELETE=10,keystone:SELECT=85,keystone:INSERT=5 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:33:55.139920 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1349/2702] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:33:55 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:33:55.144323 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31de76be-2233-4358-877d-f62f1eb292b9 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:55.145627 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-31de76be-2233-4358-877d-f62f1eb292b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:55.156305 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1354/2703] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:33:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:33:55.215583 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31de76be-2233-4358-877d-f62f1eb292b9 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:55.220111 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a734a7-ad6f-4789-9357-b8bb1eaf87c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:55.220751 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a734a7-ad6f-4789-9357-b8bb1eaf87c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:55.221030 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a734a7-ad6f-4789-9357-b8bb1eaf87c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:55.221299 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a734a7-ad6f-4789-9357-b8bb1eaf87c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:55.221926 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a734a7-ad6f-4789-9357-b8bb1eaf87c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:55.222861 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e37a3-1528-4d17-9a51-d02e0b6354b1 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:55.223717 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e37a3-1528-4d17-9a51-d02e0b6354b1 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:55.223994 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e37a3-1528-4d17-9a51-d02e0b6354b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:55.224363 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a734a7-ad6f-4789-9357-b8bb1eaf87c1 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:55.243780 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-a28e37a3-1528-4d17-9a51-d02e0b6354b1 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:33:55.244953 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-a28e37a3-1528-4d17-9a51-d02e0b6354b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:55.252263 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1350/2704] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:33:55 2022] POST /identity/v3/projects => generated 383 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 12:33:55.253423 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1355/2705] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:33:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:33:55.257710 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28e37a3-1528-4d17-9a51-d02e0b6354b1 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:55.257834 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a734a7-ad6f-4789-9357-b8bb1eaf87c1 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:55.267080 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28e37a3-1528-4d17-9a51-d02e0b6354b1 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:55.320483 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a734a7-ad6f-4789-9357-b8bb1eaf87c1 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:55.325162 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c51d7-1a3b-417a-bf6e-ad2abc62c75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:55.325758 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c51d7-1a3b-417a-bf6e-ad2abc62c75e admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:55.326037 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c51d7-1a3b-417a-bf6e-ad2abc62c75e admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:55.326314 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c51d7-1a3b-417a-bf6e-ad2abc62c75e admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:55.326970 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5c51d7-1a3b-417a-bf6e-ad2abc62c75e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:55.327101 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c0a5a6-8224-42c1-adee-87b2b973e823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:55.327643 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c0a5a6-8224-42c1-adee-87b2b973e823 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:55.327922 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c0a5a6-8224-42c1-adee-87b2b973e823 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:55.328196 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c0a5a6-8224-42c1-adee-87b2b973e823 admin admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:55.328842 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c0a5a6-8224-42c1-adee-87b2b973e823 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:33:55.328938 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5c51d7-1a3b-417a-bf6e-ad2abc62c75e admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:55.329148 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c0a5a6-8224-42c1-adee-87b2b973e823 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:55.330787 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c0a5a6-8224-42c1-adee-87b2b973e823 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:55.337863 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:33:55.346795 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1356/2706] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 15 12:33:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:33:55.349062 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c0a5a6-8224-42c1-adee-87b2b973e823 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:55.354834 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1351/2707] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:33:55 2022] POST /identity/v3/users => generated 298 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 12:33:55.356422 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c51d7-1a3b-417a-bf6e-ad2abc62c75e admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:55.359610 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c0a5a6-8224-42c1-adee-87b2b973e823 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:55.365640 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5f8f45-707a-491c-a84b-f81a84f18f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:55.366242 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f8f45-707a-491c-a84b-f81a84f18f85 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:55.366524 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f8f45-707a-491c-a84b-f81a84f18f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:55.366829 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f8f45-707a-491c-a84b-f81a84f18f85 admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:55.366943 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c51d7-1a3b-417a-bf6e-ad2abc62c75e admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:55.367490 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5f8f45-707a-491c-a84b-f81a84f18f85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:55.369487 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5f8f45-707a-491c-a84b-f81a84f18f85 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:55.371454 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92edc6d7-f053-41b4-bd46-37ab4b1e088d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:55.372018 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92edc6d7-f053-41b4-bd46-37ab4b1e088d admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:55.372293 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92edc6d7-f053-41b4-bd46-37ab4b1e088d admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:55.372560 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92edc6d7-f053-41b4-bd46-37ab4b1e088d admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:55.373215 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92edc6d7-f053-41b4-bd46-37ab4b1e088d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:55.374919 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92edc6d7-f053-41b4-bd46-37ab4b1e088d admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:55.386540 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1352/2708] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:33:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:33:55.391085 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92edc6d7-f053-41b4-bd46-37ab4b1e088d admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:55.400586 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1357/2709] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:33:55 2022] POST /identity/v3/projects => generated 391 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 12:33:55.402081 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92edc6d7-f053-41b4-bd46-37ab4b1e088d admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:55.404596 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5f8f45-707a-491c-a84b-f81a84f18f85 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:55.434665 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:33:55.462245 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62972285-2404-4ba2-bc8d-9d048c557ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:55.463450 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62972285-2404-4ba2-bc8d-9d048c557ed9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:55.463729 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62972285-2404-4ba2-bc8d-9d048c557ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:55.464006 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62972285-2404-4ba2-bc8d-9d048c557ed9 admin admin] PATH_INFO: `/v3/projects/037614cb3f5e4b53965f76729c287eac/users/622dba532f0a422cb726718c4e9a69b1/roles/7f53f1c823b746529ba5057bf21b2477` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:55.466489 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5f8f45-707a-491c-a84b-f81a84f18f85 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:55.471319 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661d325e-c4b4-432e-beef-a630ec5e9e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:55.472328 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661d325e-c4b4-432e-beef-a630ec5e9e84 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:55.472654 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661d325e-c4b4-432e-beef-a630ec5e9e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:55.472927 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661d325e-c4b4-432e-beef-a630ec5e9e84 admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:55.473622 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661d325e-c4b4-432e-beef-a630ec5e9e84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:55.475593 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661d325e-c4b4-432e-beef-a630ec5e9e84 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:55.478073 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62972285-2404-4ba2-bc8d-9d048c557ed9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=037614cb3f5e4b53965f76729c287eac, user_id=622dba532f0a422cb726718c4e9a69b1, role_id=7f53f1c823b746529ba5057bf21b2477)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:55.480737 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62972285-2404-4ba2-bc8d-9d048c557ed9 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:55.496161 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1353/2710] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:33:55 2022] PUT /identity/v3/projects/037614cb3f5e4b53965f76729c287eac/users/622dba532f0a422cb726718c4e9a69b1/roles/7f53f1c823b746529ba5057bf21b2477 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:33:55.497672 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1358/2711] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:33:55 2022] POST /identity/v3/users => generated 296 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 12:33:55.501965 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62972285-2404-4ba2-bc8d-9d048c557ed9 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:55.502099 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661d325e-c4b4-432e-beef-a630ec5e9e84 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:55.512768 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661d325e-c4b4-432e-beef-a630ec5e9e84 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:55.564752 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62972285-2404-4ba2-bc8d-9d048c557ed9 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:55.570051 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafa0b48-30d5-4b91-a317-276a796856b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:55.570347 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46af9896-e5f3-437d-bece-1e833bd7af97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:55.570655 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa0b48-30d5-4b91-a317-276a796856b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:55.570974 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa0b48-30d5-4b91-a317-276a796856b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:55.571114 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46af9896-e5f3-437d-bece-1e833bd7af97 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:55.571250 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa0b48-30d5-4b91-a317-276a796856b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:55.571398 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46af9896-e5f3-437d-bece-1e833bd7af97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:55.571556 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46af9896-e5f3-437d-bece-1e833bd7af97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:55.571884 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafa0b48-30d5-4b91-a317-276a796856b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:55.572157 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46af9896-e5f3-437d-bece-1e833bd7af97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:55.573480 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafa0b48-30d5-4b91-a317-276a796856b7 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:55.573743 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46af9896-e5f3-437d-bece-1e833bd7af97 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:55.583731 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1354/2712] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:33:55 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 12:33:55.586660 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1359/2713] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:33:55 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:33:55.587672 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46af9896-e5f3-437d-bece-1e833bd7af97 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:55.587809 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafa0b48-30d5-4b91-a317-276a796856b7 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:55.597127 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafa0b48-30d5-4b91-a317-276a796856b7 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:55.597883 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46af9896-e5f3-437d-bece-1e833bd7af97 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:55.601896 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b16e0ac-0315-4437-8c87-46ccd6e88279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:55.602498 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b16e0ac-0315-4437-8c87-46ccd6e88279 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:55.602637 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9972b87b-fcff-4700-90e5-717f3861d22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:55.602847 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b16e0ac-0315-4437-8c87-46ccd6e88279 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:55.603105 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b16e0ac-0315-4437-8c87-46ccd6e88279 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:55.603279 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9972b87b-fcff-4700-90e5-717f3861d22b admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:55.603557 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9972b87b-fcff-4700-90e5-717f3861d22b admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:55.603730 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b16e0ac-0315-4437-8c87-46ccd6e88279 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:55.603837 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9972b87b-fcff-4700-90e5-717f3861d22b admin admin] PATH_INFO: `/v3/projects/037614cb3f5e4b53965f76729c287eac/users/622dba532f0a422cb726718c4e9a69b1/roles/7f53f1c823b746529ba5057bf21b2477` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:55.605712 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9972b87b-fcff-4700-90e5-717f3861d22b admin admin] RBAC: Authorizing `identity:create_grant(project_id=037614cb3f5e4b53965f76729c287eac, user_id=622dba532f0a422cb726718c4e9a69b1, role_id=7f53f1c823b746529ba5057bf21b2477)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:55.605994 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b16e0ac-0315-4437-8c87-46ccd6e88279 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:55.608355 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9972b87b-fcff-4700-90e5-717f3861d22b admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:55.616429 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1355/2714] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:33:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:33:55.619134 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1360/2715] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:33:55 2022] PUT /identity/v3/projects/037614cb3f5e4b53965f76729c287eac/users/622dba532f0a422cb726718c4e9a69b1/roles/7f53f1c823b746529ba5057bf21b2477 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:33:55.620622 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b16e0ac-0315-4437-8c87-46ccd6e88279 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:55.631122 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b16e0ac-0315-4437-8c87-46ccd6e88279 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:55.631633 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56463e05-dbd3-4f02-af76-f6c389e47ab5 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:55.631926 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56463e05-dbd3-4f02-af76-f6c389e47ab5 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:55.632202 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56463e05-dbd3-4f02-af76-f6c389e47ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:55.660327 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-56463e05-dbd3-4f02-af76-f6c389e47ab5 None None] MFA Rules not processed for user `622dba532f0a422cb726718c4e9a69b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:33:55.661575 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-56463e05-dbd3-4f02-af76-f6c389e47ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:55.688589 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4821db1f-69fa-494d-b755-6c8e3c3af6fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:55.689237 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4821db1f-69fa-494d-b755-6c8e3c3af6fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:55.689513 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4821db1f-69fa-494d-b755-6c8e3c3af6fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:55.689783 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4821db1f-69fa-494d-b755-6c8e3c3af6fe admin admin] PATH_INFO: `/v3/projects/138299748f2142f98f3ec2111ca977e3/users/00b006568ec14c2b982015724469d59e/roles/9371e5bbc55848949eb951a815f817f2` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:55.700305 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:33:55.704953 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4821db1f-69fa-494d-b755-6c8e3c3af6fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=138299748f2142f98f3ec2111ca977e3, user_id=00b006568ec14c2b982015724469d59e, role_id=9371e5bbc55848949eb951a815f817f2)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:55.707755 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4821db1f-69fa-494d-b755-6c8e3c3af6fe admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:55.720244 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1356/2716] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:33:55 2022] PUT /identity/v3/projects/138299748f2142f98f3ec2111ca977e3/users/00b006568ec14c2b982015724469d59e/roles/9371e5bbc55848949eb951a815f817f2 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:33:55.731483 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cebd65a-dad5-47ea-a1cf-43babbce78d0 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:55.731768 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cebd65a-dad5-47ea-a1cf-43babbce78d0 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:55.732045 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cebd65a-dad5-47ea-a1cf-43babbce78d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:55.733086 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1361/2717] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:33:55 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:33:55.745130 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56463e05-dbd3-4f02-af76-f6c389e47ab5 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:55.746489 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-56463e05-dbd3-4f02-af76-f6c389e47ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:55.764024 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-9cebd65a-dad5-47ea-a1cf-43babbce78d0 None None] MFA Rules not processed for user `00b006568ec14c2b982015724469d59e`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:33:55.765372 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-9cebd65a-dad5-47ea-a1cf-43babbce78d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:55.777795 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:33:55.809197 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56463e05-dbd3-4f02-af76-f6c389e47ab5 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:55.830906 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1357/2718] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:33:55 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:33:55.835446 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cebd65a-dad5-47ea-a1cf-43babbce78d0 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:55.857771 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef88da-9dab-4692-827b-91e96a761ed0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceafc5e4283841528053f01931f10293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:55.858387 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef88da-9dab-4692-827b-91e96a761ed0 service cinder] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:55.858671 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef88da-9dab-4692-827b-91e96a761ed0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:55.858975 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef88da-9dab-4692-827b-91e96a761ed0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:55.860762 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-15ef88da-9dab-4692-827b-91e96a761ed0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:55.897573 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cebd65a-dad5-47ea-a1cf-43babbce78d0 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:55.902270 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ab3024-34b8-4f80-b0fb-03a47af6bce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:55.902924 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ab3024-34b8-4f80-b0fb-03a47af6bce5 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:55.903226 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ab3024-34b8-4f80-b0fb-03a47af6bce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:55.903495 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ab3024-34b8-4f80-b0fb-03a47af6bce5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:55.904243 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ab3024-34b8-4f80-b0fb-03a47af6bce5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:55.906122 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ab3024-34b8-4f80-b0fb-03a47af6bce5 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:55.920162 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ef88da-9dab-4692-827b-91e96a761ed0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:55.921607 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ef88da-9dab-4692-827b-91e96a761ed0 service cinder] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:55.931636 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1362/2719] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:33:55 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 12:33:55.934872 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1358/2720] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:33:55 2022] POST /identity/v3/projects => generated 393 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 12:33:55.938807 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef88da-9dab-4692-827b-91e96a761ed0 service cinder] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:55.949584 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef88da-9dab-4692-827b-91e96a761ed0 service cinder] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:55.997524 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:33:56.013562 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c57859-5883-43ad-a079-7f7a1c0212cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:56.014193 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c57859-5883-43ad-a079-7f7a1c0212cd admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:56.014474 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c57859-5883-43ad-a079-7f7a1c0212cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:56.014770 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c57859-5883-43ad-a079-7f7a1c0212cd admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:56.015409 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c57859-5883-43ad-a079-7f7a1c0212cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:56.017454 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c57859-5883-43ad-a079-7f7a1c0212cd admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:56.038858 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1363/2721] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:33:55 2022] POST /identity/v3/users => generated 303 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:33:56.042920 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ab3024-34b8-4f80-b0fb-03a47af6bce5 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:56.053822 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ab3024-34b8-4f80-b0fb-03a47af6bce5 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:56.058857 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc39b37-8d47-4f2a-8e26-060604ee83c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:56.059585 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc39b37-8d47-4f2a-8e26-060604ee83c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:56.059866 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc39b37-8d47-4f2a-8e26-060604ee83c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:56.060132 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc39b37-8d47-4f2a-8e26-060604ee83c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:56.060761 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc39b37-8d47-4f2a-8e26-060604ee83c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:56.062383 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc39b37-8d47-4f2a-8e26-060604ee83c9 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:56.072785 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1359/2722] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:33:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 12:33:56.077403 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c57859-5883-43ad-a079-7f7a1c0212cd admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:56.087997 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c57859-5883-43ad-a079-7f7a1c0212cd admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:56.093103 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f764be-1c21-4fa9-a363-fa5ad0c93714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:56.094030 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f764be-1c21-4fa9-a363-fa5ad0c93714 admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:56.094308 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f764be-1c21-4fa9-a363-fa5ad0c93714 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:56.094717 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f764be-1c21-4fa9-a363-fa5ad0c93714 admin admin] PATH_INFO: `/v3/projects/683e0759183f4dbdb0b36d7aa148bf85/users/aafe0fa10c43439497d5ba75bc611af5/roles/7f53f1c823b746529ba5057bf21b2477` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:56.111062 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f764be-1c21-4fa9-a363-fa5ad0c93714 admin admin] RBAC: Authorizing `identity:create_grant(project_id=683e0759183f4dbdb0b36d7aa148bf85, user_id=aafe0fa10c43439497d5ba75bc611af5, role_id=7f53f1c823b746529ba5057bf21b2477)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:56.114515 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f764be-1c21-4fa9-a363-fa5ad0c93714 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:56.129954 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1364/2723] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:33:56 2022] PUT /identity/v3/projects/683e0759183f4dbdb0b36d7aa148bf85/users/aafe0fa10c43439497d5ba75bc611af5/roles/7f53f1c823b746529ba5057bf21b2477 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:33:56.134078 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc39b37-8d47-4f2a-8e26-060604ee83c9 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:56.144421 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc39b37-8d47-4f2a-8e26-060604ee83c9 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:56.213283 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc87cc-41bb-41d5-b011-f16dad60506f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:56.213890 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc87cc-41bb-41d5-b011-f16dad60506f admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:56.214173 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc87cc-41bb-41d5-b011-f16dad60506f admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:56.214567 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc87cc-41bb-41d5-b011-f16dad60506f admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:56.215248 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bc87cc-41bb-41d5-b011-f16dad60506f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:56.216969 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bc87cc-41bb-41d5-b011-f16dad60506f admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:56.244365 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1360/2724] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:33:56 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:33:56.245312 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f764be-1c21-4fa9-a363-fa5ad0c93714 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:56.248896 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f764be-1c21-4fa9-a363-fa5ad0c93714 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:56.253819 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2cf5e6-e034-4ff6-89fc-7187a5c6fd6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:56.254529 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2cf5e6-e034-4ff6-89fc-7187a5c6fd6c admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:56.254864 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2cf5e6-e034-4ff6-89fc-7187a5c6fd6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:56.255135 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2cf5e6-e034-4ff6-89fc-7187a5c6fd6c admin admin] PATH_INFO: `/v3/projects/683e0759183f4dbdb0b36d7aa148bf85/users/aafe0fa10c43439497d5ba75bc611af5/roles/7f53f1c823b746529ba5057bf21b2477` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:56.257047 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2cf5e6-e034-4ff6-89fc-7187a5c6fd6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=683e0759183f4dbdb0b36d7aa148bf85, user_id=aafe0fa10c43439497d5ba75bc611af5, role_id=7f53f1c823b746529ba5057bf21b2477)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:56.259706 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2cf5e6-e034-4ff6-89fc-7187a5c6fd6c admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:56.270913 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1365/2725] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:33:56 2022] PUT /identity/v3/projects/683e0759183f4dbdb0b36d7aa148bf85/users/aafe0fa10c43439497d5ba75bc611af5/roles/7f53f1c823b746529ba5057bf21b2477 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:33:56.281208 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a6fb0-1df2-4d14-85dc-f95577d7d9c2 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:56.281487 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a6fb0-1df2-4d14-85dc-f95577d7d9c2 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:56.281754 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a6fb0-1df2-4d14-85dc-f95577d7d9c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:56.310656 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-482a6fb0-1df2-4d14-85dc-f95577d7d9c2 None None] MFA Rules not processed for user `aafe0fa10c43439497d5ba75bc611af5`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:33:56.311906 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-482a6fb0-1df2-4d14-85dc-f95577d7d9c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:56.324252 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:33:56.380345 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1361/2726] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:33:56 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:33:56.391417 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2cf5e6-e034-4ff6-89fc-7187a5c6fd6c admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:56.447521 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2cf5e6-e034-4ff6-89fc-7187a5c6fd6c admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:56.451186 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9576968-e1c3-430a-b960-71881570dde1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceafc5e4283841528053f01931f10293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:56.451778 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9576968-e1c3-430a-b960-71881570dde1 service cinder] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:56.452055 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9576968-e1c3-430a-b960-71881570dde1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:56.452325 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9576968-e1c3-430a-b960-71881570dde1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:56.461978 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9576968-e1c3-430a-b960-71881570dde1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:56.463516 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9576968-e1c3-430a-b960-71881570dde1 service cinder] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:56.472952 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1366/2727] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:33:56 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:33:56.519168 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482a6fb0-1df2-4d14-85dc-f95577d7d9c2 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:56.520531 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-482a6fb0-1df2-4d14-85dc-f95577d7d9c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:33:56.532880 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482a6fb0-1df2-4d14-85dc-f95577d7d9c2 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:56.537028 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0007180e-d062-4863-a468-3a1beb815700 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceafc5e4283841528053f01931f10293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:56.537612 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0007180e-d062-4863-a468-3a1beb815700 service cinder] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:56.537886 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0007180e-d062-4863-a468-3a1beb815700 service cinder] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:56.538152 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0007180e-d062-4863-a468-3a1beb815700 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:56.593030 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0007180e-d062-4863-a468-3a1beb815700 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:56.594437 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0007180e-d062-4863-a468-3a1beb815700 service cinder] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:56.603617 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1362/2728] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:33:56 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:33:57.462994 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9576968-e1c3-430a-b960-71881570dde1 service cinder] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:57.471988 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9576968-e1c3-430a-b960-71881570dde1 service cinder] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:57.475616 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a03a4b-8b95-4431-891d-5a38f47f1be2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceafc5e4283841528053f01931f10293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:57.476203 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a03a4b-8b95-4431-891d-5a38f47f1be2 service cinder] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:57.476480 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a03a4b-8b95-4431-891d-5a38f47f1be2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:57.476748 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a03a4b-8b95-4431-891d-5a38f47f1be2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:57.532104 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a03a4b-8b95-4431-891d-5a38f47f1be2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:57.533457 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a03a4b-8b95-4431-891d-5a38f47f1be2 service cinder] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:57.542204 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1367/2729] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:33:57 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:33:58.094598 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0007180e-d062-4863-a468-3a1beb815700 service cinder] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:33:58.109443 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0007180e-d062-4863-a468-3a1beb815700 service cinder] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:33:58.115788 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbec742-730f-4bb4-98f2-a99bdd037461 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceafc5e4283841528053f01931f10293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:33:58.117499 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbec742-730f-4bb4-98f2-a99bdd037461 service cinder] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:33:58.118078 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbec742-730f-4bb4-98f2-a99bdd037461 service cinder] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:33:58.118502 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbec742-730f-4bb4-98f2-a99bdd037461 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:33:58.208872 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbec742-730f-4bb4-98f2-a99bdd037461 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:33:58.210292 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbec742-730f-4bb4-98f2-a99bdd037461 service cinder] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:33:58.221449 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1363/2730] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:33:58 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:34:00.014180 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a03a4b-8b95-4431-891d-5a38f47f1be2 service cinder] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:00.064066 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:34:00.088281 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a03a4b-8b95-4431-891d-5a38f47f1be2 service cinder] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:00.092948 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dab7fe2-a763-4946-9f96-3e4631b14193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:00.093514 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dab7fe2-a763-4946-9f96-3e4631b14193 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:00.093791 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dab7fe2-a763-4946-9f96-3e4631b14193 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:00.094058 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dab7fe2-a763-4946-9f96-3e4631b14193 admin admin] PATH_INFO: `/v3/users/00b006568ec14c2b982015724469d59e` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:00.095195 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dab7fe2-a763-4946-9f96-3e4631b14193 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00b006568ec14c2b982015724469d59e)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:00.097111 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dab7fe2-a763-4946-9f96-3e4631b14193 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:00.146037 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-2dab7fe2-a763-4946-9f96-3e4631b14193 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00b006568ec14c2b982015724469d59e'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:00.155066 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-2dab7fe2-a763-4946-9f96-3e4631b14193 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00b006568ec14c2b982015724469d59e'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:00.155822 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-2dab7fe2-a763-4946-9f96-3e4631b14193 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00b006568ec14c2b982015724469d59e'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:00.156576 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-2dab7fe2-a763-4946-9f96-3e4631b14193 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00b006568ec14c2b982015724469d59e'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:00.163717 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-2dab7fe2-a763-4946-9f96-3e4631b14193 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00b006568ec14c2b982015724469d59e'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:00.182847 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1368/2731] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:34:00 2022] DELETE /identity/v3/users/00b006568ec14c2b982015724469d59e => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:34:00.187857 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d78df6-89ca-425e-bf5f-120f1b8f1062 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:00.188407 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d78df6-89ca-425e-bf5f-120f1b8f1062 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:00.188508 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d78df6-89ca-425e-bf5f-120f1b8f1062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:00.209015 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-b7d78df6-89ca-425e-bf5f-120f1b8f1062 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:34:00.210213 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-b7d78df6-89ca-425e-bf5f-120f1b8f1062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:34:00.249481 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:34:00.270782 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1364/2732] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:34:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:34:00.281271 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dab7fe2-a763-4946-9f96-3e4631b14193 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:00.282800 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-2dab7fe2-a763-4946-9f96-3e4631b14193 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:34:00.342192 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dab7fe2-a763-4946-9f96-3e4631b14193 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:00.346153 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e053596d-ee45-415d-8888-0b9a28bc27e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:00.346719 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e053596d-ee45-415d-8888-0b9a28bc27e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:00.347058 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e053596d-ee45-415d-8888-0b9a28bc27e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:00.347334 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e053596d-ee45-415d-8888-0b9a28bc27e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:00.356663 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e053596d-ee45-415d-8888-0b9a28bc27e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:00.358094 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e053596d-ee45-415d-8888-0b9a28bc27e8 service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:00.367830 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1369/2733] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:34:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:34:00.657183 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d78df6-89ca-425e-bf5f-120f1b8f1062 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:00.659163 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-b7d78df6-89ca-425e-bf5f-120f1b8f1062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:34:00.682721 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d78df6-89ca-425e-bf5f-120f1b8f1062 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:00.687612 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bac102-b1de-43f5-b266-d6e518e2cd89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:00.688878 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bac102-b1de-43f5-b266-d6e518e2cd89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:00.688878 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bac102-b1de-43f5-b266-d6e518e2cd89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:00.688878 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bac102-b1de-43f5-b266-d6e518e2cd89 admin admin] PATH_INFO: `/v3/projects/138299748f2142f98f3ec2111ca977e3` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:00.690065 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bac102-b1de-43f5-b266-d6e518e2cd89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=138299748f2142f98f3ec2111ca977e3)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:00.692985 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bac102-b1de-43f5-b266-d6e518e2cd89 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:00.787053 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-68bac102-b1de-43f5-b266-d6e518e2cd89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '138299748f2142f98f3ec2111ca977e3', 'request_id': 'req-68bac102-b1de-43f5-b266-d6e518e2cd89'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:00.795336 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-68bac102-b1de-43f5-b266-d6e518e2cd89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '138299748f2142f98f3ec2111ca977e3', 'request_id': 'req-68bac102-b1de-43f5-b266-d6e518e2cd89'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:00.808964 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-68bac102-b1de-43f5-b266-d6e518e2cd89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '138299748f2142f98f3ec2111ca977e3', 'request_id': 'req-68bac102-b1de-43f5-b266-d6e518e2cd89'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:00.834283 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-68bac102-b1de-43f5-b266-d6e518e2cd89 admin admin] The token cache is being invalidate because project 138299748f2142f98f3ec2111ca977e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:34:00.835096 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-68bac102-b1de-43f5-b266-d6e518e2cd89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:00.839694 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-68bac102-b1de-43f5-b266-d6e518e2cd89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:00.842748 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1365/2734] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:34:00 2022] DELETE /identity/v3/projects/138299748f2142f98f3ec2111ca977e3 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:34:00.848127 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e053596d-ee45-415d-8888-0b9a28bc27e8 service neutron] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:00.863416 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e053596d-ee45-415d-8888-0b9a28bc27e8 service neutron] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:00.985175 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df67213-8509-495f-b91d-ebf56f4ba50b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:00.986255 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df67213-8509-495f-b91d-ebf56f4ba50b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:00.986255 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df67213-8509-495f-b91d-ebf56f4ba50b admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:00.986476 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df67213-8509-495f-b91d-ebf56f4ba50b admin admin] PATH_INFO: `/v3/users/aafe0fa10c43439497d5ba75bc611af5` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:00.987598 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df67213-8509-495f-b91d-ebf56f4ba50b admin admin] RBAC: Authorizing `identity:delete_user(user_id=aafe0fa10c43439497d5ba75bc611af5)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:00.990765 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df67213-8509-495f-b91d-ebf56f4ba50b admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:00.992595 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:34:01.061089 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-3df67213-8509-495f-b91d-ebf56f4ba50b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aafe0fa10c43439497d5ba75bc611af5'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:01.075120 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-3df67213-8509-495f-b91d-ebf56f4ba50b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aafe0fa10c43439497d5ba75bc611af5'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:01.076240 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-3df67213-8509-495f-b91d-ebf56f4ba50b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aafe0fa10c43439497d5ba75bc611af5'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:01.076908 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-3df67213-8509-495f-b91d-ebf56f4ba50b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aafe0fa10c43439497d5ba75bc611af5'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:01.095082 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-3df67213-8509-495f-b91d-ebf56f4ba50b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aafe0fa10c43439497d5ba75bc611af5'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:01.117228 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1370/2735] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:34:00 2022] DELETE /identity/v3/users/aafe0fa10c43439497d5ba75bc611af5 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:34:01.453771 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bac102-b1de-43f5-b266-d6e518e2cd89 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:01.456006 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-68bac102-b1de-43f5-b266-d6e518e2cd89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:34:01.477772 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bac102-b1de-43f5-b266-d6e518e2cd89 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:01.542505 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb29175-9a03-4f51-910c-35e8e0d7085b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:01.543182 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb29175-9a03-4f51-910c-35e8e0d7085b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:01.543461 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb29175-9a03-4f51-910c-35e8e0d7085b admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:01.543727 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb29175-9a03-4f51-910c-35e8e0d7085b admin admin] PATH_INFO: `/v3/projects/683e0759183f4dbdb0b36d7aa148bf85` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:01.544829 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb29175-9a03-4f51-910c-35e8e0d7085b admin admin] RBAC: Authorizing `identity:delete_project(project_id=683e0759183f4dbdb0b36d7aa148bf85)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:01.546731 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb29175-9a03-4f51-910c-35e8e0d7085b admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:01.595711 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-2fb29175-9a03-4f51-910c-35e8e0d7085b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '683e0759183f4dbdb0b36d7aa148bf85', 'request_id': 'req-2fb29175-9a03-4f51-910c-35e8e0d7085b'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:01.604974 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-2fb29175-9a03-4f51-910c-35e8e0d7085b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '683e0759183f4dbdb0b36d7aa148bf85', 'request_id': 'req-2fb29175-9a03-4f51-910c-35e8e0d7085b'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:01.611527 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-2fb29175-9a03-4f51-910c-35e8e0d7085b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '683e0759183f4dbdb0b36d7aa148bf85', 'request_id': 'req-2fb29175-9a03-4f51-910c-35e8e0d7085b'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:01.622806 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:34:01.627567 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-2fb29175-9a03-4f51-910c-35e8e0d7085b admin admin] The token cache is being invalidate because project 683e0759183f4dbdb0b36d7aa148bf85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:34:01.628288 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-2fb29175-9a03-4f51-910c-35e8e0d7085b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:01.629878 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-2fb29175-9a03-4f51-910c-35e8e0d7085b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:01.634036 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1366/2736] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:34:01 2022] DELETE /identity/v3/projects/683e0759183f4dbdb0b36d7aa148bf85 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:34:01.638991 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6b3848-6a3c-4979-bc14-35d917da323f None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:01.638991 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6b3848-6a3c-4979-bc14-35d917da323f None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:01.638991 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6b3848-6a3c-4979-bc14-35d917da323f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:01.664461 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-0f6b3848-6a3c-4979-bc14-35d917da323f None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:34:01.665697 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-0f6b3848-6a3c-4979-bc14-35d917da323f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:34:01.730713 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1371/2737] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:34:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:34:01.738257 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff38146-cf79-4d5c-8412-0c25ba39ea0f None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:01.738596 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff38146-cf79-4d5c-8412-0c25ba39ea0f None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:01.738906 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff38146-cf79-4d5c-8412-0c25ba39ea0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:01.764321 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-fff38146-cf79-4d5c-8412-0c25ba39ea0f None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:34:01.766055 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-fff38146-cf79-4d5c-8412-0c25ba39ea0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:34:01.775751 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1367/2738] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:34:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:34:01.779798 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6b3848-6a3c-4979-bc14-35d917da323f None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:01.790774 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6b3848-6a3c-4979-bc14-35d917da323f None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:01.795570 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb49b88-5c89-4fb7-8555-e6b00a2f0cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:01.796189 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb49b88-5c89-4fb7-8555-e6b00a2f0cd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:01.796963 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb49b88-5c89-4fb7-8555-e6b00a2f0cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:01.796963 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb49b88-5c89-4fb7-8555-e6b00a2f0cd8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:01.797603 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb49b88-5c89-4fb7-8555-e6b00a2f0cd8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:34:01.797715 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb49b88-5c89-4fb7-8555-e6b00a2f0cd8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:01.799764 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb49b88-5c89-4fb7-8555-e6b00a2f0cd8 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:01.818031 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1372/2739] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 15 12:34:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:34:01.819241 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff38146-cf79-4d5c-8412-0c25ba39ea0f None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:01.834471 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff38146-cf79-4d5c-8412-0c25ba39ea0f None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:01.841252 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503d8be9-85ee-484b-bcc8-356b5d251101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:01.841597 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d8be9-85ee-484b-bcc8-356b5d251101 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:01.842066 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d8be9-85ee-484b-bcc8-356b5d251101 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:01.842267 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d8be9-85ee-484b-bcc8-356b5d251101 admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:01.843069 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503d8be9-85ee-484b-bcc8-356b5d251101 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:01.845355 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503d8be9-85ee-484b-bcc8-356b5d251101 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:01.888703 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1368/2740] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:34:01 2022] POST /identity/v3/projects => generated 377 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 12:34:01.892822 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb49b88-5c89-4fb7-8555-e6b00a2f0cd8 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:01.907222 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb49b88-5c89-4fb7-8555-e6b00a2f0cd8 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:01.976595 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bf8fd4-43a0-479f-8408-c9361a942985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:01.977417 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf8fd4-43a0-479f-8408-c9361a942985 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:01.978142 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf8fd4-43a0-479f-8408-c9361a942985 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:01.978142 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf8fd4-43a0-479f-8408-c9361a942985 admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:01.978875 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bf8fd4-43a0-479f-8408-c9361a942985 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:01.981485 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bf8fd4-43a0-479f-8408-c9361a942985 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:01.994460 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:34:02.011845 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1373/2741] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:34:01 2022] POST /identity/v3/users => generated 289 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:34:02.013177 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503d8be9-85ee-484b-bcc8-356b5d251101 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:02.025212 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503d8be9-85ee-484b-bcc8-356b5d251101 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:02.030263 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bead53-c442-4a43-83e2-f53c07d39fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:02.031168 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bead53-c442-4a43-83e2-f53c07d39fe6 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:02.031710 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bead53-c442-4a43-83e2-f53c07d39fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:02.032295 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bead53-c442-4a43-83e2-f53c07d39fe6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:02.033175 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bead53-c442-4a43-83e2-f53c07d39fe6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:02.035055 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bead53-c442-4a43-83e2-f53c07d39fe6 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:02.046053 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1369/2742] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:34:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:34:02.050291 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bf8fd4-43a0-479f-8408-c9361a942985 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:02.062833 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bf8fd4-43a0-479f-8408-c9361a942985 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:02.068782 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf714fdc-ca69-42ac-bb36-2a90799c375a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:02.069401 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf714fdc-ca69-42ac-bb36-2a90799c375a admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:02.069684 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf714fdc-ca69-42ac-bb36-2a90799c375a admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:02.070559 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf714fdc-ca69-42ac-bb36-2a90799c375a admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:02.071256 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf714fdc-ca69-42ac-bb36-2a90799c375a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:02.072989 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf714fdc-ca69-42ac-bb36-2a90799c375a admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:02.085204 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1374/2743] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:34:02 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:34:02.089551 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bead53-c442-4a43-83e2-f53c07d39fe6 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:02.100451 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bead53-c442-4a43-83e2-f53c07d39fe6 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:02.105324 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774ee6c4-5bfa-4611-8bc7-ad894b4afbe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:02.105993 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774ee6c4-5bfa-4611-8bc7-ad894b4afbe9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:02.106269 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774ee6c4-5bfa-4611-8bc7-ad894b4afbe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:02.106537 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774ee6c4-5bfa-4611-8bc7-ad894b4afbe9 admin admin] PATH_INFO: `/v3/projects/e202c9447eb54bb0ab6d945f7d20d46b/users/29d053f8f00740e1a0d9a35f3e955f8e/roles/9371e5bbc55848949eb951a815f817f2` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:02.121329 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774ee6c4-5bfa-4611-8bc7-ad894b4afbe9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e202c9447eb54bb0ab6d945f7d20d46b, user_id=29d053f8f00740e1a0d9a35f3e955f8e, role_id=9371e5bbc55848949eb951a815f817f2)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:02.123905 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774ee6c4-5bfa-4611-8bc7-ad894b4afbe9 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:02.137198 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1370/2744] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:34:02 2022] PUT /identity/v3/projects/e202c9447eb54bb0ab6d945f7d20d46b/users/29d053f8f00740e1a0d9a35f3e955f8e/roles/9371e5bbc55848949eb951a815f817f2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:34:02.148096 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da370e18-b2e1-4f26-b4e6-cb247fa88d17 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:02.148667 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da370e18-b2e1-4f26-b4e6-cb247fa88d17 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:02.149002 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da370e18-b2e1-4f26-b4e6-cb247fa88d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:02.179150 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-da370e18-b2e1-4f26-b4e6-cb247fa88d17 None None] MFA Rules not processed for user `29d053f8f00740e1a0d9a35f3e955f8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:34:02.180381 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-da370e18-b2e1-4f26-b4e6-cb247fa88d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:34:02.270314 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1375/2745] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:34:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:34:02.275062 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774ee6c4-5bfa-4611-8bc7-ad894b4afbe9 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:02.290287 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da370e18-b2e1-4f26-b4e6-cb247fa88d17 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:02.292090 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-da370e18-b2e1-4f26-b4e6-cb247fa88d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:34:02.358273 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774ee6c4-5bfa-4611-8bc7-ad894b4afbe9 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:02.363854 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad50a079-324f-4f15-9e4b-d41be3b45a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:02.364468 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad50a079-324f-4f15-9e4b-d41be3b45a32 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:02.364748 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad50a079-324f-4f15-9e4b-d41be3b45a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:02.365020 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad50a079-324f-4f15-9e4b-d41be3b45a32 admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:02.365675 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad50a079-324f-4f15-9e4b-d41be3b45a32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:02.367640 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad50a079-324f-4f15-9e4b-d41be3b45a32 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:02.371959 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da370e18-b2e1-4f26-b4e6-cb247fa88d17 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:02.381629 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88749e0a-2883-47be-9fb9-37f3da4fedea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:02.382634 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88749e0a-2883-47be-9fb9-37f3da4fedea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:02.383075 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88749e0a-2883-47be-9fb9-37f3da4fedea admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:02.383497 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88749e0a-2883-47be-9fb9-37f3da4fedea admin admin] PATH_INFO: `/v3/users/a95a7ef041db4e67ba77a0b1530ab6df` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:02.384724 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88749e0a-2883-47be-9fb9-37f3da4fedea admin admin] RBAC: Authorizing `identity:delete_user(user_id=a95a7ef041db4e67ba77a0b1530ab6df)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:02.386902 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88749e0a-2883-47be-9fb9-37f3da4fedea admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:02.399352 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1371/2746] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:34:02 2022] POST /identity/v3/projects => generated 379 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 12:34:02.403126 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad50a079-324f-4f15-9e4b-d41be3b45a32 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:02.452436 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-88749e0a-2883-47be-9fb9-37f3da4fedea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a95a7ef041db4e67ba77a0b1530ab6df'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:02.461339 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-88749e0a-2883-47be-9fb9-37f3da4fedea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a95a7ef041db4e67ba77a0b1530ab6df'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:02.462094 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-88749e0a-2883-47be-9fb9-37f3da4fedea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a95a7ef041db4e67ba77a0b1530ab6df'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:02.462733 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-88749e0a-2883-47be-9fb9-37f3da4fedea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a95a7ef041db4e67ba77a0b1530ab6df'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:02.470438 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-88749e0a-2883-47be-9fb9-37f3da4fedea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a95a7ef041db4e67ba77a0b1530ab6df'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:02.474233 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad50a079-324f-4f15-9e4b-d41be3b45a32 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:02.480335 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1531b26b-ac9e-4eb9-ba9e-71d0cebeb81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:02.480532 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531b26b-ac9e-4eb9-ba9e-71d0cebeb81a admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:02.480792 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531b26b-ac9e-4eb9-ba9e-71d0cebeb81a admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:02.481061 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531b26b-ac9e-4eb9-ba9e-71d0cebeb81a admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:02.481687 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1531b26b-ac9e-4eb9-ba9e-71d0cebeb81a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:02.483622 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1531b26b-ac9e-4eb9-ba9e-71d0cebeb81a admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:02.484278 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:34:02.497564 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1376/2747] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:34:02 2022] DELETE /identity/v3/users/a95a7ef041db4e67ba77a0b1530ab6df => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:34:02.502294 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8cebc1-fddf-475a-881b-8f73cafeaa75 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:02.502728 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8cebc1-fddf-475a-881b-8f73cafeaa75 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:02.503048 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8cebc1-fddf-475a-881b-8f73cafeaa75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:02.515285 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1372/2748] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:34:02 2022] POST /identity/v3/users => generated 290 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 12:34:02.518970 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1531b26b-ac9e-4eb9-ba9e-71d0cebeb81a admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:02.521117 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-1531b26b-ac9e-4eb9-ba9e-71d0cebeb81a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:34:02.523128 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-5d8cebc1-fddf-475a-881b-8f73cafeaa75 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:34:02.525097 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-5d8cebc1-fddf-475a-881b-8f73cafeaa75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:34:02.541729 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1531b26b-ac9e-4eb9-ba9e-71d0cebeb81a admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:02.547220 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:34:02.607479 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1377/2749] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:34:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:34:02.614857 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8cebc1-fddf-475a-881b-8f73cafeaa75 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:02.616242 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-5d8cebc1-fddf-475a-881b-8f73cafeaa75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:34:02.620744 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93826fd0-7c3b-4008-b95d-2436fc68f3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:02.621515 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93826fd0-7c3b-4008-b95d-2436fc68f3a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:02.621801 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93826fd0-7c3b-4008-b95d-2436fc68f3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:02.622113 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93826fd0-7c3b-4008-b95d-2436fc68f3a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:02.622717 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93826fd0-7c3b-4008-b95d-2436fc68f3a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:02.624318 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93826fd0-7c3b-4008-b95d-2436fc68f3a6 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:02.636245 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1373/2750] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:34:02 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 12:34:02.639952 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93826fd0-7c3b-4008-b95d-2436fc68f3a6 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:02.649965 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93826fd0-7c3b-4008-b95d-2436fc68f3a6 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:02.655152 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c585777-65b3-4056-b92d-8bdea282e5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:02.655645 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c585777-65b3-4056-b92d-8bdea282e5cb admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:02.655924 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c585777-65b3-4056-b92d-8bdea282e5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:02.656193 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c585777-65b3-4056-b92d-8bdea282e5cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:02.656878 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c585777-65b3-4056-b92d-8bdea282e5cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:02.658475 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c585777-65b3-4056-b92d-8bdea282e5cb admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:02.680791 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1374/2751] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:34:02 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 12:34:02.681587 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c585777-65b3-4056-b92d-8bdea282e5cb admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:02.689981 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8cebc1-fddf-475a-881b-8f73cafeaa75 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:02.694447 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cd0a37-93ef-40b4-b038-19a4f40fb12a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:02.695021 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c585777-65b3-4056-b92d-8bdea282e5cb admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:02.695161 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd0a37-93ef-40b4-b038-19a4f40fb12a service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:02.695787 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd0a37-93ef-40b4-b038-19a4f40fb12a service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:02.696065 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd0a37-93ef-40b4-b038-19a4f40fb12a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:02.700126 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a188109a-5ccf-4c7c-a26c-5fc6c18057aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:02.700815 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a188109a-5ccf-4c7c-a26c-5fc6c18057aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:02.701042 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a188109a-5ccf-4c7c-a26c-5fc6c18057aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:02.701413 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a188109a-5ccf-4c7c-a26c-5fc6c18057aa admin admin] PATH_INFO: `/v3/projects/167b44fe330e467fab5ab6d9723522a8/users/c4b2d10d878c446789fe5610b90db2fe/roles/9371e5bbc55848949eb951a815f817f2` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:02.706227 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cd0a37-93ef-40b4-b038-19a4f40fb12a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:02.708629 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cd0a37-93ef-40b4-b038-19a4f40fb12a service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:02.719047 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1378/2752] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:34:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 12:34:02.719541 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a188109a-5ccf-4c7c-a26c-5fc6c18057aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=167b44fe330e467fab5ab6d9723522a8, user_id=c4b2d10d878c446789fe5610b90db2fe, role_id=9371e5bbc55848949eb951a815f817f2)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:02.722267 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a188109a-5ccf-4c7c-a26c-5fc6c18057aa admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:02.741097 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1375/2753] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:34:02 2022] PUT /identity/v3/projects/167b44fe330e467fab5ab6d9723522a8/users/c4b2d10d878c446789fe5610b90db2fe/roles/9371e5bbc55848949eb951a815f817f2 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:34:02.753095 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1930ba-575e-408e-8fd4-689e5e077758 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:02.753376 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1930ba-575e-408e-8fd4-689e5e077758 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:02.753644 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1930ba-575e-408e-8fd4-689e5e077758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:02.787065 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-be1930ba-575e-408e-8fd4-689e5e077758 None None] MFA Rules not processed for user `c4b2d10d878c446789fe5610b90db2fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:34:02.788387 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-be1930ba-575e-408e-8fd4-689e5e077758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:34:02.862307 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1379/2754] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:34:02 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:34:02.867457 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a188109a-5ccf-4c7c-a26c-5fc6c18057aa admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:02.940830 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a188109a-5ccf-4c7c-a26c-5fc6c18057aa admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:02.946180 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0a13b0-7a66-42ea-92da-3742d5c764bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:02.946824 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a13b0-7a66-42ea-92da-3742d5c764bb admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:02.947105 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a13b0-7a66-42ea-92da-3742d5c764bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:02.947403 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a13b0-7a66-42ea-92da-3742d5c764bb admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:02.948045 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0a13b0-7a66-42ea-92da-3742d5c764bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:02.950187 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0a13b0-7a66-42ea-92da-3742d5c764bb admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:02.982667 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1376/2755] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:34:02 2022] POST /identity/v3/projects => generated 379 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:34:02.986723 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1930ba-575e-408e-8fd4-689e5e077758 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:02.999431 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1930ba-575e-408e-8fd4-689e5e077758 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:03.019266 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0a13b0-7a66-42ea-92da-3742d5c764bb admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:03.021875 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-6b0a13b0-7a66-42ea-92da-3742d5c764bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:34:03.025449 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:34:03.063621 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3533bfe8-217d-4663-a227-40e1eab638bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:03.064275 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3533bfe8-217d-4663-a227-40e1eab638bf admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:03.064523 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3533bfe8-217d-4663-a227-40e1eab638bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:03.064923 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3533bfe8-217d-4663-a227-40e1eab638bf admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:03.065459 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3533bfe8-217d-4663-a227-40e1eab638bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:03.068005 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3533bfe8-217d-4663-a227-40e1eab638bf admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:03.093515 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1380/2756] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:34:02 2022] POST /identity/v3/users => generated 296 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 12:34:03.094189 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:34:03.094803 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3533bfe8-217d-4663-a227-40e1eab638bf admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:03.097622 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0a13b0-7a66-42ea-92da-3742d5c764bb admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:03.103518 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b59eca-7e40-4563-be4e-5a4e1cf16ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:03.104156 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b59eca-7e40-4563-be4e-5a4e1cf16ce1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:03.104439 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b59eca-7e40-4563-be4e-5a4e1cf16ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:03.104711 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b59eca-7e40-4563-be4e-5a4e1cf16ce1 admin admin] PATH_INFO: `/v3/projects/6476601994bf43ae971336652d210d7f` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:03.104916 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3533bfe8-217d-4663-a227-40e1eab638bf admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:03.105833 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b59eca-7e40-4563-be4e-5a4e1cf16ce1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6476601994bf43ae971336652d210d7f)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:03.107774 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b59eca-7e40-4563-be4e-5a4e1cf16ce1 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:03.109597 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0839673f-5008-4b32-bedc-c76671510521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:03.110181 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0839673f-5008-4b32-bedc-c76671510521 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:03.110458 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0839673f-5008-4b32-bedc-c76671510521 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:03.110750 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0839673f-5008-4b32-bedc-c76671510521 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:03.111385 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0839673f-5008-4b32-bedc-c76671510521 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:03.112975 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0839673f-5008-4b32-bedc-c76671510521 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:03.123221 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1381/2757] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:34:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:34:03.127437 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0839673f-5008-4b32-bedc-c76671510521 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:03.137890 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0839673f-5008-4b32-bedc-c76671510521 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:03.143194 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b42b2-d256-4b2b-a45c-eecb9f0f8d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:03.143716 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b42b2-d256-4b2b-a45c-eecb9f0f8d58 admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:03.144000 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b42b2-d256-4b2b-a45c-eecb9f0f8d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:03.144282 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b42b2-d256-4b2b-a45c-eecb9f0f8d58 admin admin] PATH_INFO: `/v3/projects/8b0a3bfbf7dd4989b670486b19813655/users/62d1f069438e46f3bafe779b99d19398/roles/7f53f1c823b746529ba5057bf21b2477` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:03.160107 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-47b59eca-7e40-4563-be4e-5a4e1cf16ce1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6476601994bf43ae971336652d210d7f', 'request_id': 'req-47b59eca-7e40-4563-be4e-5a4e1cf16ce1'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:03.160624 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39b42b2-d256-4b2b-a45c-eecb9f0f8d58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b0a3bfbf7dd4989b670486b19813655, user_id=62d1f069438e46f3bafe779b99d19398, role_id=7f53f1c823b746529ba5057bf21b2477)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:03.163379 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39b42b2-d256-4b2b-a45c-eecb9f0f8d58 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:03.166432 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-47b59eca-7e40-4563-be4e-5a4e1cf16ce1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6476601994bf43ae971336652d210d7f', 'request_id': 'req-47b59eca-7e40-4563-be4e-5a4e1cf16ce1'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:03.172822 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-47b59eca-7e40-4563-be4e-5a4e1cf16ce1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6476601994bf43ae971336652d210d7f', 'request_id': 'req-47b59eca-7e40-4563-be4e-5a4e1cf16ce1'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:03.177646 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1382/2758] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:34:03 2022] PUT /identity/v3/projects/8b0a3bfbf7dd4989b670486b19813655/users/62d1f069438e46f3bafe779b99d19398/roles/7f53f1c823b746529ba5057bf21b2477 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:34:03.181676 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b42b2-d256-4b2b-a45c-eecb9f0f8d58 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:03.186068 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-47b59eca-7e40-4563-be4e-5a4e1cf16ce1 admin admin] The token cache is being invalidate because project 6476601994bf43ae971336652d210d7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:34:03.186367 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-47b59eca-7e40-4563-be4e-5a4e1cf16ce1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:03.187037 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-47b59eca-7e40-4563-be4e-5a4e1cf16ce1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:03.188522 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1377/2759] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:34:03 2022] DELETE /identity/v3/projects/6476601994bf43ae971336652d210d7f => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:34:03.192767 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b59eca-7e40-4563-be4e-5a4e1cf16ce1 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:03.194079 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-47b59eca-7e40-4563-be4e-5a4e1cf16ce1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:34:03.246957 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b42b2-d256-4b2b-a45c-eecb9f0f8d58 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:03.251981 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc37844-edda-4156-84a3-923559ac850b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:03.252584 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc37844-edda-4156-84a3-923559ac850b admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:03.252862 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc37844-edda-4156-84a3-923559ac850b admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:03.253133 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc37844-edda-4156-84a3-923559ac850b admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:03.253811 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc37844-edda-4156-84a3-923559ac850b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:03.256021 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc37844-edda-4156-84a3-923559ac850b admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:03.259231 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b59eca-7e40-4563-be4e-5a4e1cf16ce1 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:03.263948 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416164fb-f685-44fd-8a53-1be069fe0c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:03.264572 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416164fb-f685-44fd-8a53-1be069fe0c15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:03.264855 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416164fb-f685-44fd-8a53-1be069fe0c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:03.265130 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416164fb-f685-44fd-8a53-1be069fe0c15 admin admin] PATH_INFO: `/v3/users/8a51dd9983e34a5fb38d3f1771f0036e` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:03.265917 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1383/2760] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:34:03 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 12:34:03.266469 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416164fb-f685-44fd-8a53-1be069fe0c15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a51dd9983e34a5fb38d3f1771f0036e)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:03.268594 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416164fb-f685-44fd-8a53-1be069fe0c15 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:03.270626 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc37844-edda-4156-84a3-923559ac850b admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:03.272345 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-fdc37844-edda-4156-84a3-923559ac850b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:34:03.285167 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc37844-edda-4156-84a3-923559ac850b admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:03.289919 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922393cc-bd84-4301-9ae3-121a5821a7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:03.290565 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922393cc-bd84-4301-9ae3-121a5821a7bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:03.290877 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922393cc-bd84-4301-9ae3-121a5821a7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:03.291156 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922393cc-bd84-4301-9ae3-121a5821a7bc admin admin] PATH_INFO: `/v3/projects/8b0a3bfbf7dd4989b670486b19813655/users/62d1f069438e46f3bafe779b99d19398/roles/7f53f1c823b746529ba5057bf21b2477` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:03.293380 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922393cc-bd84-4301-9ae3-121a5821a7bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b0a3bfbf7dd4989b670486b19813655, user_id=62d1f069438e46f3bafe779b99d19398, role_id=7f53f1c823b746529ba5057bf21b2477)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:03.296465 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922393cc-bd84-4301-9ae3-121a5821a7bc admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:03.307820 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1384/2761] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:34:03 2022] PUT /identity/v3/projects/8b0a3bfbf7dd4989b670486b19813655/users/62d1f069438e46f3bafe779b99d19398/roles/7f53f1c823b746529ba5057bf21b2477 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:34:03.317202 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-416164fb-f685-44fd-8a53-1be069fe0c15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a51dd9983e34a5fb38d3f1771f0036e'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:03.318328 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21b98ba-a6fc-425c-9339-58b9d79d882c None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:03.318594 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21b98ba-a6fc-425c-9339-58b9d79d882c None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:03.318896 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21b98ba-a6fc-425c-9339-58b9d79d882c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:03.326748 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-416164fb-f685-44fd-8a53-1be069fe0c15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a51dd9983e34a5fb38d3f1771f0036e'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:03.327653 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-416164fb-f685-44fd-8a53-1be069fe0c15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a51dd9983e34a5fb38d3f1771f0036e'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:03.329116 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-416164fb-f685-44fd-8a53-1be069fe0c15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a51dd9983e34a5fb38d3f1771f0036e'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:03.337067 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-416164fb-f685-44fd-8a53-1be069fe0c15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a51dd9983e34a5fb38d3f1771f0036e'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:03.348723 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-f21b98ba-a6fc-425c-9339-58b9d79d882c None None] MFA Rules not processed for user `62d1f069438e46f3bafe779b99d19398`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:34:03.349942 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-f21b98ba-a6fc-425c-9339-58b9d79d882c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:34:03.355986 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1378/2762] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:34:03 2022] DELETE /identity/v3/users/8a51dd9983e34a5fb38d3f1771f0036e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:34:03.404490 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:34:03.425194 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1385/2763] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:34:03 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:34:03.437984 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416164fb-f685-44fd-8a53-1be069fe0c15 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:03.439485 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-416164fb-f685-44fd-8a53-1be069fe0c15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:34:03.446636 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:34:03.503478 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416164fb-f685-44fd-8a53-1be069fe0c15 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:03.507560 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee08d98-7e87-4f46-96c0-dda652dbfaae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceafc5e4283841528053f01931f10293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:03.508583 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee08d98-7e87-4f46-96c0-dda652dbfaae service cinder] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:03.509026 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee08d98-7e87-4f46-96c0-dda652dbfaae service cinder] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:03.509453 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee08d98-7e87-4f46-96c0-dda652dbfaae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:03.576035 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee08d98-7e87-4f46-96c0-dda652dbfaae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:03.577475 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee08d98-7e87-4f46-96c0-dda652dbfaae service cinder] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:03.587936 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1379/2764] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:34:03 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:34:03.630442 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21b98ba-a6fc-425c-9339-58b9d79d882c None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:03.631904 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-f21b98ba-a6fc-425c-9339-58b9d79d882c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:34:03.637076 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee08d98-7e87-4f46-96c0-dda652dbfaae service cinder] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:03.638560 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-7ee08d98-7e87-4f46-96c0-dda652dbfaae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:34:03.698422 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21b98ba-a6fc-425c-9339-58b9d79d882c None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:03.701995 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa0dcab-cf2b-4e15-a817-ed1442e0311a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceafc5e4283841528053f01931f10293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:03.702639 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa0dcab-cf2b-4e15-a817-ed1442e0311a service cinder] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:03.702941 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa0dcab-cf2b-4e15-a817-ed1442e0311a service cinder] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:03.703206 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa0dcab-cf2b-4e15-a817-ed1442e0311a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:03.704878 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-2aa0dcab-cf2b-4e15-a817-ed1442e0311a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:34:03.709927 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee08d98-7e87-4f46-96c0-dda652dbfaae service cinder] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:03.714950 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfc789c-39d9-4a7d-aa55-738ffdb3db66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:03.715575 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc789c-39d9-4a7d-aa55-738ffdb3db66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:03.715880 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc789c-39d9-4a7d-aa55-738ffdb3db66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:03.716151 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc789c-39d9-4a7d-aa55-738ffdb3db66 admin admin] PATH_INFO: `/v3/projects/2f1a4e956ae54d998785b1d56d490bf2` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:03.717277 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfc789c-39d9-4a7d-aa55-738ffdb3db66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f1a4e956ae54d998785b1d56d490bf2)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:03.719210 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfc789c-39d9-4a7d-aa55-738ffdb3db66 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:03.773785 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-4cfc789c-39d9-4a7d-aa55-738ffdb3db66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f1a4e956ae54d998785b1d56d490bf2', 'request_id': 'req-4cfc789c-39d9-4a7d-aa55-738ffdb3db66'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:03.776745 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa0dcab-cf2b-4e15-a817-ed1442e0311a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:03.778229 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa0dcab-cf2b-4e15-a817-ed1442e0311a service cinder] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:03.781168 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-4cfc789c-39d9-4a7d-aa55-738ffdb3db66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f1a4e956ae54d998785b1d56d490bf2', 'request_id': 'req-4cfc789c-39d9-4a7d-aa55-738ffdb3db66'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:03.784210 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:34:03.788933 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-4cfc789c-39d9-4a7d-aa55-738ffdb3db66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f1a4e956ae54d998785b1d56d490bf2', 'request_id': 'req-4cfc789c-39d9-4a7d-aa55-738ffdb3db66'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:03.789822 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1386/2765] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:34:03 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:34:03.805964 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-4cfc789c-39d9-4a7d-aa55-738ffdb3db66 admin admin] The token cache is being invalidate because project 2f1a4e956ae54d998785b1d56d490bf2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:34:03.805964 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-4cfc789c-39d9-4a7d-aa55-738ffdb3db66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:03.805964 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-4cfc789c-39d9-4a7d-aa55-738ffdb3db66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:03.808627 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1380/2766] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:34:03 2022] DELETE /identity/v3/projects/2f1a4e956ae54d998785b1d56d490bf2 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:34:03.811555 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa0dcab-cf2b-4e15-a817-ed1442e0311a service cinder] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:03.825035 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa0dcab-cf2b-4e15-a817-ed1442e0311a service cinder] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:03.903086 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d5951c-6f24-4b4a-bea0-f1ac3304d8db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:03.903727 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d5951c-6f24-4b4a-bea0-f1ac3304d8db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:03.904007 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d5951c-6f24-4b4a-bea0-f1ac3304d8db admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:03.904282 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d5951c-6f24-4b4a-bea0-f1ac3304d8db admin admin] PATH_INFO: `/v3/users/622dba532f0a422cb726718c4e9a69b1` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:03.905423 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d5951c-6f24-4b4a-bea0-f1ac3304d8db admin admin] RBAC: Authorizing `identity:delete_user(user_id=622dba532f0a422cb726718c4e9a69b1)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:03.907492 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d5951c-6f24-4b4a-bea0-f1ac3304d8db admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:03.971406 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:34:03.978851 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-52d5951c-6f24-4b4a-bea0-f1ac3304d8db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '622dba532f0a422cb726718c4e9a69b1'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:03.985356 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-52d5951c-6f24-4b4a-bea0-f1ac3304d8db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '622dba532f0a422cb726718c4e9a69b1'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:03.986341 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-52d5951c-6f24-4b4a-bea0-f1ac3304d8db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '622dba532f0a422cb726718c4e9a69b1'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:03.987350 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-52d5951c-6f24-4b4a-bea0-f1ac3304d8db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '622dba532f0a422cb726718c4e9a69b1'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:03.995436 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-52d5951c-6f24-4b4a-bea0-f1ac3304d8db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '622dba532f0a422cb726718c4e9a69b1'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:04.014478 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1387/2767] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:34:03 2022] DELETE /identity/v3/users/622dba532f0a422cb726718c4e9a69b1 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:34:04.328844 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfc789c-39d9-4a7d-aa55-738ffdb3db66 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:04.330496 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-4cfc789c-39d9-4a7d-aa55-738ffdb3db66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:34:04.345195 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfc789c-39d9-4a7d-aa55-738ffdb3db66 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:04.402163 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef48eca7-ee99-44b7-aae0-0ac926bbd00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:04.402817 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48eca7-ee99-44b7-aae0-0ac926bbd00a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:04.403091 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48eca7-ee99-44b7-aae0-0ac926bbd00a admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:04.403358 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48eca7-ee99-44b7-aae0-0ac926bbd00a admin admin] PATH_INFO: `/v3/projects/037614cb3f5e4b53965f76729c287eac` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:04.404443 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef48eca7-ee99-44b7-aae0-0ac926bbd00a admin admin] RBAC: Authorizing `identity:delete_project(project_id=037614cb3f5e4b53965f76729c287eac)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:04.406309 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef48eca7-ee99-44b7-aae0-0ac926bbd00a admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:04.452097 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-ef48eca7-ee99-44b7-aae0-0ac926bbd00a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '037614cb3f5e4b53965f76729c287eac', 'request_id': 'req-ef48eca7-ee99-44b7-aae0-0ac926bbd00a'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:04.459097 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-ef48eca7-ee99-44b7-aae0-0ac926bbd00a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '037614cb3f5e4b53965f76729c287eac', 'request_id': 'req-ef48eca7-ee99-44b7-aae0-0ac926bbd00a'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:04.464746 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-ef48eca7-ee99-44b7-aae0-0ac926bbd00a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '037614cb3f5e4b53965f76729c287eac', 'request_id': 'req-ef48eca7-ee99-44b7-aae0-0ac926bbd00a'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:04.477542 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-ef48eca7-ee99-44b7-aae0-0ac926bbd00a admin admin] The token cache is being invalidate because project 037614cb3f5e4b53965f76729c287eac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:34:04.477833 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-ef48eca7-ee99-44b7-aae0-0ac926bbd00a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:04.478457 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-ef48eca7-ee99-44b7-aae0-0ac926bbd00a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:04.479922 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1381/2768] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:34:04 2022] DELETE /identity/v3/projects/037614cb3f5e4b53965f76729c287eac => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:34:04.484809 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d36045-6bc2-44bf-a44f-1eb48ed4b624 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:04.485273 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d36045-6bc2-44bf-a44f-1eb48ed4b624 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:04.485369 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d36045-6bc2-44bf-a44f-1eb48ed4b624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:04.504816 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-64d36045-6bc2-44bf-a44f-1eb48ed4b624 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:34:04.506010 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-64d36045-6bc2-44bf-a44f-1eb48ed4b624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:34:04.563269 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1388/2769] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:34:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:34:04.571920 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d045b2f-f9f7-4891-bd00-8dfdee60ee77 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:04.572376 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d045b2f-f9f7-4891-bd00-8dfdee60ee77 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:04.572492 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d045b2f-f9f7-4891-bd00-8dfdee60ee77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:04.592496 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-8d045b2f-f9f7-4891-bd00-8dfdee60ee77 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:34:04.593706 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-8d045b2f-f9f7-4891-bd00-8dfdee60ee77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:34:04.601446 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1382/2770] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:34:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:34:04.605731 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d36045-6bc2-44bf-a44f-1eb48ed4b624 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:04.615278 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d36045-6bc2-44bf-a44f-1eb48ed4b624 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:04.619764 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209c6e87-0db4-4b6c-a43f-6b99ac10fa82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:04.620357 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c6e87-0db4-4b6c-a43f-6b99ac10fa82 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:04.620631 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c6e87-0db4-4b6c-a43f-6b99ac10fa82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:04.620899 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c6e87-0db4-4b6c-a43f-6b99ac10fa82 admin admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:04.621531 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209c6e87-0db4-4b6c-a43f-6b99ac10fa82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:34:04.621826 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209c6e87-0db4-4b6c-a43f-6b99ac10fa82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:04.623454 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209c6e87-0db4-4b6c-a43f-6b99ac10fa82 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:04.635448 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1389/2771] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 15 12:34:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:34:04.639658 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d045b2f-f9f7-4891-bd00-8dfdee60ee77 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:04.649549 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d045b2f-f9f7-4891-bd00-8dfdee60ee77 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:04.654117 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a29d2be-3742-4aa7-876e-fe2248bdbe19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:04.654730 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a29d2be-3742-4aa7-876e-fe2248bdbe19 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:04.655019 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a29d2be-3742-4aa7-876e-fe2248bdbe19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:04.655292 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a29d2be-3742-4aa7-876e-fe2248bdbe19 admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:04.655919 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a29d2be-3742-4aa7-876e-fe2248bdbe19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:04.657801 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a29d2be-3742-4aa7-876e-fe2248bdbe19 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:04.684422 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1383/2772] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:34:04 2022] POST /identity/v3/projects => generated 365 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:34:04.688666 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209c6e87-0db4-4b6c-a43f-6b99ac10fa82 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:04.699855 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209c6e87-0db4-4b6c-a43f-6b99ac10fa82 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:04.755154 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91ff692-c7eb-4d71-ac59-b335fcdfa39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:04.755715 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ff692-c7eb-4d71-ac59-b335fcdfa39b admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:04.755994 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ff692-c7eb-4d71-ac59-b335fcdfa39b admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:04.756257 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ff692-c7eb-4d71-ac59-b335fcdfa39b admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:04.756886 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91ff692-c7eb-4d71-ac59-b335fcdfa39b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:04.758820 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91ff692-c7eb-4d71-ac59-b335fcdfa39b admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:04.781676 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1390/2773] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:34:04 2022] POST /identity/v3/users => generated 283 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 12:34:04.785704 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a29d2be-3742-4aa7-876e-fe2248bdbe19 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:04.796731 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a29d2be-3742-4aa7-876e-fe2248bdbe19 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:04.801423 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c7e129-47d8-4fda-afce-4269301c6300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:04.802019 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7e129-47d8-4fda-afce-4269301c6300 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:04.802301 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7e129-47d8-4fda-afce-4269301c6300 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:04.802574 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7e129-47d8-4fda-afce-4269301c6300 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:04.803249 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c7e129-47d8-4fda-afce-4269301c6300 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:04.804825 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c7e129-47d8-4fda-afce-4269301c6300 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:04.814780 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1384/2774] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:34:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 12:34:04.819290 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91ff692-c7eb-4d71-ac59-b335fcdfa39b admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:04.829161 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91ff692-c7eb-4d71-ac59-b335fcdfa39b admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:04.834239 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4427c427-d6aa-4be0-b87e-8c543de88582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:04.834866 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4427c427-d6aa-4be0-b87e-8c543de88582 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:04.835161 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4427c427-d6aa-4be0-b87e-8c543de88582 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:04.835417 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4427c427-d6aa-4be0-b87e-8c543de88582 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:04.836056 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4427c427-d6aa-4be0-b87e-8c543de88582 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:04.837634 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4427c427-d6aa-4be0-b87e-8c543de88582 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:04.847933 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1391/2775] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:34:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:34:04.851795 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c7e129-47d8-4fda-afce-4269301c6300 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:04.861968 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c7e129-47d8-4fda-afce-4269301c6300 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:04.866844 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6edc710-9fbe-484c-968b-82ee28ef2bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:04.867483 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6edc710-9fbe-484c-968b-82ee28ef2bce admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:04.867766 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6edc710-9fbe-484c-968b-82ee28ef2bce admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:04.868042 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6edc710-9fbe-484c-968b-82ee28ef2bce admin admin] PATH_INFO: `/v3/projects/6c663c28acec4ded9d6c42f155a85c3f/users/7c321cfad0eb4c0c8d9b7382d5f2cc9d/roles/9371e5bbc55848949eb951a815f817f2` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:04.883323 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6edc710-9fbe-484c-968b-82ee28ef2bce admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c663c28acec4ded9d6c42f155a85c3f, user_id=7c321cfad0eb4c0c8d9b7382d5f2cc9d, role_id=9371e5bbc55848949eb951a815f817f2)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:04.886020 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6edc710-9fbe-484c-968b-82ee28ef2bce admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:04.899432 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1385/2776] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:34:04 2022] PUT /identity/v3/projects/6c663c28acec4ded9d6c42f155a85c3f/users/7c321cfad0eb4c0c8d9b7382d5f2cc9d/roles/9371e5bbc55848949eb951a815f817f2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:34:04.909575 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d913679-1adf-4401-8479-b471b63ae1bb None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:04.909906 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d913679-1adf-4401-8479-b471b63ae1bb None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:04.910180 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d913679-1adf-4401-8479-b471b63ae1bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:04.938237 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-5d913679-1adf-4401-8479-b471b63ae1bb None None] MFA Rules not processed for user `7c321cfad0eb4c0c8d9b7382d5f2cc9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:34:04.939473 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-5d913679-1adf-4401-8479-b471b63ae1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:34:04.957821 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:34:05.011686 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1392/2777] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:34:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:34:05.022635 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6edc710-9fbe-484c-968b-82ee28ef2bce admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:05.024370 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-a6edc710-9fbe-484c-968b-82ee28ef2bce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:34:05.037760 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:34:05.087813 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6edc710-9fbe-484c-968b-82ee28ef2bce admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:05.091627 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07ac9a3-9deb-417f-ac87-d7bf997ca4bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceafc5e4283841528053f01931f10293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:05.092555 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07ac9a3-9deb-417f-ac87-d7bf997ca4bb service cinder] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:05.092831 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07ac9a3-9deb-417f-ac87-d7bf997ca4bb service cinder] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:05.093101 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07ac9a3-9deb-417f-ac87-d7bf997ca4bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:05.097236 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d913679-1adf-4401-8479-b471b63ae1bb None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:05.098809 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-5d913679-1adf-4401-8479-b471b63ae1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:34:05.101734 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07ac9a3-9deb-417f-ac87-d7bf997ca4bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:05.103251 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07ac9a3-9deb-417f-ac87-d7bf997ca4bb service cinder] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:05.112003 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1386/2778] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:34:05 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:34:05.161347 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d913679-1adf-4401-8479-b471b63ae1bb None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:05.165059 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f31cf23-fe92-4edf-b4e2-59f097447fc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:05.165678 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f31cf23-fe92-4edf-b4e2-59f097447fc4 service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:05.167317 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f31cf23-fe92-4edf-b4e2-59f097447fc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:05.167317 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f31cf23-fe92-4edf-b4e2-59f097447fc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:05.168864 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-4f31cf23-fe92-4edf-b4e2-59f097447fc4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:34:05.240438 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f31cf23-fe92-4edf-b4e2-59f097447fc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:05.242001 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f31cf23-fe92-4edf-b4e2-59f097447fc4 service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:05.253364 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1393/2779] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:34:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 12:34:06.843924 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07ac9a3-9deb-417f-ac87-d7bf997ca4bb service cinder] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:06.845902 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-d07ac9a3-9deb-417f-ac87-d7bf997ca4bb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:34:06.862843 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07ac9a3-9deb-417f-ac87-d7bf997ca4bb service cinder] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:06.870576 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6ffc47-81c1-4e47-bbb1-d037c44edc44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:06.870940 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ffc47-81c1-4e47-bbb1-d037c44edc44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:06.871340 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ffc47-81c1-4e47-bbb1-d037c44edc44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:06.871933 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ffc47-81c1-4e47-bbb1-d037c44edc44 admin admin] PATH_INFO: `/v3/users/29d053f8f00740e1a0d9a35f3e955f8e` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:06.873294 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6ffc47-81c1-4e47-bbb1-d037c44edc44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29d053f8f00740e1a0d9a35f3e955f8e)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:06.875820 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6ffc47-81c1-4e47-bbb1-d037c44edc44 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:06.963887 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-4c6ffc47-81c1-4e47-bbb1-d037c44edc44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29d053f8f00740e1a0d9a35f3e955f8e'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:06.978009 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-4c6ffc47-81c1-4e47-bbb1-d037c44edc44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29d053f8f00740e1a0d9a35f3e955f8e'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:06.980046 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-4c6ffc47-81c1-4e47-bbb1-d037c44edc44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29d053f8f00740e1a0d9a35f3e955f8e'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:06.981109 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-4c6ffc47-81c1-4e47-bbb1-d037c44edc44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29d053f8f00740e1a0d9a35f3e955f8e'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:06.990618 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-4c6ffc47-81c1-4e47-bbb1-d037c44edc44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29d053f8f00740e1a0d9a35f3e955f8e'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:07.013342 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1387/2780] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:34:06 2022] DELETE /identity/v3/users/29d053f8f00740e1a0d9a35f3e955f8e => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:34:07.018763 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0057e30-3a28-4cc1-8f22-ad5f54e66be4 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:07.018763 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0057e30-3a28-4cc1-8f22-ad5f54e66be4 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:07.019402 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0057e30-3a28-4cc1-8f22-ad5f54e66be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:07.042626 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-c0057e30-3a28-4cc1-8f22-ad5f54e66be4 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:34:07.044168 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-c0057e30-3a28-4cc1-8f22-ad5f54e66be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:34:07.141904 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1394/2781] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:34:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:34:07.155772 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6ffc47-81c1-4e47-bbb1-d037c44edc44 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:07.155772 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-4c6ffc47-81c1-4e47-bbb1-d037c44edc44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:34:07.237525 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6ffc47-81c1-4e47-bbb1-d037c44edc44 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:07.242098 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bfdf22-e43a-465f-9a3e-567eff41257c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:07.242446 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bfdf22-e43a-465f-9a3e-567eff41257c service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:07.242895 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bfdf22-e43a-465f-9a3e-567eff41257c service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:07.243481 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bfdf22-e43a-465f-9a3e-567eff41257c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:07.255129 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bfdf22-e43a-465f-9a3e-567eff41257c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:07.256822 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bfdf22-e43a-465f-9a3e-567eff41257c service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:07.271667 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1388/2782] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:34:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:34:07.598011 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0057e30-3a28-4cc1-8f22-ad5f54e66be4 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:07.599628 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-c0057e30-3a28-4cc1-8f22-ad5f54e66be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:34:07.613422 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0057e30-3a28-4cc1-8f22-ad5f54e66be4 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:07.619576 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66821072-9d8f-4d9e-bed8-66dd2aebaff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:07.620360 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66821072-9d8f-4d9e-bed8-66dd2aebaff0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:07.620694 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66821072-9d8f-4d9e-bed8-66dd2aebaff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:07.621039 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66821072-9d8f-4d9e-bed8-66dd2aebaff0 admin admin] PATH_INFO: `/v3/projects/e202c9447eb54bb0ab6d945f7d20d46b` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:07.622519 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66821072-9d8f-4d9e-bed8-66dd2aebaff0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e202c9447eb54bb0ab6d945f7d20d46b)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:07.624633 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66821072-9d8f-4d9e-bed8-66dd2aebaff0 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:07.629687 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:34:07.676667 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-66821072-9d8f-4d9e-bed8-66dd2aebaff0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e202c9447eb54bb0ab6d945f7d20d46b', 'request_id': 'req-66821072-9d8f-4d9e-bed8-66dd2aebaff0'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:07.682623 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-66821072-9d8f-4d9e-bed8-66dd2aebaff0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e202c9447eb54bb0ab6d945f7d20d46b', 'request_id': 'req-66821072-9d8f-4d9e-bed8-66dd2aebaff0'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:07.690465 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-66821072-9d8f-4d9e-bed8-66dd2aebaff0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e202c9447eb54bb0ab6d945f7d20d46b', 'request_id': 'req-66821072-9d8f-4d9e-bed8-66dd2aebaff0'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:07.701595 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-66821072-9d8f-4d9e-bed8-66dd2aebaff0 admin admin] The token cache is being invalidate because project e202c9447eb54bb0ab6d945f7d20d46b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:34:07.701879 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-66821072-9d8f-4d9e-bed8-66dd2aebaff0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:07.702509 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-66821072-9d8f-4d9e-bed8-66dd2aebaff0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:07.704099 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1395/2783] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:34:07 2022] DELETE /identity/v3/projects/e202c9447eb54bb0ab6d945f7d20d46b => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:34:07.708612 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bfdf22-e43a-465f-9a3e-567eff41257c service neutron] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:07.718837 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bfdf22-e43a-465f-9a3e-567eff41257c service neutron] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:07.748242 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:34:07.789931 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64719dda-e974-4bd7-8fc5-8f3bd2f331db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:07.790674 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64719dda-e974-4bd7-8fc5-8f3bd2f331db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:07.791089 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64719dda-e974-4bd7-8fc5-8f3bd2f331db admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:07.791428 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64719dda-e974-4bd7-8fc5-8f3bd2f331db admin admin] PATH_INFO: `/v3/users/c4b2d10d878c446789fe5610b90db2fe` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:07.792808 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64719dda-e974-4bd7-8fc5-8f3bd2f331db admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4b2d10d878c446789fe5610b90db2fe)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:07.796670 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64719dda-e974-4bd7-8fc5-8f3bd2f331db admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:07.858813 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-64719dda-e974-4bd7-8fc5-8f3bd2f331db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4b2d10d878c446789fe5610b90db2fe'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:07.871991 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-64719dda-e974-4bd7-8fc5-8f3bd2f331db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4b2d10d878c446789fe5610b90db2fe'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:07.872709 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-64719dda-e974-4bd7-8fc5-8f3bd2f331db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4b2d10d878c446789fe5610b90db2fe'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:07.873321 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-64719dda-e974-4bd7-8fc5-8f3bd2f331db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4b2d10d878c446789fe5610b90db2fe'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:07.883622 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-64719dda-e974-4bd7-8fc5-8f3bd2f331db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4b2d10d878c446789fe5610b90db2fe'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:07.906678 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1389/2784] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:34:07 2022] DELETE /identity/v3/users/c4b2d10d878c446789fe5610b90db2fe => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:34:08.200529 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66821072-9d8f-4d9e-bed8-66dd2aebaff0 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:08.202158 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-66821072-9d8f-4d9e-bed8-66dd2aebaff0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:34:08.241583 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66821072-9d8f-4d9e-bed8-66dd2aebaff0 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:08.331630 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64719dda-e974-4bd7-8fc5-8f3bd2f331db admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:08.333738 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-64719dda-e974-4bd7-8fc5-8f3bd2f331db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:34:08.383941 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4812c1fe-228e-4a1d-9ca7-18574d9361e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:08.384866 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4812c1fe-228e-4a1d-9ca7-18574d9361e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:08.385212 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4812c1fe-228e-4a1d-9ca7-18574d9361e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:08.385550 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4812c1fe-228e-4a1d-9ca7-18574d9361e0 admin admin] PATH_INFO: `/v3/projects/167b44fe330e467fab5ab6d9723522a8` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:08.387581 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4812c1fe-228e-4a1d-9ca7-18574d9361e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=167b44fe330e467fab5ab6d9723522a8)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:08.391982 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4812c1fe-228e-4a1d-9ca7-18574d9361e0 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:08.452828 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64719dda-e974-4bd7-8fc5-8f3bd2f331db admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:08.473890 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-4812c1fe-228e-4a1d-9ca7-18574d9361e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '167b44fe330e467fab5ab6d9723522a8', 'request_id': 'req-4812c1fe-228e-4a1d-9ca7-18574d9361e0'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:08.480289 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-4812c1fe-228e-4a1d-9ca7-18574d9361e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '167b44fe330e467fab5ab6d9723522a8', 'request_id': 'req-4812c1fe-228e-4a1d-9ca7-18574d9361e0'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:08.488133 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-4812c1fe-228e-4a1d-9ca7-18574d9361e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '167b44fe330e467fab5ab6d9723522a8', 'request_id': 'req-4812c1fe-228e-4a1d-9ca7-18574d9361e0'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:08.506303 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-4812c1fe-228e-4a1d-9ca7-18574d9361e0 admin admin] The token cache is being invalidate because project 167b44fe330e467fab5ab6d9723522a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:34:08.507022 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-4812c1fe-228e-4a1d-9ca7-18574d9361e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:08.508166 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-4812c1fe-228e-4a1d-9ca7-18574d9361e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:08.510186 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1396/2785] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:34:08 2022] DELETE /identity/v3/projects/167b44fe330e467fab5ab6d9723522a8 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:34:08.511134 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4812c1fe-228e-4a1d-9ca7-18574d9361e0 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:08.512547 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-4812c1fe-228e-4a1d-9ca7-18574d9361e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:34:08.518072 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:34:08.537771 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061803be-9f7f-452f-b13f-ff1dc6e96b84 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ff8a5ddf1e422ca97f92bd9d4e5fb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:08.538390 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061803be-9f7f-452f-b13f-ff1dc6e96b84 service placement] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:08.538667 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061803be-9f7f-452f-b13f-ff1dc6e96b84 service placement] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:08.538972 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061803be-9f7f-452f-b13f-ff1dc6e96b84 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:08.540737 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-061803be-9f7f-452f-b13f-ff1dc6e96b84 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:34:08.553248 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061803be-9f7f-452f-b13f-ff1dc6e96b84 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:08.555046 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061803be-9f7f-452f-b13f-ff1dc6e96b84 service placement] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:08.558782 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:34:08.568589 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1390/2786] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:34:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 12:34:08.569477 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061803be-9f7f-452f-b13f-ff1dc6e96b84 service placement] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:08.570945 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-061803be-9f7f-452f-b13f-ff1dc6e96b84 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:34:08.608439 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4812c1fe-228e-4a1d-9ca7-18574d9361e0 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:08.617169 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c94370-86aa-4e00-abc8-a069dc02a4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:08.617849 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c94370-86aa-4e00-abc8-a069dc02a4c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:08.618188 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c94370-86aa-4e00-abc8-a069dc02a4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:08.618449 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c94370-86aa-4e00-abc8-a069dc02a4c8 admin admin] PATH_INFO: `/v3/users/2c5895375da54d2e9b51d59de4f98fe7` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:08.619982 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c94370-86aa-4e00-abc8-a069dc02a4c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c5895375da54d2e9b51d59de4f98fe7)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:08.622125 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c94370-86aa-4e00-abc8-a069dc02a4c8 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:08.655122 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061803be-9f7f-452f-b13f-ff1dc6e96b84 service placement] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:08.660982 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d11ffa-97c1-4983-b944-9b788fc3ce7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:08.662007 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d11ffa-97c1-4983-b944-9b788fc3ce7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:08.662361 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d11ffa-97c1-4983-b944-9b788fc3ce7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:08.662630 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d11ffa-97c1-4983-b944-9b788fc3ce7d admin admin] PATH_INFO: `/v3/users/62d1f069438e46f3bafe779b99d19398` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:08.668474 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d11ffa-97c1-4983-b944-9b788fc3ce7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=62d1f069438e46f3bafe779b99d19398)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:08.668474 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d11ffa-97c1-4983-b944-9b788fc3ce7d admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:08.681686 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-13c94370-86aa-4e00-abc8-a069dc02a4c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c5895375da54d2e9b51d59de4f98fe7'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:08.689059 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-13c94370-86aa-4e00-abc8-a069dc02a4c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c5895375da54d2e9b51d59de4f98fe7'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:08.689895 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-13c94370-86aa-4e00-abc8-a069dc02a4c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c5895375da54d2e9b51d59de4f98fe7'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:08.690592 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-13c94370-86aa-4e00-abc8-a069dc02a4c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c5895375da54d2e9b51d59de4f98fe7'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:08.699687 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-13c94370-86aa-4e00-abc8-a069dc02a4c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c5895375da54d2e9b51d59de4f98fe7'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:08.718757 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-50d11ffa-97c1-4983-b944-9b788fc3ce7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62d1f069438e46f3bafe779b99d19398'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:08.719529 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1397/2787] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:34:08 2022] DELETE /identity/v3/users/2c5895375da54d2e9b51d59de4f98fe7 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:34:08.728121 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-50d11ffa-97c1-4983-b944-9b788fc3ce7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62d1f069438e46f3bafe779b99d19398'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:08.728749 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-50d11ffa-97c1-4983-b944-9b788fc3ce7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62d1f069438e46f3bafe779b99d19398'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:08.729371 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-50d11ffa-97c1-4983-b944-9b788fc3ce7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62d1f069438e46f3bafe779b99d19398'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:08.737496 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-50d11ffa-97c1-4983-b944-9b788fc3ce7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62d1f069438e46f3bafe779b99d19398'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:08.764589 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1391/2788] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:34:08 2022] DELETE /identity/v3/users/62d1f069438e46f3bafe779b99d19398 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:34:08.901761 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c94370-86aa-4e00-abc8-a069dc02a4c8 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:08.903303 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-13c94370-86aa-4e00-abc8-a069dc02a4c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:34:08.986216 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c94370-86aa-4e00-abc8-a069dc02a4c8 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:09.032237 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:34:09.047644 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d11ffa-97c1-4983-b944-9b788fc3ce7d admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:09.049169 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-50d11ffa-97c1-4983-b944-9b788fc3ce7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:34:09.051525 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a25744a-57e2-4afd-8df8-3692d55378a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:09.052240 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a25744a-57e2-4afd-8df8-3692d55378a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:09.052560 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a25744a-57e2-4afd-8df8-3692d55378a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:09.053130 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a25744a-57e2-4afd-8df8-3692d55378a8 admin admin] PATH_INFO: `/v3/projects/d012e88554bf4c479f55c6a082e5749b` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:09.054972 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a25744a-57e2-4afd-8df8-3692d55378a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d012e88554bf4c479f55c6a082e5749b)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:09.057297 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a25744a-57e2-4afd-8df8-3692d55378a8 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:09.064240 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d11ffa-97c1-4983-b944-9b788fc3ce7d admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:09.070298 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a9ea1f-ce36-415a-abf5-ffda9cb7c2df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:09.071162 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9ea1f-ce36-415a-abf5-ffda9cb7c2df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:09.071591 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9ea1f-ce36-415a-abf5-ffda9cb7c2df admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:09.072031 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9ea1f-ce36-415a-abf5-ffda9cb7c2df admin admin] PATH_INFO: `/v3/projects/8b0a3bfbf7dd4989b670486b19813655` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:09.073358 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a9ea1f-ce36-415a-abf5-ffda9cb7c2df admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b0a3bfbf7dd4989b670486b19813655)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:09.075438 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a9ea1f-ce36-415a-abf5-ffda9cb7c2df admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:09.113232 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-1a25744a-57e2-4afd-8df8-3692d55378a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd012e88554bf4c479f55c6a082e5749b', 'request_id': 'req-1a25744a-57e2-4afd-8df8-3692d55378a8'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:09.119424 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-1a25744a-57e2-4afd-8df8-3692d55378a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd012e88554bf4c479f55c6a082e5749b', 'request_id': 'req-1a25744a-57e2-4afd-8df8-3692d55378a8'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:09.126554 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-24a9ea1f-ce36-415a-abf5-ffda9cb7c2df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b0a3bfbf7dd4989b670486b19813655', 'request_id': 'req-24a9ea1f-ce36-415a-abf5-ffda9cb7c2df'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:09.127814 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-1a25744a-57e2-4afd-8df8-3692d55378a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd012e88554bf4c479f55c6a082e5749b', 'request_id': 'req-1a25744a-57e2-4afd-8df8-3692d55378a8'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:09.132785 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-24a9ea1f-ce36-415a-abf5-ffda9cb7c2df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b0a3bfbf7dd4989b670486b19813655', 'request_id': 'req-24a9ea1f-ce36-415a-abf5-ffda9cb7c2df'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:09.134087 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:34:09.140071 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-1a25744a-57e2-4afd-8df8-3692d55378a8 admin admin] The token cache is being invalidate because project d012e88554bf4c479f55c6a082e5749b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:34:09.140276 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-1a25744a-57e2-4afd-8df8-3692d55378a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:09.140714 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-24a9ea1f-ce36-415a-abf5-ffda9cb7c2df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b0a3bfbf7dd4989b670486b19813655', 'request_id': 'req-24a9ea1f-ce36-415a-abf5-ffda9cb7c2df'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:09.140917 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-1a25744a-57e2-4afd-8df8-3692d55378a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:09.143012 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1398/2789] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:34:08 2022] DELETE /identity/v3/projects/d012e88554bf4c479f55c6a082e5749b => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:34:09.148182 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00839685-4e08-437e-bdbb-9a4b4c311aef None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:09.148465 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00839685-4e08-437e-bdbb-9a4b4c311aef None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:09.148821 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00839685-4e08-437e-bdbb-9a4b4c311aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:09.154449 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-24a9ea1f-ce36-415a-abf5-ffda9cb7c2df admin admin] The token cache is being invalidate because project 8b0a3bfbf7dd4989b670486b19813655 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:34:09.154772 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-24a9ea1f-ce36-415a-abf5-ffda9cb7c2df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:09.155381 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-24a9ea1f-ce36-415a-abf5-ffda9cb7c2df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:09.156837 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1392/2790] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:34:09 2022] DELETE /identity/v3/projects/8b0a3bfbf7dd4989b670486b19813655 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:34:09.162942 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1537d9e6-2f3b-44a0-9eaa-84bf6933063d None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:09.163216 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1537d9e6-2f3b-44a0-9eaa-84bf6933063d None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:09.163487 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1537d9e6-2f3b-44a0-9eaa-84bf6933063d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:09.170655 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-00839685-4e08-437e-bdbb-9a4b4c311aef None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:34:09.171811 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-00839685-4e08-437e-bdbb-9a4b4c311aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:34:09.183041 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-1537d9e6-2f3b-44a0-9eaa-84bf6933063d None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:34:09.184203 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-1537d9e6-2f3b-44a0-9eaa-84bf6933063d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:34:09.231696 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1399/2791] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:34:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:34:09.240136 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9810100f-ccd1-4fa3-8198-31cf2dd51978 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:09.240423 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9810100f-ccd1-4fa3-8198-31cf2dd51978 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:09.240693 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9810100f-ccd1-4fa3-8198-31cf2dd51978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:09.245232 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1393/2792] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:34:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:34:09.253634 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a866f-9fbe-40b4-b63b-25811ade44bf None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:09.253917 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a866f-9fbe-40b4-b63b-25811ade44bf None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:09.254188 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a866f-9fbe-40b4-b63b-25811ade44bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:09.259949 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-9810100f-ccd1-4fa3-8198-31cf2dd51978 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:34:09.261202 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-9810100f-ccd1-4fa3-8198-31cf2dd51978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:34:09.269084 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1400/2793] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:34:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:34:09.273277 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9810100f-ccd1-4fa3-8198-31cf2dd51978 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:09.276743 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-099a866f-9fbe-40b4-b63b-25811ade44bf None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:34:09.277955 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-099a866f-9fbe-40b4-b63b-25811ade44bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:34:09.282508 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9810100f-ccd1-4fa3-8198-31cf2dd51978 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:09.286408 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1394/2794] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:34:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:34:09.288025 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c56d1d4-e7d2-42bf-a8f1-be9fefeff697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:09.288617 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c56d1d4-e7d2-42bf-a8f1-be9fefeff697 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:09.288899 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c56d1d4-e7d2-42bf-a8f1-be9fefeff697 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:09.289174 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c56d1d4-e7d2-42bf-a8f1-be9fefeff697 admin admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:09.289809 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c56d1d4-e7d2-42bf-a8f1-be9fefeff697 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:34:09.290113 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c56d1d4-e7d2-42bf-a8f1-be9fefeff697 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:09.290573 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099a866f-9fbe-40b4-b63b-25811ade44bf None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:09.291744 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c56d1d4-e7d2-42bf-a8f1-be9fefeff697 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:09.299972 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099a866f-9fbe-40b4-b63b-25811ade44bf None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:09.307644 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1401/2795] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 15 12:34:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:34:09.307805 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edac017c-a6b1-439f-9414-d18d95c607b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:09.307805 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac017c-a6b1-439f-9414-d18d95c607b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:09.307805 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac017c-a6b1-439f-9414-d18d95c607b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:09.307805 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac017c-a6b1-439f-9414-d18d95c607b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:09.308124 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edac017c-a6b1-439f-9414-d18d95c607b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:34:09.308124 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edac017c-a6b1-439f-9414-d18d95c607b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:09.308575 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c56d1d4-e7d2-42bf-a8f1-be9fefeff697 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:09.308882 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edac017c-a6b1-439f-9414-d18d95c607b4 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:09.318536 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c56d1d4-e7d2-42bf-a8f1-be9fefeff697 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:09.322738 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1395/2796] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 15 12:34:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 12:34:09.325225 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edac017c-a6b1-439f-9414-d18d95c607b4 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:09.325579 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631edae6-a380-4581-8514-0460c30970c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:09.326196 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631edae6-a380-4581-8514-0460c30970c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:09.326473 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631edae6-a380-4581-8514-0460c30970c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:09.326923 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631edae6-a380-4581-8514-0460c30970c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:09.327470 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631edae6-a380-4581-8514-0460c30970c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:09.329335 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631edae6-a380-4581-8514-0460c30970c4 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:09.336461 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edac017c-a6b1-439f-9414-d18d95c607b4 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:09.341882 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6138bb35-4f98-47bc-af20-04f67cfa61a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:09.342631 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6138bb35-4f98-47bc-af20-04f67cfa61a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:09.342866 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6138bb35-4f98-47bc-af20-04f67cfa61a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:09.343070 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6138bb35-4f98-47bc-af20-04f67cfa61a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:09.343673 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6138bb35-4f98-47bc-af20-04f67cfa61a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:09.345699 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6138bb35-4f98-47bc-af20-04f67cfa61a0 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:09.362496 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1402/2797] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:34:09 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 12:34:09.367830 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631edae6-a380-4581-8514-0460c30970c4 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:09.379768 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1396/2798] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:34:09 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:34:09.384070 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6138bb35-4f98-47bc-af20-04f67cfa61a0 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:09.415372 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:34:09.443624 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631edae6-a380-4581-8514-0460c30970c4 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:09.448482 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b90748-add3-4b76-85ab-a4b332df8689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:09.449215 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b90748-add3-4b76-85ab-a4b332df8689 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:09.449496 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b90748-add3-4b76-85ab-a4b332df8689 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:09.449822 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b90748-add3-4b76-85ab-a4b332df8689 admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:09.450454 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b90748-add3-4b76-85ab-a4b332df8689 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:09.452374 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6138bb35-4f98-47bc-af20-04f67cfa61a0 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:09.452510 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b90748-add3-4b76-85ab-a4b332df8689 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:09.457701 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda82611-168b-4793-8c66-2f603064472c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:09.458361 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda82611-168b-4793-8c66-2f603064472c admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:09.458604 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda82611-168b-4793-8c66-2f603064472c admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:09.458973 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda82611-168b-4793-8c66-2f603064472c admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:09.463522 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda82611-168b-4793-8c66-2f603064472c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:09.465492 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda82611-168b-4793-8c66-2f603064472c admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:09.482104 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1403/2799] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:34:09 2022] POST /identity/v3/users => generated 287 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:34:09.483441 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b90748-add3-4b76-85ab-a4b332df8689 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:09.493636 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1397/2800] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:34:09 2022] POST /identity/v3/users => generated 293 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:34:09.493885 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b90748-add3-4b76-85ab-a4b332df8689 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:09.494644 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda82611-168b-4793-8c66-2f603064472c admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:09.498773 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35673c8-c309-49d6-87a2-ed21a4385e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:09.499370 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35673c8-c309-49d6-87a2-ed21a4385e1d admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:09.499651 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35673c8-c309-49d6-87a2-ed21a4385e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:09.499924 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35673c8-c309-49d6-87a2-ed21a4385e1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:09.500569 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35673c8-c309-49d6-87a2-ed21a4385e1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:09.502444 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35673c8-c309-49d6-87a2-ed21a4385e1d admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:09.504523 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda82611-168b-4793-8c66-2f603064472c admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:09.509267 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c89683d-9272-4c53-863d-4cb909c4a9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:09.509970 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c89683d-9272-4c53-863d-4cb909c4a9ed admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:09.510254 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c89683d-9272-4c53-863d-4cb909c4a9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:09.510525 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c89683d-9272-4c53-863d-4cb909c4a9ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:09.511188 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c89683d-9272-4c53-863d-4cb909c4a9ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:09.515485 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1404/2801] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:34:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:34:09.515642 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c89683d-9272-4c53-863d-4cb909c4a9ed admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:09.516450 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35673c8-c309-49d6-87a2-ed21a4385e1d admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:09.523464 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1398/2802] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:34:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 12:34:09.527045 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c89683d-9272-4c53-863d-4cb909c4a9ed admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:09.527180 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35673c8-c309-49d6-87a2-ed21a4385e1d admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:09.531782 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb609a-996c-474b-acea-8d96344ad5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:09.532384 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb609a-996c-474b-acea-8d96344ad5d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:09.532666 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb609a-996c-474b-acea-8d96344ad5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:09.532942 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb609a-996c-474b-acea-8d96344ad5d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:09.533578 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afb609a-996c-474b-acea-8d96344ad5d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:09.536812 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afb609a-996c-474b-acea-8d96344ad5d5 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:09.539411 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c89683d-9272-4c53-863d-4cb909c4a9ed admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:09.545267 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a058ef-9af7-4233-80fc-2c09199a433d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:09.545928 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a058ef-9af7-4233-80fc-2c09199a433d admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:09.546277 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a058ef-9af7-4233-80fc-2c09199a433d admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:09.546661 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a058ef-9af7-4233-80fc-2c09199a433d admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:09.547396 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a058ef-9af7-4233-80fc-2c09199a433d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:09.547976 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1405/2803] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:34:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:34:09.552052 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a058ef-9af7-4233-80fc-2c09199a433d admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:09.552231 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb609a-996c-474b-acea-8d96344ad5d5 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:09.563573 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb609a-996c-474b-acea-8d96344ad5d5 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:09.568980 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfba3f87-2f9b-4928-a7e7-e865052fc5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:09.569822 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfba3f87-2f9b-4928-a7e7-e865052fc5de admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:09.569935 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1399/2804] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:34:09 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 12:34:09.570100 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfba3f87-2f9b-4928-a7e7-e865052fc5de admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:09.570432 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfba3f87-2f9b-4928-a7e7-e865052fc5de admin admin] PATH_INFO: `/v3/projects/396938a108674433a881cc0085e0a687/users/90174c5538be45d2a5a223e722df5c33/roles/9371e5bbc55848949eb951a815f817f2` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:09.571211 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a058ef-9af7-4233-80fc-2c09199a433d admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:09.581493 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a058ef-9af7-4233-80fc-2c09199a433d admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:09.586871 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e763044f-f768-44c7-8a63-74bee6736c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:09.587348 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfba3f87-2f9b-4928-a7e7-e865052fc5de admin admin] RBAC: Authorizing `identity:create_grant(project_id=396938a108674433a881cc0085e0a687, user_id=90174c5538be45d2a5a223e722df5c33, role_id=9371e5bbc55848949eb951a815f817f2)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:09.587522 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e763044f-f768-44c7-8a63-74bee6736c6e admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:09.587797 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e763044f-f768-44c7-8a63-74bee6736c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:09.588064 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e763044f-f768-44c7-8a63-74bee6736c6e admin admin] PATH_INFO: `/v3/projects/eb6227235e1743ba993be11589f9305c/users/ffdadeb00f264161815d62ccff1039fe/roles/9371e5bbc55848949eb951a815f817f2` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:09.590027 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfba3f87-2f9b-4928-a7e7-e865052fc5de admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:09.593611 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:DELETE=3,keystone:SELECT=92,keystone:INSERT=5 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:34:09.607218 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1406/2805] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:34:09 2022] PUT /identity/v3/projects/396938a108674433a881cc0085e0a687/users/90174c5538be45d2a5a223e722df5c33/roles/9371e5bbc55848949eb951a815f817f2 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:34:09.611382 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e763044f-f768-44c7-8a63-74bee6736c6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb6227235e1743ba993be11589f9305c, user_id=ffdadeb00f264161815d62ccff1039fe, role_id=9371e5bbc55848949eb951a815f817f2)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:09.614114 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e763044f-f768-44c7-8a63-74bee6736c6e admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:09.618982 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d39232-cee0-4850-9a61-6b908b654c8d None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:09.619421 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d39232-cee0-4850-9a61-6b908b654c8d None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:09.619820 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d39232-cee0-4850-9a61-6b908b654c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:09.628738 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1400/2806] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:34:09 2022] PUT /identity/v3/projects/eb6227235e1743ba993be11589f9305c/users/ffdadeb00f264161815d62ccff1039fe/roles/9371e5bbc55848949eb951a815f817f2 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:34:09.641403 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a13c3c-dd52-44cf-b056-0d6ddfa2c3ce None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:09.642262 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a13c3c-dd52-44cf-b056-0d6ddfa2c3ce None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:09.642787 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a13c3c-dd52-44cf-b056-0d6ddfa2c3ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:09.656577 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-57d39232-cee0-4850-9a61-6b908b654c8d None None] MFA Rules not processed for user `90174c5538be45d2a5a223e722df5c33`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:34:09.658158 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-57d39232-cee0-4850-9a61-6b908b654c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:34:09.675350 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-58a13c3c-dd52-44cf-b056-0d6ddfa2c3ce None None] MFA Rules not processed for user `ffdadeb00f264161815d62ccff1039fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:34:09.677702 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-58a13c3c-dd52-44cf-b056-0d6ddfa2c3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:34:09.732982 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1407/2807] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:34:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:34:09.744866 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d39232-cee0-4850-9a61-6b908b654c8d None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:09.746226 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-57d39232-cee0-4850-9a61-6b908b654c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:34:09.747702 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1401/2808] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:34:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:34:09.752400 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a13c3c-dd52-44cf-b056-0d6ddfa2c3ce None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:09.824004 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a13c3c-dd52-44cf-b056-0d6ddfa2c3ce None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:09.826740 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:34:09.828718 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718876e7-056e-405e-b33a-520e5b716386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:09.829327 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718876e7-056e-405e-b33a-520e5b716386 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:09.829608 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718876e7-056e-405e-b33a-520e5b716386 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:09.829879 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718876e7-056e-405e-b33a-520e5b716386 admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:09.830507 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718876e7-056e-405e-b33a-520e5b716386 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:09.833212 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718876e7-056e-405e-b33a-520e5b716386 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:09.854960 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d39232-cee0-4850-9a61-6b908b654c8d None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:09.860444 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1402/2809] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:34:09 2022] POST /identity/v3/projects => generated 383 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 12:34:09.864193 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3fec9b-3e50-45b0-af19-94065e85f044 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d05c52570474820b4ba0e2cdad5c13f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:09.864418 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718876e7-056e-405e-b33a-520e5b716386 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:09.865321 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3fec9b-3e50-45b0-af19-94065e85f044 service nova] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:09.865613 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3fec9b-3e50-45b0-af19-94065e85f044 service nova] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:09.865891 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3fec9b-3e50-45b0-af19-94065e85f044 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:09.875860 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3fec9b-3e50-45b0-af19-94065e85f044 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:09.878513 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3fec9b-3e50-45b0-af19-94065e85f044 service nova] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:09.888786 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1408/2810] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:34:09 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 12:34:09.933338 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718876e7-056e-405e-b33a-520e5b716386 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:09.937974 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9b7d4f-6f63-4fb9-a38a-45e2179bad91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:09.938572 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b7d4f-6f63-4fb9-a38a-45e2179bad91 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:09.938884 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b7d4f-6f63-4fb9-a38a-45e2179bad91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:09.939158 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b7d4f-6f63-4fb9-a38a-45e2179bad91 admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:09.939781 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9b7d4f-6f63-4fb9-a38a-45e2179bad91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:09.941810 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9b7d4f-6f63-4fb9-a38a-45e2179bad91 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:09.950041 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:34:09.964831 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1403/2811] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:34:09 2022] POST /identity/v3/users => generated 298 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:34:09.968664 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3fec9b-3e50-45b0-af19-94065e85f044 service nova] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:09.983877 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3fec9b-3e50-45b0-af19-94065e85f044 service nova] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:09.989885 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e8cd2e-df72-4593-b1ae-5a6ec942165d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:09.990505 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e8cd2e-df72-4593-b1ae-5a6ec942165d admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:09.990813 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e8cd2e-df72-4593-b1ae-5a6ec942165d admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:09.991085 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e8cd2e-df72-4593-b1ae-5a6ec942165d admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:09.991725 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e8cd2e-df72-4593-b1ae-5a6ec942165d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:09.993320 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e8cd2e-df72-4593-b1ae-5a6ec942165d admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:10.003775 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1409/2812] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:34:09 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:34:10.007905 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9b7d4f-6f63-4fb9-a38a-45e2179bad91 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:10.017719 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9b7d4f-6f63-4fb9-a38a-45e2179bad91 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:10.022375 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53262fbc-717d-4e15-9461-e47532ca65b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:10.023061 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53262fbc-717d-4e15-9461-e47532ca65b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:10.023341 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53262fbc-717d-4e15-9461-e47532ca65b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:10.023613 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53262fbc-717d-4e15-9461-e47532ca65b7 admin admin] PATH_INFO: `/v3/projects/0f85d3611c06474580d5fb4fece77b33/users/8187970402de4cb2909fa835f8c86e2b/roles/7f53f1c823b746529ba5057bf21b2477` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:10.039075 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53262fbc-717d-4e15-9461-e47532ca65b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f85d3611c06474580d5fb4fece77b33, user_id=8187970402de4cb2909fa835f8c86e2b, role_id=7f53f1c823b746529ba5057bf21b2477)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:10.041714 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53262fbc-717d-4e15-9461-e47532ca65b7 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:10.056700 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1404/2813] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:34:10 2022] PUT /identity/v3/projects/0f85d3611c06474580d5fb4fece77b33/users/8187970402de4cb2909fa835f8c86e2b/roles/7f53f1c823b746529ba5057bf21b2477 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:34:10.060943 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e8cd2e-df72-4593-b1ae-5a6ec942165d admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:10.072121 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e8cd2e-df72-4593-b1ae-5a6ec942165d admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:10.134263 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5317a411-1427-4717-99bd-dbcf00319c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:10.134912 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317a411-1427-4717-99bd-dbcf00319c4b admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:10.135194 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317a411-1427-4717-99bd-dbcf00319c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:10.135488 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317a411-1427-4717-99bd-dbcf00319c4b admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:10.136139 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5317a411-1427-4717-99bd-dbcf00319c4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:10.137738 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5317a411-1427-4717-99bd-dbcf00319c4b admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:10.152267 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1410/2814] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:34:10 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:34:10.153579 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53262fbc-717d-4e15-9461-e47532ca65b7 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:10.168172 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53262fbc-717d-4e15-9461-e47532ca65b7 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:10.173548 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa72dad-2d10-4b85-a0b5-2a5d1ceabd15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:10.174210 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa72dad-2d10-4b85-a0b5-2a5d1ceabd15 admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:10.174493 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa72dad-2d10-4b85-a0b5-2a5d1ceabd15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:10.174813 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa72dad-2d10-4b85-a0b5-2a5d1ceabd15 admin admin] PATH_INFO: `/v3/projects/0f85d3611c06474580d5fb4fece77b33/users/8187970402de4cb2909fa835f8c86e2b/roles/7f53f1c823b746529ba5057bf21b2477` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:10.176775 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa72dad-2d10-4b85-a0b5-2a5d1ceabd15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f85d3611c06474580d5fb4fece77b33, user_id=8187970402de4cb2909fa835f8c86e2b, role_id=7f53f1c823b746529ba5057bf21b2477)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:10.179434 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa72dad-2d10-4b85-a0b5-2a5d1ceabd15 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:10.191083 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1405/2815] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:34:10 2022] PUT /identity/v3/projects/0f85d3611c06474580d5fb4fece77b33/users/8187970402de4cb2909fa835f8c86e2b/roles/7f53f1c823b746529ba5057bf21b2477 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 12:34:10.201228 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f52d6-ce81-419c-bdc4-f97fd86fd001 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:10.201519 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f52d6-ce81-419c-bdc4-f97fd86fd001 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:10.201796 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f52d6-ce81-419c-bdc4-f97fd86fd001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:10.236752 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-f70f52d6-ce81-419c-bdc4-f97fd86fd001 None None] MFA Rules not processed for user `8187970402de4cb2909fa835f8c86e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:34:10.238129 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-f70f52d6-ce81-419c-bdc4-f97fd86fd001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:34:10.312340 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1411/2816] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:34:10 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:34:10.323280 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa72dad-2d10-4b85-a0b5-2a5d1ceabd15 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:10.324971 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-baa72dad-2d10-4b85-a0b5-2a5d1ceabd15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:34:10.388050 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa72dad-2d10-4b85-a0b5-2a5d1ceabd15 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:10.391696 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b410a1-6935-4e95-912c-6c8563c31824 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceafc5e4283841528053f01931f10293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:10.392215 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b410a1-6935-4e95-912c-6c8563c31824 service cinder] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:10.392491 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b410a1-6935-4e95-912c-6c8563c31824 service cinder] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:10.392758 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b410a1-6935-4e95-912c-6c8563c31824 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:10.447907 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b410a1-6935-4e95-912c-6c8563c31824 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:10.449342 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b410a1-6935-4e95-912c-6c8563c31824 service cinder] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:10.458582 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1406/2817] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:34:10 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:34:12.582513 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70f52d6-ce81-419c-bdc4-f97fd86fd001 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:12.628401 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:34:12.646381 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70f52d6-ce81-419c-bdc4-f97fd86fd001 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:12.650867 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24ece2b-4dde-481a-9498-94d7f0dbc7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:12.651491 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24ece2b-4dde-481a-9498-94d7f0dbc7a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:12.651764 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24ece2b-4dde-481a-9498-94d7f0dbc7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:12.652031 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24ece2b-4dde-481a-9498-94d7f0dbc7a0 admin admin] PATH_INFO: `/v3/users/90174c5538be45d2a5a223e722df5c33` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:12.653127 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24ece2b-4dde-481a-9498-94d7f0dbc7a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90174c5538be45d2a5a223e722df5c33)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:12.655054 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24ece2b-4dde-481a-9498-94d7f0dbc7a0 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:12.701100 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-b24ece2b-4dde-481a-9498-94d7f0dbc7a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90174c5538be45d2a5a223e722df5c33'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:12.709245 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-b24ece2b-4dde-481a-9498-94d7f0dbc7a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90174c5538be45d2a5a223e722df5c33'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:12.709902 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-b24ece2b-4dde-481a-9498-94d7f0dbc7a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90174c5538be45d2a5a223e722df5c33'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:12.710519 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-b24ece2b-4dde-481a-9498-94d7f0dbc7a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90174c5538be45d2a5a223e722df5c33'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:12.717637 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-b24ece2b-4dde-481a-9498-94d7f0dbc7a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90174c5538be45d2a5a223e722df5c33'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:12.735253 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1412/2818] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:34:12 2022] DELETE /identity/v3/users/90174c5538be45d2a5a223e722df5c33 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:34:12.739787 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f754d2-2410-457e-a5ea-d5e8b15fb64b None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:12.740260 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f754d2-2410-457e-a5ea-d5e8b15fb64b None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:12.740384 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f754d2-2410-457e-a5ea-d5e8b15fb64b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:12.761033 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-70f754d2-2410-457e-a5ea-d5e8b15fb64b None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:34:12.762322 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-70f754d2-2410-457e-a5ea-d5e8b15fb64b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:34:12.825168 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1407/2819] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:34:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:34:12.835507 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24ece2b-4dde-481a-9498-94d7f0dbc7a0 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:12.836918 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-b24ece2b-4dde-481a-9498-94d7f0dbc7a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:34:12.895600 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24ece2b-4dde-481a-9498-94d7f0dbc7a0 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:12.899842 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c214141a-76ed-4843-a61b-87dcdedb2096 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:12.900446 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214141a-76ed-4843-a61b-87dcdedb2096 service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:12.900722 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214141a-76ed-4843-a61b-87dcdedb2096 service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:12.900992 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214141a-76ed-4843-a61b-87dcdedb2096 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:12.913901 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c214141a-76ed-4843-a61b-87dcdedb2096 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:12.915379 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c214141a-76ed-4843-a61b-87dcdedb2096 service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:12.925242 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1413/2820] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:34:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:34:13.194670 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f754d2-2410-457e-a5ea-d5e8b15fb64b None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:13.196137 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-70f754d2-2410-457e-a5ea-d5e8b15fb64b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:34:13.207774 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f754d2-2410-457e-a5ea-d5e8b15fb64b None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:13.213406 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4017053-6008-48dd-ae79-bf052cf0ea00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:13.213996 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4017053-6008-48dd-ae79-bf052cf0ea00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:13.214239 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4017053-6008-48dd-ae79-bf052cf0ea00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:13.214511 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4017053-6008-48dd-ae79-bf052cf0ea00 admin admin] PATH_INFO: `/v3/projects/396938a108674433a881cc0085e0a687` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:13.215718 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4017053-6008-48dd-ae79-bf052cf0ea00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=396938a108674433a881cc0085e0a687)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:13.217648 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4017053-6008-48dd-ae79-bf052cf0ea00 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:13.219588 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:34:13.273591 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-a4017053-6008-48dd-ae79-bf052cf0ea00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '396938a108674433a881cc0085e0a687', 'request_id': 'req-a4017053-6008-48dd-ae79-bf052cf0ea00'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:13.280641 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-a4017053-6008-48dd-ae79-bf052cf0ea00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '396938a108674433a881cc0085e0a687', 'request_id': 'req-a4017053-6008-48dd-ae79-bf052cf0ea00'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:13.290257 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-a4017053-6008-48dd-ae79-bf052cf0ea00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '396938a108674433a881cc0085e0a687', 'request_id': 'req-a4017053-6008-48dd-ae79-bf052cf0ea00'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:13.305455 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-a4017053-6008-48dd-ae79-bf052cf0ea00 admin admin] The token cache is being invalidate because project 396938a108674433a881cc0085e0a687 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:34:13.305655 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-a4017053-6008-48dd-ae79-bf052cf0ea00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:13.306275 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-a4017053-6008-48dd-ae79-bf052cf0ea00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:13.307893 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1408/2821] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:34:13 2022] DELETE /identity/v3/projects/396938a108674433a881cc0085e0a687 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:34:13.312767 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5305f6ee-b52e-4021-b358-20742c35de0c None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:13.313098 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5305f6ee-b52e-4021-b358-20742c35de0c None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:13.313395 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5305f6ee-b52e-4021-b358-20742c35de0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:13.333266 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-5305f6ee-b52e-4021-b358-20742c35de0c None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:34:13.335062 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-5305f6ee-b52e-4021-b358-20742c35de0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:34:13.401192 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1414/2822] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:34:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:34:13.408987 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faddde54-d726-4d0f-8f57-9832e1811873 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:13.409272 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faddde54-d726-4d0f-8f57-9832e1811873 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:13.409544 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faddde54-d726-4d0f-8f57-9832e1811873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:13.433017 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-faddde54-d726-4d0f-8f57-9832e1811873 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:34:13.434471 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-faddde54-d726-4d0f-8f57-9832e1811873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:34:13.442316 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1409/2823] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:34:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:34:13.446522 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5305f6ee-b52e-4021-b358-20742c35de0c None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:13.456724 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5305f6ee-b52e-4021-b358-20742c35de0c None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:13.462839 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6556564d-b65b-4f62-a0d5-e8b891fd6d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:13.463867 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6556564d-b65b-4f62-a0d5-e8b891fd6d7a admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:13.464533 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6556564d-b65b-4f62-a0d5-e8b891fd6d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:13.464817 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6556564d-b65b-4f62-a0d5-e8b891fd6d7a admin admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:13.465468 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6556564d-b65b-4f62-a0d5-e8b891fd6d7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:34:13.466812 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6556564d-b65b-4f62-a0d5-e8b891fd6d7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:13.468482 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6556564d-b65b-4f62-a0d5-e8b891fd6d7a admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:13.471585 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:34:13.486901 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1415/2824] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 15 12:34:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:34:13.491151 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faddde54-d726-4d0f-8f57-9832e1811873 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:13.507154 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faddde54-d726-4d0f-8f57-9832e1811873 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:13.512294 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6b90d6-a765-4d02-b1e7-04650605dd4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:13.513465 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b90d6-a765-4d02-b1e7-04650605dd4c admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:13.513752 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b90d6-a765-4d02-b1e7-04650605dd4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:13.514027 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b90d6-a765-4d02-b1e7-04650605dd4c admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:13.514662 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6b90d6-a765-4d02-b1e7-04650605dd4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:13.517386 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6b90d6-a765-4d02-b1e7-04650605dd4c admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:13.556437 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1410/2825] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:34:13 2022] POST /identity/v3/projects => generated 357 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 12:34:13.574397 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6556564d-b65b-4f62-a0d5-e8b891fd6d7a admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:13.603555 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6556564d-b65b-4f62-a0d5-e8b891fd6d7a admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:13.697490 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0c29e2-acaa-4b37-a745-fa2ca0099bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:13.698298 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c29e2-acaa-4b37-a745-fa2ca0099bba admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:13.698567 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c29e2-acaa-4b37-a745-fa2ca0099bba admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:13.698899 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c29e2-acaa-4b37-a745-fa2ca0099bba admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:13.699526 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0c29e2-acaa-4b37-a745-fa2ca0099bba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:13.701418 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0c29e2-acaa-4b37-a745-fa2ca0099bba admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:13.726634 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1416/2826] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:34:13 2022] POST /identity/v3/users => generated 279 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:34:13.727820 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6b90d6-a765-4d02-b1e7-04650605dd4c admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:13.738063 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6b90d6-a765-4d02-b1e7-04650605dd4c admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:13.743237 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5624c1-53d6-4e40-8496-a6037e833b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:13.743856 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5624c1-53d6-4e40-8496-a6037e833b25 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:13.744114 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5624c1-53d6-4e40-8496-a6037e833b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:13.744383 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5624c1-53d6-4e40-8496-a6037e833b25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:13.745018 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5624c1-53d6-4e40-8496-a6037e833b25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:13.746730 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5624c1-53d6-4e40-8496-a6037e833b25 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:13.757924 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1411/2827] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:34:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:34:13.762471 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0c29e2-acaa-4b37-a745-fa2ca0099bba admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:13.773507 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0c29e2-acaa-4b37-a745-fa2ca0099bba admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:13.778189 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09174a01-e59b-4d53-aecc-55e16dc6938e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:13.778822 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09174a01-e59b-4d53-aecc-55e16dc6938e admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:13.779097 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09174a01-e59b-4d53-aecc-55e16dc6938e admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:13.779395 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09174a01-e59b-4d53-aecc-55e16dc6938e admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:13.780037 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09174a01-e59b-4d53-aecc-55e16dc6938e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:13.781622 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09174a01-e59b-4d53-aecc-55e16dc6938e admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:13.794720 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1417/2828] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:34:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:34:13.797117 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5624c1-53d6-4e40-8496-a6037e833b25 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:13.807141 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5624c1-53d6-4e40-8496-a6037e833b25 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:13.811832 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bd9c14-8f9e-4520-a7df-7acd7c57f0a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:13.812476 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd9c14-8f9e-4520-a7df-7acd7c57f0a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:13.812756 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd9c14-8f9e-4520-a7df-7acd7c57f0a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:13.813027 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd9c14-8f9e-4520-a7df-7acd7c57f0a9 admin admin] PATH_INFO: `/v3/projects/766a67e3f5334031b22598eeae927ee1/users/3ed46ddcae674ae9b6402e8792a5cb9b/roles/9371e5bbc55848949eb951a815f817f2` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:13.833533 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bd9c14-8f9e-4520-a7df-7acd7c57f0a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=766a67e3f5334031b22598eeae927ee1, user_id=3ed46ddcae674ae9b6402e8792a5cb9b, role_id=9371e5bbc55848949eb951a815f817f2)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:13.837377 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bd9c14-8f9e-4520-a7df-7acd7c57f0a9 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:13.852873 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1412/2829] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:34:13 2022] PUT /identity/v3/projects/766a67e3f5334031b22598eeae927ee1/users/3ed46ddcae674ae9b6402e8792a5cb9b/roles/9371e5bbc55848949eb951a815f817f2 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:34:13.863893 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b6b816-f3bd-495d-a46f-2a98c817f5b7 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:13.864203 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b6b816-f3bd-495d-a46f-2a98c817f5b7 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:13.864517 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b6b816-f3bd-495d-a46f-2a98c817f5b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:13.895425 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-c7b6b816-f3bd-495d-a46f-2a98c817f5b7 None None] MFA Rules not processed for user `3ed46ddcae674ae9b6402e8792a5cb9b`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:34:13.896735 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-c7b6b816-f3bd-495d-a46f-2a98c817f5b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:34:13.974732 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1418/2830] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:34:13 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:34:13.979694 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bd9c14-8f9e-4520-a7df-7acd7c57f0a9 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:14.054200 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bd9c14-8f9e-4520-a7df-7acd7c57f0a9 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:14.059187 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fa2a22-3717-4e76-8d5b-19dbc595db95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:14.059793 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa2a22-3717-4e76-8d5b-19dbc595db95 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:14.060121 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa2a22-3717-4e76-8d5b-19dbc595db95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:14.060363 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa2a22-3717-4e76-8d5b-19dbc595db95 admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:14.061071 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fa2a22-3717-4e76-8d5b-19dbc595db95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:14.062992 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fa2a22-3717-4e76-8d5b-19dbc595db95 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:14.093224 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1413/2831] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:34:13 2022] POST /identity/v3/projects => generated 355 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:34:14.094460 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b6b816-f3bd-495d-a46f-2a98c817f5b7 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:14.107489 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b6b816-f3bd-495d-a46f-2a98c817f5b7 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:14.166517 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb0d1fe-91a7-495c-9c7c-b5307138aa3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:14.167071 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb0d1fe-91a7-495c-9c7c-b5307138aa3f admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:14.167361 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb0d1fe-91a7-495c-9c7c-b5307138aa3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:14.167634 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb0d1fe-91a7-495c-9c7c-b5307138aa3f admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:14.168458 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb0d1fe-91a7-495c-9c7c-b5307138aa3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:14.170725 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb0d1fe-91a7-495c-9c7c-b5307138aa3f admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:14.180839 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:34:14.192356 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1419/2832] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:34:14 2022] POST /identity/v3/users => generated 284 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 12:34:14.196421 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fa2a22-3717-4e76-8d5b-19dbc595db95 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:14.206765 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fa2a22-3717-4e76-8d5b-19dbc595db95 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:14.212292 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b43dd1c-97f3-45a7-8016-7f74457168cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:14.213055 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b43dd1c-97f3-45a7-8016-7f74457168cb admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:14.213336 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b43dd1c-97f3-45a7-8016-7f74457168cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:14.213610 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b43dd1c-97f3-45a7-8016-7f74457168cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:14.214251 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b43dd1c-97f3-45a7-8016-7f74457168cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:14.215879 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b43dd1c-97f3-45a7-8016-7f74457168cb admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:14.222394 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:34:14.229918 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1414/2833] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:34:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:34:14.233981 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb0d1fe-91a7-495c-9c7c-b5307138aa3f admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:14.244563 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb0d1fe-91a7-495c-9c7c-b5307138aa3f admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:14.249300 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6db56f-84ec-4d53-a7f8-9c293ade3922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:14.249958 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6db56f-84ec-4d53-a7f8-9c293ade3922 admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:14.250287 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6db56f-84ec-4d53-a7f8-9c293ade3922 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:14.250558 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6db56f-84ec-4d53-a7f8-9c293ade3922 admin admin] PATH_INFO: `/v3/projects/0e5924f82adc491b8760e4ab1139aeed/users/d245f23633894972b90d799e23ff6a60/roles/7f53f1c823b746529ba5057bf21b2477` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:14.268174 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6db56f-84ec-4d53-a7f8-9c293ade3922 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e5924f82adc491b8760e4ab1139aeed, user_id=d245f23633894972b90d799e23ff6a60, role_id=7f53f1c823b746529ba5057bf21b2477)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:14.271756 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6db56f-84ec-4d53-a7f8-9c293ade3922 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:14.286158 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1420/2834] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:34:14 2022] PUT /identity/v3/projects/0e5924f82adc491b8760e4ab1139aeed/users/d245f23633894972b90d799e23ff6a60/roles/7f53f1c823b746529ba5057bf21b2477 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:34:14.290423 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b43dd1c-97f3-45a7-8016-7f74457168cb admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:14.301192 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b43dd1c-97f3-45a7-8016-7f74457168cb admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:14.360361 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09483c67-2df1-4cf6-b6de-d921a22f9b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:14.360967 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09483c67-2df1-4cf6-b6de-d921a22f9b1a admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:14.361254 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09483c67-2df1-4cf6-b6de-d921a22f9b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:14.361537 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09483c67-2df1-4cf6-b6de-d921a22f9b1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:14.362174 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09483c67-2df1-4cf6-b6de-d921a22f9b1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:14.363828 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09483c67-2df1-4cf6-b6de-d921a22f9b1a admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:14.373843 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1415/2835] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:34:14 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:34:14.379019 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6db56f-84ec-4d53-a7f8-9c293ade3922 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:14.391703 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6db56f-84ec-4d53-a7f8-9c293ade3922 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:14.396955 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d99782-8a49-4738-938a-8c1e4f76753c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:14.397647 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d99782-8a49-4738-938a-8c1e4f76753c admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:14.397925 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d99782-8a49-4738-938a-8c1e4f76753c admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:14.398196 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d99782-8a49-4738-938a-8c1e4f76753c admin admin] PATH_INFO: `/v3/projects/0e5924f82adc491b8760e4ab1139aeed/users/d245f23633894972b90d799e23ff6a60/roles/7f53f1c823b746529ba5057bf21b2477` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:14.400197 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d99782-8a49-4738-938a-8c1e4f76753c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e5924f82adc491b8760e4ab1139aeed, user_id=d245f23633894972b90d799e23ff6a60, role_id=7f53f1c823b746529ba5057bf21b2477)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:14.402848 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d99782-8a49-4738-938a-8c1e4f76753c admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:14.413263 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1421/2836] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:34:14 2022] PUT /identity/v3/projects/0e5924f82adc491b8760e4ab1139aeed/users/d245f23633894972b90d799e23ff6a60/roles/7f53f1c823b746529ba5057bf21b2477 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:34:14.425865 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e688d4-c959-49c7-a66e-0fde2fb93ea5 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:14.426086 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e688d4-c959-49c7-a66e-0fde2fb93ea5 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:14.426362 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e688d4-c959-49c7-a66e-0fde2fb93ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:14.455339 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-78e688d4-c959-49c7-a66e-0fde2fb93ea5 None None] MFA Rules not processed for user `d245f23633894972b90d799e23ff6a60`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:34:14.456556 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-78e688d4-c959-49c7-a66e-0fde2fb93ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:34:14.529275 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1416/2837] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:34:14 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:34:14.540901 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d99782-8a49-4738-938a-8c1e4f76753c admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:14.542635 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-12d99782-8a49-4738-938a-8c1e4f76753c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:34:14.605725 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d99782-8a49-4738-938a-8c1e4f76753c admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:14.610520 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40f150e-a711-4558-b9e9-c546ac605769 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceafc5e4283841528053f01931f10293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:14.611175 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f150e-a711-4558-b9e9-c546ac605769 service cinder] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:14.611455 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f150e-a711-4558-b9e9-c546ac605769 service cinder] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:14.611727 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f150e-a711-4558-b9e9-c546ac605769 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:14.623952 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40f150e-a711-4558-b9e9-c546ac605769 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:14.625397 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40f150e-a711-4558-b9e9-c546ac605769 service cinder] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:14.636349 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1422/2838] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:34:14 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:34:14.715158 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e688d4-c959-49c7-a66e-0fde2fb93ea5 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:14.724800 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e688d4-c959-49c7-a66e-0fde2fb93ea5 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:14.728574 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9d4657-03e2-42b7-aa0c-d4adaa798486 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceafc5e4283841528053f01931f10293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:14.728970 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d4657-03e2-42b7-aa0c-d4adaa798486 service cinder] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:14.729250 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d4657-03e2-42b7-aa0c-d4adaa798486 service cinder] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:14.729523 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d4657-03e2-42b7-aa0c-d4adaa798486 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:14.769032 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40f150e-a711-4558-b9e9-c546ac605769 service cinder] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:14.770549 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-f40f150e-a711-4558-b9e9-c546ac605769 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:34:14.781956 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40f150e-a711-4558-b9e9-c546ac605769 service cinder] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:14.785591 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7d79ce-0226-4866-97f9-1a5f602e36ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceafc5e4283841528053f01931f10293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:14.786182 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7d79ce-0226-4866-97f9-1a5f602e36ba service cinder] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:14.786459 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7d79ce-0226-4866-97f9-1a5f602e36ba service cinder] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:14.786782 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7d79ce-0226-4866-97f9-1a5f602e36ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:14.788471 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-eb7d79ce-0226-4866-97f9-1a5f602e36ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:34:14.790295 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9d4657-03e2-42b7-aa0c-d4adaa798486 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:14.791811 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9d4657-03e2-42b7-aa0c-d4adaa798486 service cinder] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:14.800848 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1417/2839] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:34:14 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:34:14.854112 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7d79ce-0226-4866-97f9-1a5f602e36ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:14.855846 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7d79ce-0226-4866-97f9-1a5f602e36ba service cinder] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:14.866499 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1423/2840] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:34:14 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 12:34:19.823176 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9d4657-03e2-42b7-aa0c-d4adaa798486 service cinder] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:19.824596 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-fe9d4657-03e2-42b7-aa0c-d4adaa798486 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:34:19.846466 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:34:19.896509 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9d4657-03e2-42b7-aa0c-d4adaa798486 service cinder] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:19.901029 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee35e14-8b9c-4804-b860-a6e881f042f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:19.901659 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee35e14-8b9c-4804-b860-a6e881f042f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:19.901934 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee35e14-8b9c-4804-b860-a6e881f042f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:19.902205 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee35e14-8b9c-4804-b860-a6e881f042f6 admin admin] PATH_INFO: `/v3/users/ffdadeb00f264161815d62ccff1039fe` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:19.904779 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee35e14-8b9c-4804-b860-a6e881f042f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffdadeb00f264161815d62ccff1039fe)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:19.906706 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee35e14-8b9c-4804-b860-a6e881f042f6 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:19.957271 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-cee35e14-8b9c-4804-b860-a6e881f042f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffdadeb00f264161815d62ccff1039fe'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:19.965055 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-cee35e14-8b9c-4804-b860-a6e881f042f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffdadeb00f264161815d62ccff1039fe'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:19.965685 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-cee35e14-8b9c-4804-b860-a6e881f042f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffdadeb00f264161815d62ccff1039fe'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:19.966355 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-cee35e14-8b9c-4804-b860-a6e881f042f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffdadeb00f264161815d62ccff1039fe'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:19.978116 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-cee35e14-8b9c-4804-b860-a6e881f042f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffdadeb00f264161815d62ccff1039fe'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:19.992111 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1418/2841] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:34:19 2022] DELETE /identity/v3/users/ffdadeb00f264161815d62ccff1039fe => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:34:19.996653 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311968a0-d9b5-4b2d-938a-e5efee468f57 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:19.997154 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311968a0-d9b5-4b2d-938a-e5efee468f57 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:19.997253 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311968a0-d9b5-4b2d-938a-e5efee468f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:20.016202 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-311968a0-d9b5-4b2d-938a-e5efee468f57 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:34:20.017387 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-311968a0-d9b5-4b2d-938a-e5efee468f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:34:20.064513 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:34:20.077638 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1424/2842] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:34:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:34:20.088700 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee35e14-8b9c-4804-b860-a6e881f042f6 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:20.090804 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-cee35e14-8b9c-4804-b860-a6e881f042f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:34:20.154142 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee35e14-8b9c-4804-b860-a6e881f042f6 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:20.157839 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b5d246-3b2a-419a-ae30-8d98d601e68f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:20.158436 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b5d246-3b2a-419a-ae30-8d98d601e68f service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:20.158739 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b5d246-3b2a-419a-ae30-8d98d601e68f service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:20.159012 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b5d246-3b2a-419a-ae30-8d98d601e68f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:20.168756 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b5d246-3b2a-419a-ae30-8d98d601e68f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:20.170158 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b5d246-3b2a-419a-ae30-8d98d601e68f service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:20.179783 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1419/2843] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:34:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:34:20.445923 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311968a0-d9b5-4b2d-938a-e5efee468f57 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:20.447392 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-311968a0-d9b5-4b2d-938a-e5efee468f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:34:20.459993 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311968a0-d9b5-4b2d-938a-e5efee468f57 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:20.471963 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe0c61f-8a44-47c7-b8c6-96aaee63fa1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:20.471963 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe0c61f-8a44-47c7-b8c6-96aaee63fa1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:20.471963 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe0c61f-8a44-47c7-b8c6-96aaee63fa1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:20.471963 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe0c61f-8a44-47c7-b8c6-96aaee63fa1a admin admin] PATH_INFO: `/v3/projects/eb6227235e1743ba993be11589f9305c` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:20.472487 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe0c61f-8a44-47c7-b8c6-96aaee63fa1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb6227235e1743ba993be11589f9305c)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:20.472487 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe0c61f-8a44-47c7-b8c6-96aaee63fa1a admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:20.521541 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-cfe0c61f-8a44-47c7-b8c6-96aaee63fa1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb6227235e1743ba993be11589f9305c', 'request_id': 'req-cfe0c61f-8a44-47c7-b8c6-96aaee63fa1a'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:20.526970 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-cfe0c61f-8a44-47c7-b8c6-96aaee63fa1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb6227235e1743ba993be11589f9305c', 'request_id': 'req-cfe0c61f-8a44-47c7-b8c6-96aaee63fa1a'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:20.533895 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-cfe0c61f-8a44-47c7-b8c6-96aaee63fa1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb6227235e1743ba993be11589f9305c', 'request_id': 'req-cfe0c61f-8a44-47c7-b8c6-96aaee63fa1a'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:20.544760 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-cfe0c61f-8a44-47c7-b8c6-96aaee63fa1a admin admin] The token cache is being invalidate because project eb6227235e1743ba993be11589f9305c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:34:20.545045 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-cfe0c61f-8a44-47c7-b8c6-96aaee63fa1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:20.545662 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-cfe0c61f-8a44-47c7-b8c6-96aaee63fa1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:20.547190 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1425/2844] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:34:20 2022] DELETE /identity/v3/projects/eb6227235e1743ba993be11589f9305c => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:34:20.551196 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b5d246-3b2a-419a-ae30-8d98d601e68f service neutron] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:20.560789 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b5d246-3b2a-419a-ae30-8d98d601e68f service neutron] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:20.600439 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:34:20.618733 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c76e8fc-46f8-460a-b031-fa65179e4874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:20.619354 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76e8fc-46f8-460a-b031-fa65179e4874 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:20.619633 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76e8fc-46f8-460a-b031-fa65179e4874 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:20.619903 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76e8fc-46f8-460a-b031-fa65179e4874 admin admin] PATH_INFO: `/v3/users/8187970402de4cb2909fa835f8c86e2b` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:20.621009 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c76e8fc-46f8-460a-b031-fa65179e4874 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8187970402de4cb2909fa835f8c86e2b)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:20.623010 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c76e8fc-46f8-460a-b031-fa65179e4874 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:20.684140 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-6c76e8fc-46f8-460a-b031-fa65179e4874 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8187970402de4cb2909fa835f8c86e2b'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:20.691276 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-6c76e8fc-46f8-460a-b031-fa65179e4874 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8187970402de4cb2909fa835f8c86e2b'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:20.691973 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-6c76e8fc-46f8-460a-b031-fa65179e4874 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8187970402de4cb2909fa835f8c86e2b'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:20.692574 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-6c76e8fc-46f8-460a-b031-fa65179e4874 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8187970402de4cb2909fa835f8c86e2b'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:20.700210 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-6c76e8fc-46f8-460a-b031-fa65179e4874 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8187970402de4cb2909fa835f8c86e2b'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:20.720479 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1420/2845] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:34:20 2022] DELETE /identity/v3/users/8187970402de4cb2909fa835f8c86e2b => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:34:21.004116 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe0c61f-8a44-47c7-b8c6-96aaee63fa1a admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:21.008983 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-cfe0c61f-8a44-47c7-b8c6-96aaee63fa1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:34:21.035838 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe0c61f-8a44-47c7-b8c6-96aaee63fa1a admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:21.093447 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea92a2fe-d157-4814-90a4-cab6fbb83bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:21.094078 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea92a2fe-d157-4814-90a4-cab6fbb83bb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:21.094353 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea92a2fe-d157-4814-90a4-cab6fbb83bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:21.094625 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea92a2fe-d157-4814-90a4-cab6fbb83bb1 admin admin] PATH_INFO: `/v3/projects/0f85d3611c06474580d5fb4fece77b33` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:21.095752 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea92a2fe-d157-4814-90a4-cab6fbb83bb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f85d3611c06474580d5fb4fece77b33)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:21.097642 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea92a2fe-d157-4814-90a4-cab6fbb83bb1 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:21.144883 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-ea92a2fe-d157-4814-90a4-cab6fbb83bb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f85d3611c06474580d5fb4fece77b33', 'request_id': 'req-ea92a2fe-d157-4814-90a4-cab6fbb83bb1'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:21.150253 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-ea92a2fe-d157-4814-90a4-cab6fbb83bb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f85d3611c06474580d5fb4fece77b33', 'request_id': 'req-ea92a2fe-d157-4814-90a4-cab6fbb83bb1'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:21.157543 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-ea92a2fe-d157-4814-90a4-cab6fbb83bb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f85d3611c06474580d5fb4fece77b33', 'request_id': 'req-ea92a2fe-d157-4814-90a4-cab6fbb83bb1'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:21.168843 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-ea92a2fe-d157-4814-90a4-cab6fbb83bb1 admin admin] The token cache is being invalidate because project 0f85d3611c06474580d5fb4fece77b33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:34:21.169132 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-ea92a2fe-d157-4814-90a4-cab6fbb83bb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:21.169750 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-ea92a2fe-d157-4814-90a4-cab6fbb83bb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:21.171254 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1426/2846] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:34:21 2022] DELETE /identity/v3/projects/0f85d3611c06474580d5fb4fece77b33 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:34:29.749682 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c76e8fc-46f8-460a-b031-fa65179e4874 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:29.751853 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-6c76e8fc-46f8-460a-b031-fa65179e4874 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:34:29.768617 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c76e8fc-46f8-460a-b031-fa65179e4874 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:29.824566 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4275a0f4-3bdf-4d0d-a9e8-63ec01ed45b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:29.825187 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4275a0f4-3bdf-4d0d-a9e8-63ec01ed45b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:29.825469 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4275a0f4-3bdf-4d0d-a9e8-63ec01ed45b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:29.825742 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4275a0f4-3bdf-4d0d-a9e8-63ec01ed45b6 admin admin] PATH_INFO: `/v3/users/3ed46ddcae674ae9b6402e8792a5cb9b` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:29.826898 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4275a0f4-3bdf-4d0d-a9e8-63ec01ed45b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ed46ddcae674ae9b6402e8792a5cb9b)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:29.828800 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4275a0f4-3bdf-4d0d-a9e8-63ec01ed45b6 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:29.875342 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-4275a0f4-3bdf-4d0d-a9e8-63ec01ed45b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ed46ddcae674ae9b6402e8792a5cb9b'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:29.882965 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-4275a0f4-3bdf-4d0d-a9e8-63ec01ed45b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ed46ddcae674ae9b6402e8792a5cb9b'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:29.883588 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-4275a0f4-3bdf-4d0d-a9e8-63ec01ed45b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ed46ddcae674ae9b6402e8792a5cb9b'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:29.884277 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-4275a0f4-3bdf-4d0d-a9e8-63ec01ed45b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ed46ddcae674ae9b6402e8792a5cb9b'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:29.891309 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-4275a0f4-3bdf-4d0d-a9e8-63ec01ed45b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ed46ddcae674ae9b6402e8792a5cb9b'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:29.892394 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:34:29.912281 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1421/2847] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:34:29 2022] DELETE /identity/v3/users/3ed46ddcae674ae9b6402e8792a5cb9b => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:34:29.916945 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e5cb26-fcae-4dd6-9a63-cdc7adfc727d None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:29.917416 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e5cb26-fcae-4dd6-9a63-cdc7adfc727d None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:29.917654 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e5cb26-fcae-4dd6-9a63-cdc7adfc727d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:29.932335 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:34:29.939573 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-a6e5cb26-fcae-4dd6-9a63-cdc7adfc727d None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:34:29.941415 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-a6e5cb26-fcae-4dd6-9a63-cdc7adfc727d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:34:30.000730 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1427/2848] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:34:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:34:30.011310 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4275a0f4-3bdf-4d0d-a9e8-63ec01ed45b6 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:30.012781 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-4275a0f4-3bdf-4d0d-a9e8-63ec01ed45b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:34:30.073896 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4275a0f4-3bdf-4d0d-a9e8-63ec01ed45b6 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:30.077531 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e3568a-3857-40cb-ab80-a3e094efff99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:30.078130 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e3568a-3857-40cb-ab80-a3e094efff99 service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:30.078408 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e3568a-3857-40cb-ab80-a3e094efff99 service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:30.078677 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e3568a-3857-40cb-ab80-a3e094efff99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:30.088277 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e3568a-3857-40cb-ab80-a3e094efff99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:30.089689 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e3568a-3857-40cb-ab80-a3e094efff99 service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:30.099116 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1422/2849] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:34:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:34:30.371615 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e5cb26-fcae-4dd6-9a63-cdc7adfc727d None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:30.373209 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-a6e5cb26-fcae-4dd6-9a63-cdc7adfc727d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:34:30.387831 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e5cb26-fcae-4dd6-9a63-cdc7adfc727d None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:30.392415 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93cfc79-5a8f-4b8b-98bd-22e61d442c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:30.393051 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93cfc79-5a8f-4b8b-98bd-22e61d442c06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:30.393329 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93cfc79-5a8f-4b8b-98bd-22e61d442c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:30.393603 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93cfc79-5a8f-4b8b-98bd-22e61d442c06 admin admin] PATH_INFO: `/v3/projects/766a67e3f5334031b22598eeae927ee1` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:30.394758 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93cfc79-5a8f-4b8b-98bd-22e61d442c06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=766a67e3f5334031b22598eeae927ee1)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:30.397482 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93cfc79-5a8f-4b8b-98bd-22e61d442c06 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:30.444182 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-a93cfc79-5a8f-4b8b-98bd-22e61d442c06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '766a67e3f5334031b22598eeae927ee1', 'request_id': 'req-a93cfc79-5a8f-4b8b-98bd-22e61d442c06'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:30.449635 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-a93cfc79-5a8f-4b8b-98bd-22e61d442c06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '766a67e3f5334031b22598eeae927ee1', 'request_id': 'req-a93cfc79-5a8f-4b8b-98bd-22e61d442c06'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:30.456997 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-a93cfc79-5a8f-4b8b-98bd-22e61d442c06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '766a67e3f5334031b22598eeae927ee1', 'request_id': 'req-a93cfc79-5a8f-4b8b-98bd-22e61d442c06'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:30.468966 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-a93cfc79-5a8f-4b8b-98bd-22e61d442c06 admin admin] The token cache is being invalidate because project 766a67e3f5334031b22598eeae927ee1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:34:30.469350 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-a93cfc79-5a8f-4b8b-98bd-22e61d442c06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:30.469881 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-a93cfc79-5a8f-4b8b-98bd-22e61d442c06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:30.471745 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1428/2850] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:34:30 2022] DELETE /identity/v3/projects/766a67e3f5334031b22598eeae927ee1 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:34:30.476132 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e3568a-3857-40cb-ab80-a3e094efff99 service neutron] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:30.487785 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e3568a-3857-40cb-ab80-a3e094efff99 service neutron] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:30.545951 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4779a1-0359-4d67-bbb3-9b092242cbdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:30.546573 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4779a1-0359-4d67-bbb3-9b092242cbdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:30.546876 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4779a1-0359-4d67-bbb3-9b092242cbdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:30.547152 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4779a1-0359-4d67-bbb3-9b092242cbdb admin admin] PATH_INFO: `/v3/users/d245f23633894972b90d799e23ff6a60` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:30.548295 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4779a1-0359-4d67-bbb3-9b092242cbdb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d245f23633894972b90d799e23ff6a60)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:30.550180 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4779a1-0359-4d67-bbb3-9b092242cbdb admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:30.595162 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-ce4779a1-0359-4d67-bbb3-9b092242cbdb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd245f23633894972b90d799e23ff6a60'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:30.602285 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-ce4779a1-0359-4d67-bbb3-9b092242cbdb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd245f23633894972b90d799e23ff6a60'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:30.602924 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-ce4779a1-0359-4d67-bbb3-9b092242cbdb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd245f23633894972b90d799e23ff6a60'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:30.603530 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-ce4779a1-0359-4d67-bbb3-9b092242cbdb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd245f23633894972b90d799e23ff6a60'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:30.610426 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-ce4779a1-0359-4d67-bbb3-9b092242cbdb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd245f23633894972b90d799e23ff6a60'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:30.629484 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1423/2851] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:34:30 2022] DELETE /identity/v3/users/d245f23633894972b90d799e23ff6a60 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:34:30.905712 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93cfc79-5a8f-4b8b-98bd-22e61d442c06 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:30.907306 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-a93cfc79-5a8f-4b8b-98bd-22e61d442c06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:34:30.922451 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93cfc79-5a8f-4b8b-98bd-22e61d442c06 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:30.981773 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2177d048-2f84-4e45-829e-d51e623c3fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:30.982403 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2177d048-2f84-4e45-829e-d51e623c3fa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:30.982679 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2177d048-2f84-4e45-829e-d51e623c3fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:30.983046 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2177d048-2f84-4e45-829e-d51e623c3fa0 admin admin] PATH_INFO: `/v3/projects/0e5924f82adc491b8760e4ab1139aeed` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:30.984091 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2177d048-2f84-4e45-829e-d51e623c3fa0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e5924f82adc491b8760e4ab1139aeed)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:30.986080 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2177d048-2f84-4e45-829e-d51e623c3fa0 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:31.020511 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:34:31.033228 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-2177d048-2f84-4e45-829e-d51e623c3fa0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e5924f82adc491b8760e4ab1139aeed', 'request_id': 'req-2177d048-2f84-4e45-829e-d51e623c3fa0'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:31.039347 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-2177d048-2f84-4e45-829e-d51e623c3fa0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e5924f82adc491b8760e4ab1139aeed', 'request_id': 'req-2177d048-2f84-4e45-829e-d51e623c3fa0'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:31.047020 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-2177d048-2f84-4e45-829e-d51e623c3fa0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e5924f82adc491b8760e4ab1139aeed', 'request_id': 'req-2177d048-2f84-4e45-829e-d51e623c3fa0'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:31.058707 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-2177d048-2f84-4e45-829e-d51e623c3fa0 admin admin] The token cache is being invalidate because project 0e5924f82adc491b8760e4ab1139aeed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:34:31.059008 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-2177d048-2f84-4e45-829e-d51e623c3fa0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:31.059643 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-2177d048-2f84-4e45-829e-d51e623c3fa0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:31.061102 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1429/2852] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:34:30 2022] DELETE /identity/v3/projects/0e5924f82adc491b8760e4ab1139aeed => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:34:31.067575 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d7c41b-4df2-4372-9051-0751029e47e1 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:31.068042 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d7c41b-4df2-4372-9051-0751029e47e1 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:31.068158 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d7c41b-4df2-4372-9051-0751029e47e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:31.075663 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:34:31.089412 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-61d7c41b-4df2-4372-9051-0751029e47e1 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:34:31.090613 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-61d7c41b-4df2-4372-9051-0751029e47e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:34:31.150840 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1424/2853] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:34:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:34:31.158618 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197bcd1d-4b27-4baf-9225-5330ee393e78 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:31.158935 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197bcd1d-4b27-4baf-9225-5330ee393e78 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:31.159208 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197bcd1d-4b27-4baf-9225-5330ee393e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:31.179045 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-197bcd1d-4b27-4baf-9225-5330ee393e78 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:34:31.180233 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-197bcd1d-4b27-4baf-9225-5330ee393e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:34:31.188126 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1430/2854] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:34:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:34:31.192232 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d7c41b-4df2-4372-9051-0751029e47e1 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:31.201892 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d7c41b-4df2-4372-9051-0751029e47e1 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:31.206436 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a374644-461e-4d02-ae8e-b7191c29be1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:31.207061 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a374644-461e-4d02-ae8e-b7191c29be1b admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:31.207341 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a374644-461e-4d02-ae8e-b7191c29be1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:31.207616 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a374644-461e-4d02-ae8e-b7191c29be1b admin admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:31.208794 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a374644-461e-4d02-ae8e-b7191c29be1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:34:31.209098 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a374644-461e-4d02-ae8e-b7191c29be1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:31.210679 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a374644-461e-4d02-ae8e-b7191c29be1b admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:31.222421 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1425/2855] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 15 12:34:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:34:31.226850 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197bcd1d-4b27-4baf-9225-5330ee393e78 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:31.235943 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197bcd1d-4b27-4baf-9225-5330ee393e78 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:31.240620 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4f8720-2f03-4447-ad08-72669bfb2a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:31.241209 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f8720-2f03-4447-ad08-72669bfb2a54 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:31.241484 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f8720-2f03-4447-ad08-72669bfb2a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:31.241755 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f8720-2f03-4447-ad08-72669bfb2a54 admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:31.242405 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4f8720-2f03-4447-ad08-72669bfb2a54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:31.244355 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4f8720-2f03-4447-ad08-72669bfb2a54 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:31.280562 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1431/2856] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:34:31 2022] POST /identity/v3/projects => generated 369 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:34:31.284810 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a374644-461e-4d02-ae8e-b7191c29be1b admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:31.295387 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a374644-461e-4d02-ae8e-b7191c29be1b admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:31.351155 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ce07ff-173c-4652-b44a-0e2961339bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:31.351758 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ce07ff-173c-4652-b44a-0e2961339bf5 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:31.352038 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ce07ff-173c-4652-b44a-0e2961339bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:31.352308 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ce07ff-173c-4652-b44a-0e2961339bf5 admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:31.352941 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ce07ff-173c-4652-b44a-0e2961339bf5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:31.355011 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ce07ff-173c-4652-b44a-0e2961339bf5 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:31.375801 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1426/2857] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:34:31 2022] POST /identity/v3/users => generated 285 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:34:31.380734 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4f8720-2f03-4447-ad08-72669bfb2a54 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:31.390936 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4f8720-2f03-4447-ad08-72669bfb2a54 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:31.395951 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e779943f-29dd-446e-ab89-564973050181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:31.396552 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e779943f-29dd-446e-ab89-564973050181 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:31.396830 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e779943f-29dd-446e-ab89-564973050181 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:31.397102 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e779943f-29dd-446e-ab89-564973050181 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:31.397745 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e779943f-29dd-446e-ab89-564973050181 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:31.399365 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e779943f-29dd-446e-ab89-564973050181 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:31.412468 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1432/2858] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:34:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:34:31.413652 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ce07ff-173c-4652-b44a-0e2961339bf5 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:31.423683 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ce07ff-173c-4652-b44a-0e2961339bf5 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:31.428878 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57348d54-103b-425a-8a8b-bf56d99a2426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:31.429391 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57348d54-103b-425a-8a8b-bf56d99a2426 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:31.429667 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57348d54-103b-425a-8a8b-bf56d99a2426 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:31.429935 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57348d54-103b-425a-8a8b-bf56d99a2426 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:31.430573 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57348d54-103b-425a-8a8b-bf56d99a2426 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:31.432194 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57348d54-103b-425a-8a8b-bf56d99a2426 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:31.445461 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1427/2859] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:34:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 12:34:31.449285 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e779943f-29dd-446e-ab89-564973050181 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:31.459199 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e779943f-29dd-446e-ab89-564973050181 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:31.463794 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4a10cf-bbde-4090-8675-0b125858c079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:31.464439 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a10cf-bbde-4090-8675-0b125858c079 admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:31.464719 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a10cf-bbde-4090-8675-0b125858c079 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:31.464994 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a10cf-bbde-4090-8675-0b125858c079 admin admin] PATH_INFO: `/v3/projects/6525320a8b744649b6654f6e7d5535c2/users/fa8597319bbe467f8adf3bbf59248c56/roles/9371e5bbc55848949eb951a815f817f2` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:31.480007 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4a10cf-bbde-4090-8675-0b125858c079 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6525320a8b744649b6654f6e7d5535c2, user_id=fa8597319bbe467f8adf3bbf59248c56, role_id=9371e5bbc55848949eb951a815f817f2)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:31.482645 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4a10cf-bbde-4090-8675-0b125858c079 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:31.498273 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1433/2860] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:34:31 2022] PUT /identity/v3/projects/6525320a8b744649b6654f6e7d5535c2/users/fa8597319bbe467f8adf3bbf59248c56/roles/9371e5bbc55848949eb951a815f817f2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:34:31.508781 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2515a88-2a0f-4173-aee3-6c31a17310eb None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:31.509134 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2515a88-2a0f-4173-aee3-6c31a17310eb None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:31.509471 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2515a88-2a0f-4173-aee3-6c31a17310eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:31.538150 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-b2515a88-2a0f-4173-aee3-6c31a17310eb None None] MFA Rules not processed for user `fa8597319bbe467f8adf3bbf59248c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:34:31.539389 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-b2515a88-2a0f-4173-aee3-6c31a17310eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:34:31.598062 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:34:31.605234 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1428/2861] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:34:31 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:34:31.617138 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4a10cf-bbde-4090-8675-0b125858c079 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:31.618877 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-ec4a10cf-bbde-4090-8675-0b125858c079 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:34:31.674882 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4a10cf-bbde-4090-8675-0b125858c079 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:31.679168 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3458458c-38e2-407a-8118-34909ae6b235 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd057b651769b4ae99c1d4f2b0fc31fb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:31.679765 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3458458c-38e2-407a-8118-34909ae6b235 service glance] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:31.680048 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3458458c-38e2-407a-8118-34909ae6b235 service glance] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:31.680322 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3458458c-38e2-407a-8118-34909ae6b235 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:31.688520 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3458458c-38e2-407a-8118-34909ae6b235 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:31.689946 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3458458c-38e2-407a-8118-34909ae6b235 service glance] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:31.698653 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1434/2862] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:34:31 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:34:41.606257 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:34:41.694743 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=69,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:34:41.861839 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2515a88-2a0f-4173-aee3-6c31a17310eb None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:41.863307 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-b2515a88-2a0f-4173-aee3-6c31a17310eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:34:41.929253 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2515a88-2a0f-4173-aee3-6c31a17310eb None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:41.933691 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71020bd1-ec0b-4bac-b894-7548f8ac6cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:41.934318 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71020bd1-ec0b-4bac-b894-7548f8ac6cbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:41.934597 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71020bd1-ec0b-4bac-b894-7548f8ac6cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:41.934901 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71020bd1-ec0b-4bac-b894-7548f8ac6cbe admin admin] PATH_INFO: `/v3/users/7c321cfad0eb4c0c8d9b7382d5f2cc9d` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:41.936013 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71020bd1-ec0b-4bac-b894-7548f8ac6cbe admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c321cfad0eb4c0c8d9b7382d5f2cc9d)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:41.937911 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71020bd1-ec0b-4bac-b894-7548f8ac6cbe admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:41.990041 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-71020bd1-ec0b-4bac-b894-7548f8ac6cbe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c321cfad0eb4c0c8d9b7382d5f2cc9d'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:41.997678 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-71020bd1-ec0b-4bac-b894-7548f8ac6cbe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c321cfad0eb4c0c8d9b7382d5f2cc9d'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:41.998438 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-71020bd1-ec0b-4bac-b894-7548f8ac6cbe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c321cfad0eb4c0c8d9b7382d5f2cc9d'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:41.999156 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-71020bd1-ec0b-4bac-b894-7548f8ac6cbe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c321cfad0eb4c0c8d9b7382d5f2cc9d'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:42.006913 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-71020bd1-ec0b-4bac-b894-7548f8ac6cbe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c321cfad0eb4c0c8d9b7382d5f2cc9d'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:42.023956 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1429/2863] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:34:41 2022] DELETE /identity/v3/users/7c321cfad0eb4c0c8d9b7382d5f2cc9d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:34:42.028429 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e95119-ebcd-4a2f-955d-8bf78810ab52 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:42.028716 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e95119-ebcd-4a2f-955d-8bf78810ab52 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:42.028991 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e95119-ebcd-4a2f-955d-8bf78810ab52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:42.048161 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-42e95119-ebcd-4a2f-955d-8bf78810ab52 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:34:42.049357 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-42e95119-ebcd-4a2f-955d-8bf78810ab52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:34:42.108735 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1435/2864] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:34:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:34:42.119173 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71020bd1-ec0b-4bac-b894-7548f8ac6cbe admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:42.120574 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-71020bd1-ec0b-4bac-b894-7548f8ac6cbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:34:42.177666 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71020bd1-ec0b-4bac-b894-7548f8ac6cbe admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:42.181293 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c460b887-1ca2-4afe-9e23-d923a63a609f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:42.181903 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c460b887-1ca2-4afe-9e23-d923a63a609f service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:42.182182 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c460b887-1ca2-4afe-9e23-d923a63a609f service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:42.182452 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c460b887-1ca2-4afe-9e23-d923a63a609f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:42.192853 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c460b887-1ca2-4afe-9e23-d923a63a609f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:42.194421 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c460b887-1ca2-4afe-9e23-d923a63a609f service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:42.205093 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1430/2865] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:34:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:34:42.483407 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e95119-ebcd-4a2f-955d-8bf78810ab52 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:34:42.484889 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-42e95119-ebcd-4a2f-955d-8bf78810ab52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:34:42.500811 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e95119-ebcd-4a2f-955d-8bf78810ab52 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:34:42.506505 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5fb9e7-59e2-4467-969f-e5cd1f5578d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:34:42.507187 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5fb9e7-59e2-4467-969f-e5cd1f5578d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:34:42.507473 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5fb9e7-59e2-4467-969f-e5cd1f5578d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:34:42.507745 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5fb9e7-59e2-4467-969f-e5cd1f5578d8 admin admin] PATH_INFO: `/v3/projects/6c663c28acec4ded9d6c42f155a85c3f` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:34:42.508987 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5fb9e7-59e2-4467-969f-e5cd1f5578d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c663c28acec4ded9d6c42f155a85c3f)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:34:42.510928 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5fb9e7-59e2-4467-969f-e5cd1f5578d8 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:34:42.560759 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-ec5fb9e7-59e2-4467-969f-e5cd1f5578d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c663c28acec4ded9d6c42f155a85c3f', 'request_id': 'req-ec5fb9e7-59e2-4467-969f-e5cd1f5578d8'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:42.566326 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-ec5fb9e7-59e2-4467-969f-e5cd1f5578d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c663c28acec4ded9d6c42f155a85c3f', 'request_id': 'req-ec5fb9e7-59e2-4467-969f-e5cd1f5578d8'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:42.574751 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-ec5fb9e7-59e2-4467-969f-e5cd1f5578d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c663c28acec4ded9d6c42f155a85c3f', 'request_id': 'req-ec5fb9e7-59e2-4467-969f-e5cd1f5578d8'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:42.586345 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-ec5fb9e7-59e2-4467-969f-e5cd1f5578d8 admin admin] The token cache is being invalidate because project 6c663c28acec4ded9d6c42f155a85c3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:34:42.586633 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-ec5fb9e7-59e2-4467-969f-e5cd1f5578d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:42.587314 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-ec5fb9e7-59e2-4467-969f-e5cd1f5578d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:34:42.588923 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1436/2866] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:34:42 2022] DELETE /identity/v3/projects/6c663c28acec4ded9d6c42f155a85c3f => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:34:52.200187 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:34:52.583296 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:35:00.819250 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c460b887-1ca2-4afe-9e23-d923a63a609f service neutron] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:35:00.820649 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-c460b887-1ca2-4afe-9e23-d923a63a609f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:35:00.833084 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c460b887-1ca2-4afe-9e23-d923a63a609f service neutron] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:35:00.887853 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f26f7ee-9a19-40bb-ad3b-657321e2a224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:35:00.888465 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f26f7ee-9a19-40bb-ad3b-657321e2a224 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:35:00.888745 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f26f7ee-9a19-40bb-ad3b-657321e2a224 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:35:00.889017 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f26f7ee-9a19-40bb-ad3b-657321e2a224 admin admin] PATH_INFO: `/v3/users/fa8597319bbe467f8adf3bbf59248c56` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:35:00.890129 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f26f7ee-9a19-40bb-ad3b-657321e2a224 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa8597319bbe467f8adf3bbf59248c56)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:35:00.892058 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f26f7ee-9a19-40bb-ad3b-657321e2a224 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:35:00.938323 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-1f26f7ee-9a19-40bb-ad3b-657321e2a224 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa8597319bbe467f8adf3bbf59248c56'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:35:00.947753 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-1f26f7ee-9a19-40bb-ad3b-657321e2a224 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa8597319bbe467f8adf3bbf59248c56'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:35:00.948370 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-1f26f7ee-9a19-40bb-ad3b-657321e2a224 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa8597319bbe467f8adf3bbf59248c56'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:35:00.948970 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-1f26f7ee-9a19-40bb-ad3b-657321e2a224 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa8597319bbe467f8adf3bbf59248c56'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:35:00.956072 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-1f26f7ee-9a19-40bb-ad3b-657321e2a224 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa8597319bbe467f8adf3bbf59248c56'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:35:00.976962 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1431/2867] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:35:00 2022] DELETE /identity/v3/users/fa8597319bbe467f8adf3bbf59248c56 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:35:00.978662 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d0c4a-5149-4333-915b-bb96e812a795 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:35:00.979111 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d0c4a-5149-4333-915b-bb96e812a795 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:35:00.979386 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d0c4a-5149-4333-915b-bb96e812a795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:35:00.999323 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-848d0c4a-5149-4333-915b-bb96e812a795 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:35:01.000514 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-848d0c4a-5149-4333-915b-bb96e812a795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:35:01.057893 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1437/2868] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:35:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:35:01.071469 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f26f7ee-9a19-40bb-ad3b-657321e2a224 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:35:01.073264 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-1f26f7ee-9a19-40bb-ad3b-657321e2a224 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:35:01.137573 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f26f7ee-9a19-40bb-ad3b-657321e2a224 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:35:01.141175 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424b858f-e9de-49d2-99e6-c26e3695e0c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:35:01.141776 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424b858f-e9de-49d2-99e6-c26e3695e0c5 service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:35:01.142057 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424b858f-e9de-49d2-99e6-c26e3695e0c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:35:01.142330 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424b858f-e9de-49d2-99e6-c26e3695e0c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:35:01.151817 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424b858f-e9de-49d2-99e6-c26e3695e0c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:35:01.153237 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424b858f-e9de-49d2-99e6-c26e3695e0c5 service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:35:01.163230 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1432/2869] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:35:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:35:01.430805 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848d0c4a-5149-4333-915b-bb96e812a795 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:35:01.432270 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-848d0c4a-5149-4333-915b-bb96e812a795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:35:01.444528 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848d0c4a-5149-4333-915b-bb96e812a795 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:35:01.450972 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e54e9e-6ca9-4b47-a491-a2a8801316b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:35:01.451683 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e54e9e-6ca9-4b47-a491-a2a8801316b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:35:01.452115 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e54e9e-6ca9-4b47-a491-a2a8801316b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:35:01.452479 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e54e9e-6ca9-4b47-a491-a2a8801316b5 admin admin] PATH_INFO: `/v3/projects/6525320a8b744649b6654f6e7d5535c2` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:35:01.453698 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e54e9e-6ca9-4b47-a491-a2a8801316b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6525320a8b744649b6654f6e7d5535c2)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:35:01.456834 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e54e9e-6ca9-4b47-a491-a2a8801316b5 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:35:01.505491 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-69e54e9e-6ca9-4b47-a491-a2a8801316b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6525320a8b744649b6654f6e7d5535c2', 'request_id': 'req-69e54e9e-6ca9-4b47-a491-a2a8801316b5'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:35:01.511095 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-69e54e9e-6ca9-4b47-a491-a2a8801316b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6525320a8b744649b6654f6e7d5535c2', 'request_id': 'req-69e54e9e-6ca9-4b47-a491-a2a8801316b5'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:35:01.518181 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-69e54e9e-6ca9-4b47-a491-a2a8801316b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6525320a8b744649b6654f6e7d5535c2', 'request_id': 'req-69e54e9e-6ca9-4b47-a491-a2a8801316b5'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:35:01.529181 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-69e54e9e-6ca9-4b47-a491-a2a8801316b5 admin admin] The token cache is being invalidate because project 6525320a8b744649b6654f6e7d5535c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81375) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:35:01.529465 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-69e54e9e-6ca9-4b47-a491-a2a8801316b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:35:01.530085 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-69e54e9e-6ca9-4b47-a491-a2a8801316b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:35:01.531590 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1438/2870] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:35:01 2022] DELETE /identity/v3/projects/6525320a8b744649b6654f6e7d5535c2 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:35:01.536900 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5dd5f3-5ebe-4262-89ab-5601490fe189 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:35:01.537185 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5dd5f3-5ebe-4262-89ab-5601490fe189 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:35:01.537460 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5dd5f3-5ebe-4262-89ab-5601490fe189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:35:01.556777 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-9a5dd5f3-5ebe-4262-89ab-5601490fe189 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:35:01.557963 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-9a5dd5f3-5ebe-4262-89ab-5601490fe189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:35:01.574057 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:35:01.616521 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1433/2871] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:35:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:35:01.624227 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e1e23-2ccd-4dad-b5cb-6ebeb31c714d None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:35:01.624540 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e1e23-2ccd-4dad-b5cb-6ebeb31c714d None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:35:01.624810 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e1e23-2ccd-4dad-b5cb-6ebeb31c714d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:35:01.646618 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-8c8e1e23-2ccd-4dad-b5cb-6ebeb31c714d None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:35:01.647916 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-8c8e1e23-2ccd-4dad-b5cb-6ebeb31c714d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:35:01.655692 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1439/2872] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:35:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:35:01.659721 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5dd5f3-5ebe-4262-89ab-5601490fe189 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:35:01.669258 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5dd5f3-5ebe-4262-89ab-5601490fe189 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:35:01.673904 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be7938c-f5c5-40ec-92ce-27e0bc06bc87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:35:01.674497 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be7938c-f5c5-40ec-92ce-27e0bc06bc87 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:35:01.674813 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be7938c-f5c5-40ec-92ce-27e0bc06bc87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:35:01.675087 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be7938c-f5c5-40ec-92ce-27e0bc06bc87 admin admin] PATH_INFO: `/v3/domains` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:35:01.675733 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be7938c-f5c5-40ec-92ce-27e0bc06bc87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81374) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:35:01.676033 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be7938c-f5c5-40ec-92ce-27e0bc06bc87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:35:01.677610 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be7938c-f5c5-40ec-92ce-27e0bc06bc87 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:35:01.689323 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1434/2873] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 15 12:35:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:35:01.693962 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8e1e23-2ccd-4dad-b5cb-6ebeb31c714d None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:35:01.702940 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8e1e23-2ccd-4dad-b5cb-6ebeb31c714d None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:35:01.708108 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d204f2db-d775-4921-8aef-f7149aa55474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:35:01.708646 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d204f2db-d775-4921-8aef-f7149aa55474 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:35:01.708921 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d204f2db-d775-4921-8aef-f7149aa55474 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:35:01.709188 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d204f2db-d775-4921-8aef-f7149aa55474 admin admin] PATH_INFO: `/v3/projects` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:35:01.709816 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d204f2db-d775-4921-8aef-f7149aa55474 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:35:01.711766 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d204f2db-d775-4921-8aef-f7149aa55474 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:35:01.737258 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1440/2874] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:35:01 2022] POST /identity/v3/projects => generated 381 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 12:35:01.741938 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be7938c-f5c5-40ec-92ce-27e0bc06bc87 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:35:01.752004 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be7938c-f5c5-40ec-92ce-27e0bc06bc87 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:35:01.808325 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c097ae9-530e-4a80-818f-9d41d5284d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:35:01.808924 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c097ae9-530e-4a80-818f-9d41d5284d43 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:35:01.809201 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c097ae9-530e-4a80-818f-9d41d5284d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:35:01.809472 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c097ae9-530e-4a80-818f-9d41d5284d43 admin admin] PATH_INFO: `/v3/users` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:35:01.810131 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c097ae9-530e-4a80-818f-9d41d5284d43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:35:01.812057 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c097ae9-530e-4a80-818f-9d41d5284d43 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:35:01.833049 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1435/2875] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:35:01 2022] POST /identity/v3/users => generated 291 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:35:01.836992 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d204f2db-d775-4921-8aef-f7149aa55474 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:35:01.847010 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d204f2db-d775-4921-8aef-f7149aa55474 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:35:01.851585 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c3687-1aaf-4272-9aab-32462406d5ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:35:01.852175 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c3687-1aaf-4272-9aab-32462406d5ab admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:35:01.852448 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c3687-1aaf-4272-9aab-32462406d5ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:35:01.852713 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c3687-1aaf-4272-9aab-32462406d5ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:35:01.853345 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948c3687-1aaf-4272-9aab-32462406d5ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:35:01.854950 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948c3687-1aaf-4272-9aab-32462406d5ab admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:35:01.865577 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1441/2876] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:35:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:35:01.869273 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c097ae9-530e-4a80-818f-9d41d5284d43 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:35:01.880074 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c097ae9-530e-4a80-818f-9d41d5284d43 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:35:01.884750 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1a3c61-44fb-443f-9812-ffeb07f6dcce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:35:01.885334 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a3c61-44fb-443f-9812-ffeb07f6dcce admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:35:01.885617 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a3c61-44fb-443f-9812-ffeb07f6dcce admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:35:01.885890 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a3c61-44fb-443f-9812-ffeb07f6dcce admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:35:01.886526 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1a3c61-44fb-443f-9812-ffeb07f6dcce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:35:01.888248 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1a3c61-44fb-443f-9812-ffeb07f6dcce admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:35:01.899899 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1436/2877] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:35:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 12:35:01.903747 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c3687-1aaf-4272-9aab-32462406d5ab admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:35:01.913532 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c3687-1aaf-4272-9aab-32462406d5ab admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:35:01.918110 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1433a8-1652-416e-9ad2-f8b838ab1397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:35:01.918778 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1433a8-1652-416e-9ad2-f8b838ab1397 admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:35:01.919057 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1433a8-1652-416e-9ad2-f8b838ab1397 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:35:01.919326 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1433a8-1652-416e-9ad2-f8b838ab1397 admin admin] PATH_INFO: `/v3/projects/504f711eb70443a8ae76f959ca58b0a2/users/75bf0cd077294f6e9b390e9e3c853421/roles/9371e5bbc55848949eb951a815f817f2` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:35:01.934016 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1433a8-1652-416e-9ad2-f8b838ab1397 admin admin] RBAC: Authorizing `identity:create_grant(project_id=504f711eb70443a8ae76f959ca58b0a2, user_id=75bf0cd077294f6e9b390e9e3c853421, role_id=9371e5bbc55848949eb951a815f817f2)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:35:01.936678 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1433a8-1652-416e-9ad2-f8b838ab1397 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:35:01.949511 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1442/2878] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:35:01 2022] PUT /identity/v3/projects/504f711eb70443a8ae76f959ca58b0a2/users/75bf0cd077294f6e9b390e9e3c853421/roles/9371e5bbc55848949eb951a815f817f2 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:35:01.954603 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d30fc9-e1f5-4f6f-bbd0-ccf5c3969f4c None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:35:01.954945 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d30fc9-e1f5-4f6f-bbd0-ccf5c3969f4c None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:35:01.955219 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d30fc9-e1f5-4f6f-bbd0-ccf5c3969f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:35:01.974667 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-46d30fc9-e1f5-4f6f-bbd0-ccf5c3969f4c None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:35:01.975911 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-46d30fc9-e1f5-4f6f-bbd0-ccf5c3969f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:35:02.034791 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1437/2879] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:35:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:35:02.044458 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1433a8-1652-416e-9ad2-f8b838ab1397 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:35:02.046142 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-1f1433a8-1652-416e-9ad2-f8b838ab1397 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:35:02.068425 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:35:02.103467 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1433a8-1652-416e-9ad2-f8b838ab1397 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:35:02.107076 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2448abd3-07b7-4c44-b3ee-43c92f53d026 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:35:02.107670 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2448abd3-07b7-4c44-b3ee-43c92f53d026 service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:35:02.107947 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2448abd3-07b7-4c44-b3ee-43c92f53d026 service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:35:02.108219 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2448abd3-07b7-4c44-b3ee-43c92f53d026 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:35:02.117517 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2448abd3-07b7-4c44-b3ee-43c92f53d026 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:35:02.118963 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2448abd3-07b7-4c44-b3ee-43c92f53d026 service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:35:02.128446 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1443/2880] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:35:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:35:02.969632 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0931153-707f-4ee2-9ea7-b57228665918 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:35:02.969632 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0931153-707f-4ee2-9ea7-b57228665918 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:35:02.969632 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0931153-707f-4ee2-9ea7-b57228665918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:35:02.996288 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-a0931153-707f-4ee2-9ea7-b57228665918 None None] MFA Rules not processed for user `75bf0cd077294f6e9b390e9e3c853421`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:35:02.997497 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-a0931153-707f-4ee2-9ea7-b57228665918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:35:03.014543 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:35:03.066623 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1438/2881] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:35:02 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:35:03.077175 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2448abd3-07b7-4c44-b3ee-43c92f53d026 service neutron] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:35:03.078588 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-2448abd3-07b7-4c44-b3ee-43c92f53d026 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:35:03.138257 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2448abd3-07b7-4c44-b3ee-43c92f53d026 service neutron] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:35:03.142060 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9b92fb-759d-46e3-ad44-be24a00e4f37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ceafc5e4283841528053f01931f10293', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:35:03.142668 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b92fb-759d-46e3-ad44-be24a00e4f37 service cinder] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:35:03.142996 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b92fb-759d-46e3-ad44-be24a00e4f37 service cinder] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:35:03.143308 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b92fb-759d-46e3-ad44-be24a00e4f37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:35:03.152798 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9b92fb-759d-46e3-ad44-be24a00e4f37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:35:03.154375 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9b92fb-759d-46e3-ad44-be24a00e4f37 service cinder] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:35:03.164939 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1444/2882] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:35:03 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:35:04.525037 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01424b22-105c-4514-93da-12397be50a34 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:35:04.525559 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01424b22-105c-4514-93da-12397be50a34 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:35:04.525559 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01424b22-105c-4514-93da-12397be50a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:35:04.544054 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-01424b22-105c-4514-93da-12397be50a34 None None] MFA Rules not processed for user `75bf0cd077294f6e9b390e9e3c853421`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:35:04.545239 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-01424b22-105c-4514-93da-12397be50a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:35:04.551924 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1439/2883] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:35:04 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:35:04.591845 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9b92fb-759d-46e3-ad44-be24a00e4f37 service cinder] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:35:04.593272 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-2d9b92fb-759d-46e3-ad44-be24a00e4f37 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:35:04.649388 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9b92fb-759d-46e3-ad44-be24a00e4f37 service cinder] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:35:04.652914 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7cb02e-d7c2-4cb0-b295-db437739f79f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd057b651769b4ae99c1d4f2b0fc31fb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:35:04.653499 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7cb02e-d7c2-4cb0-b295-db437739f79f service glance] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:35:04.653777 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7cb02e-d7c2-4cb0-b295-db437739f79f service glance] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:35:04.654048 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7cb02e-d7c2-4cb0-b295-db437739f79f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:35:04.655830 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-9f7cb02e-d7c2-4cb0-b295-db437739f79f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:35:04.725596 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7cb02e-d7c2-4cb0-b295-db437739f79f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:35:04.726974 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7cb02e-d7c2-4cb0-b295-db437739f79f service glance] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:35:04.737795 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1445/2884] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:35:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:35:05.273422 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01424b22-105c-4514-93da-12397be50a34 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:35:05.274846 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-01424b22-105c-4514-93da-12397be50a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:35:05.287314 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01424b22-105c-4514-93da-12397be50a34 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:35:05.291059 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b57d57f-d04e-4e2b-ade6-1ff3702d9c15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:35:05.291604 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b57d57f-d04e-4e2b-ade6-1ff3702d9c15 service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:35:05.291887 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b57d57f-d04e-4e2b-ade6-1ff3702d9c15 service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:35:05.292160 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b57d57f-d04e-4e2b-ade6-1ff3702d9c15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:35:05.293839 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-5b57d57f-d04e-4e2b-ade6-1ff3702d9c15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:35:05.308084 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b57d57f-d04e-4e2b-ade6-1ff3702d9c15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:35:05.309562 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b57d57f-d04e-4e2b-ade6-1ff3702d9c15 service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:35:05.320942 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1440/2885] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:35:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:35:07.731727 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7cb02e-d7c2-4cb0-b295-db437739f79f service glance] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:35:07.733282 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-9f7cb02e-d7c2-4cb0-b295-db437739f79f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:35:07.747799 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7cb02e-d7c2-4cb0-b295-db437739f79f service glance] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:35:07.754059 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c54277-8e26-4b1b-99ca-d6a208f2e91c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d05c52570474820b4ba0e2cdad5c13f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:35:07.754788 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c54277-8e26-4b1b-99ca-d6a208f2e91c service nova] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:35:07.755133 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c54277-8e26-4b1b-99ca-d6a208f2e91c service nova] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:35:07.755472 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c54277-8e26-4b1b-99ca-d6a208f2e91c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:35:07.757229 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-22c54277-8e26-4b1b-99ca-d6a208f2e91c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:35:07.766291 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=100 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:35:07.771315 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c54277-8e26-4b1b-99ca-d6a208f2e91c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:35:07.772914 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c54277-8e26-4b1b-99ca-d6a208f2e91c service nova] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:35:07.784368 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1446/2886] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:35:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:35:15.315803 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=28 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:35:17.779346 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=3 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:35:27.207027 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b57d57f-d04e-4e2b-ade6-1ff3702d9c15 service neutron] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:35:27.215937 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b57d57f-d04e-4e2b-ade6-1ff3702d9c15 service neutron] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:35:27.219552 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984f0f83-f804-43e7-88d7-57dd56ce8f38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:35:27.220138 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f0f83-f804-43e7-88d7-57dd56ce8f38 service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:35:27.220417 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f0f83-f804-43e7-88d7-57dd56ce8f38 service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:35:27.220687 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f0f83-f804-43e7-88d7-57dd56ce8f38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:35:27.222549 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-984f0f83-f804-43e7-88d7-57dd56ce8f38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:35:27.232173 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984f0f83-f804-43e7-88d7-57dd56ce8f38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:35:27.233580 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984f0f83-f804-43e7-88d7-57dd56ce8f38 service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:35:27.242275 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1441/2887] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:35:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:35:35.021185 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c1073-af10-4367-ac73-be8ae2f5e86b None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:35:35.021707 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c1073-af10-4367-ac73-be8ae2f5e86b None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:35:35.021707 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c1073-af10-4367-ac73-be8ae2f5e86b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:35:35.041957 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-988c1073-af10-4367-ac73-be8ae2f5e86b None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:35:35.043171 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-988c1073-af10-4367-ac73-be8ae2f5e86b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:35:35.051741 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1447/2888] 10.222.0.50 () {58 vars in 1016 bytes} [Thu Sep 15 12:35:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:35:35.077771 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984f0f83-f804-43e7-88d7-57dd56ce8f38 service neutron] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:35:35.079917 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-984f0f83-f804-43e7-88d7-57dd56ce8f38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:35:35.095195 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984f0f83-f804-43e7-88d7-57dd56ce8f38 service neutron] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:35:35.101067 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e6b711-a090-4403-8271-0b70b5c25ba3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d05c52570474820b4ba0e2cdad5c13f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:35:35.101647 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e6b711-a090-4403-8271-0b70b5c25ba3 service nova] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:35:35.101924 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e6b711-a090-4403-8271-0b70b5c25ba3 service nova] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:35:35.102194 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e6b711-a090-4403-8271-0b70b5c25ba3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:35:35.110031 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e6b711-a090-4403-8271-0b70b5c25ba3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:35:35.111606 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e6b711-a090-4403-8271-0b70b5c25ba3 service nova] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:35:35.121715 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1442/2889] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:35:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:35:38.095632 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ff9da-bbba-4258-83d7-a51ef5abc676 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:35:38.096146 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ff9da-bbba-4258-83d7-a51ef5abc676 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:35:38.096146 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ff9da-bbba-4258-83d7-a51ef5abc676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:35:38.116352 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-389ff9da-bbba-4258-83d7-a51ef5abc676 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:35:38.117548 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-389ff9da-bbba-4258-83d7-a51ef5abc676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:35:38.125332 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1448/2890] 10.222.0.50 () {58 vars in 1016 bytes} [Thu Sep 15 12:35:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:35:38.146242 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e6b711-a090-4403-8271-0b70b5c25ba3 service nova] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:35:38.157552 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e6b711-a090-4403-8271-0b70b5c25ba3 service nova] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:35:38.163514 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdcc0cc-0fb3-493a-9235-ece747ad59b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d05c52570474820b4ba0e2cdad5c13f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:35:38.164097 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdcc0cc-0fb3-493a-9235-ece747ad59b1 service nova] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:35:38.164374 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdcc0cc-0fb3-493a-9235-ece747ad59b1 service nova] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:35:38.164655 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdcc0cc-0fb3-493a-9235-ece747ad59b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:35:38.172621 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdcc0cc-0fb3-493a-9235-ece747ad59b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:35:38.174165 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdcc0cc-0fb3-493a-9235-ece747ad59b1 service nova] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:35:38.184040 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1443/2891] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:35:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:35:41.324713 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd319dba-45d2-4b8b-be13-e0c008a72b69 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:35:41.325247 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd319dba-45d2-4b8b-be13-e0c008a72b69 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:35:41.325247 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd319dba-45d2-4b8b-be13-e0c008a72b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:35:41.344094 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-cd319dba-45d2-4b8b-be13-e0c008a72b69 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:35:41.345272 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-cd319dba-45d2-4b8b-be13-e0c008a72b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:35:41.352958 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1449/2892] 10.222.0.50 () {58 vars in 1016 bytes} [Thu Sep 15 12:35:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:35:41.373584 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdcc0cc-0fb3-493a-9235-ece747ad59b1 service nova] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:35:41.385512 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdcc0cc-0fb3-493a-9235-ece747ad59b1 service nova] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:35:41.390969 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdca0b48-8f5f-40fa-990b-bb34e2aa7654 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d05c52570474820b4ba0e2cdad5c13f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:35:41.391548 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca0b48-8f5f-40fa-990b-bb34e2aa7654 service nova] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:35:41.391822 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca0b48-8f5f-40fa-990b-bb34e2aa7654 service nova] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:35:41.392090 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca0b48-8f5f-40fa-990b-bb34e2aa7654 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:35:41.399886 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdca0b48-8f5f-40fa-990b-bb34e2aa7654 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:35:41.401430 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdca0b48-8f5f-40fa-990b-bb34e2aa7654 service nova] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:35:41.410784 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1444/2893] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:35:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 12:35:44.412835 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db0a5f-7654-4f94-938b-f87e1468166c None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:35:44.413334 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db0a5f-7654-4f94-938b-f87e1468166c None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:35:44.413440 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db0a5f-7654-4f94-938b-f87e1468166c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:35:44.432659 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-55db0a5f-7654-4f94-938b-f87e1468166c None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:35:44.433831 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-55db0a5f-7654-4f94-938b-f87e1468166c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:35:44.441583 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1450/2894] 10.222.0.50 () {58 vars in 1016 bytes} [Thu Sep 15 12:35:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:35:44.462298 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdca0b48-8f5f-40fa-990b-bb34e2aa7654 service nova] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:35:44.473945 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdca0b48-8f5f-40fa-990b-bb34e2aa7654 service nova] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:35:44.479372 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2122324-572c-45c1-9b6e-bd60388e60a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d05c52570474820b4ba0e2cdad5c13f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:35:44.479953 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2122324-572c-45c1-9b6e-bd60388e60a2 service nova] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:35:44.480233 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2122324-572c-45c1-9b6e-bd60388e60a2 service nova] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:35:44.480505 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2122324-572c-45c1-9b6e-bd60388e60a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:35:44.488391 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2122324-572c-45c1-9b6e-bd60388e60a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:35:44.489938 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2122324-572c-45c1-9b6e-bd60388e60a2 service nova] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:35:44.499140 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1445/2895] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:35:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:35:48.599781 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02336368-c579-4e2c-a11e-2c2a13a54e3a None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:35:48.600275 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02336368-c579-4e2c-a11e-2c2a13a54e3a None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:35:48.600389 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02336368-c579-4e2c-a11e-2c2a13a54e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:35:48.620178 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-02336368-c579-4e2c-a11e-2c2a13a54e3a None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:35:48.621359 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-02336368-c579-4e2c-a11e-2c2a13a54e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:35:48.629285 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1451/2896] 10.222.0.50 () {58 vars in 1016 bytes} [Thu Sep 15 12:35:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:35:48.651573 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2122324-572c-45c1-9b6e-bd60388e60a2 service nova] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:35:48.662937 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2122324-572c-45c1-9b6e-bd60388e60a2 service nova] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:35:48.668167 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fbd5b3-194f-4ec7-acd9-df6ec96c8b2f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d05c52570474820b4ba0e2cdad5c13f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:35:48.668744 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fbd5b3-194f-4ec7-acd9-df6ec96c8b2f service nova] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:35:48.669019 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fbd5b3-194f-4ec7-acd9-df6ec96c8b2f service nova] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:35:48.669287 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fbd5b3-194f-4ec7-acd9-df6ec96c8b2f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:35:48.677186 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fbd5b3-194f-4ec7-acd9-df6ec96c8b2f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:35:48.678750 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fbd5b3-194f-4ec7-acd9-df6ec96c8b2f service nova] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:35:48.687858 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1446/2897] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:35:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:35:51.761269 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7a3c7c-fd8a-4c88-8fda-bede8383d837 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:35:51.761758 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7a3c7c-fd8a-4c88-8fda-bede8383d837 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:35:51.761874 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7a3c7c-fd8a-4c88-8fda-bede8383d837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:35:51.782590 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-ae7a3c7c-fd8a-4c88-8fda-bede8383d837 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:35:51.783804 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-ae7a3c7c-fd8a-4c88-8fda-bede8383d837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:35:51.791579 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1452/2898] 10.222.0.50 () {58 vars in 1016 bytes} [Thu Sep 15 12:35:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:35:51.813333 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fbd5b3-194f-4ec7-acd9-df6ec96c8b2f service nova] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:35:51.825041 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fbd5b3-194f-4ec7-acd9-df6ec96c8b2f service nova] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:35:51.830460 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a466b311-eac2-432e-a152-b871431d414e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d05c52570474820b4ba0e2cdad5c13f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:35:51.831086 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a466b311-eac2-432e-a152-b871431d414e service nova] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:35:51.831372 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a466b311-eac2-432e-a152-b871431d414e service nova] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:35:51.831643 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a466b311-eac2-432e-a152-b871431d414e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:35:51.839548 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a466b311-eac2-432e-a152-b871431d414e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:35:51.841095 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a466b311-eac2-432e-a152-b871431d414e service nova] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:35:51.850344 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1447/2899] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:35:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:36:01.777799 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=18 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:36:01.846195 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=42 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:36:06.843923 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfafd92-11c4-44ae-bd02-15dece2d2cd4 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:36:06.844420 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfafd92-11c4-44ae-bd02-15dece2d2cd4 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:36:06.844545 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfafd92-11c4-44ae-bd02-15dece2d2cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:36:06.862768 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-cdfafd92-11c4-44ae-bd02-15dece2d2cd4 None None] MFA Rules not processed for user `75bf0cd077294f6e9b390e9e3c853421`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:36:06.863946 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-cdfafd92-11c4-44ae-bd02-15dece2d2cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:36:06.871152 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1453/2900] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:36:06 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:36:07.099742 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a466b311-eac2-432e-a152-b871431d414e service nova] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:36:07.109109 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a466b311-eac2-432e-a152-b871431d414e service nova] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:36:07.112644 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2ea013-8247-4f93-b6af-9da266c7926f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:36:07.113223 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ea013-8247-4f93-b6af-9da266c7926f service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:36:07.113503 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ea013-8247-4f93-b6af-9da266c7926f service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:36:07.113774 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ea013-8247-4f93-b6af-9da266c7926f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:36:07.116262 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-ac2ea013-8247-4f93-b6af-9da266c7926f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:36:07.125876 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2ea013-8247-4f93-b6af-9da266c7926f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:36:07.127576 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2ea013-8247-4f93-b6af-9da266c7926f service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:36:07.136773 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1448/2901] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:36:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:36:07.456847 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfafd92-11c4-44ae-bd02-15dece2d2cd4 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:36:07.458836 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-cdfafd92-11c4-44ae-bd02-15dece2d2cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:36:07.530630 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfafd92-11c4-44ae-bd02-15dece2d2cd4 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:36:07.535570 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0866194-54ad-4525-87db-f4704f853cb6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ff8a5ddf1e422ca97f92bd9d4e5fb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:36:07.536170 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0866194-54ad-4525-87db-f4704f853cb6 service placement] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:36:07.537005 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0866194-54ad-4525-87db-f4704f853cb6 service placement] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:36:07.537277 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0866194-54ad-4525-87db-f4704f853cb6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:36:07.539015 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-a0866194-54ad-4525-87db-f4704f853cb6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:36:07.550103 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0866194-54ad-4525-87db-f4704f853cb6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:36:07.551700 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0866194-54ad-4525-87db-f4704f853cb6 service placement] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:36:07.561429 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1454/2902] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:36:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:36:16.904694 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2ea013-8247-4f93-b6af-9da266c7926f service neutron] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:36:16.921289 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2ea013-8247-4f93-b6af-9da266c7926f service neutron] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:36:16.927086 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc9cdec-37f2-4f0d-a54d-938b4539bb69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d05c52570474820b4ba0e2cdad5c13f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:36:16.927685 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9cdec-37f2-4f0d-a54d-938b4539bb69 service nova] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:36:16.928689 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9cdec-37f2-4f0d-a54d-938b4539bb69 service nova] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:36:16.928963 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9cdec-37f2-4f0d-a54d-938b4539bb69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:36:16.930826 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-9dc9cdec-37f2-4f0d-a54d-938b4539bb69 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:36:16.943438 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc9cdec-37f2-4f0d-a54d-938b4539bb69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:36:16.945145 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc9cdec-37f2-4f0d-a54d-938b4539bb69 service nova] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:36:16.956048 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1449/2903] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:36:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:36:17.557319 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=35 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:36:21.996199 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd24e8bc-01df-4141-b66e-ad116beb7783 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:36:21.996777 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd24e8bc-01df-4141-b66e-ad116beb7783 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:36:21.996777 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd24e8bc-01df-4141-b66e-ad116beb7783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:36:22.016995 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-cd24e8bc-01df-4141-b66e-ad116beb7783 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:36:22.018177 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-cd24e8bc-01df-4141-b66e-ad116beb7783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:36:22.025846 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1455/2904] 10.222.0.50 () {58 vars in 1016 bytes} [Thu Sep 15 12:36:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:36:22.045363 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc9cdec-37f2-4f0d-a54d-938b4539bb69 service nova] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:36:22.056888 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc9cdec-37f2-4f0d-a54d-938b4539bb69 service nova] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:36:22.062200 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3918282b-729e-4e89-86a9-43e73e708510 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d05c52570474820b4ba0e2cdad5c13f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:36:22.062815 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918282b-729e-4e89-86a9-43e73e708510 service nova] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:36:22.063092 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918282b-729e-4e89-86a9-43e73e708510 service nova] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:36:22.063362 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918282b-729e-4e89-86a9-43e73e708510 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:36:22.071175 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3918282b-729e-4e89-86a9-43e73e708510 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:36:22.072713 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3918282b-729e-4e89-86a9-43e73e708510 service nova] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:36:22.081796 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1450/2905] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:36:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:36:25.249456 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc94b3-7236-4fe3-a18a-8ab23831ea07 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:36:25.250006 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc94b3-7236-4fe3-a18a-8ab23831ea07 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:36:25.250006 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc94b3-7236-4fe3-a18a-8ab23831ea07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:36:25.269617 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-a0bc94b3-7236-4fe3-a18a-8ab23831ea07 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:36:25.270837 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-a0bc94b3-7236-4fe3-a18a-8ab23831ea07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:36:25.279232 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1456/2906] 10.222.0.50 () {58 vars in 1016 bytes} [Thu Sep 15 12:36:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:36:25.299857 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3918282b-729e-4e89-86a9-43e73e708510 service nova] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:36:25.311287 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3918282b-729e-4e89-86a9-43e73e708510 service nova] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:36:25.316714 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849f9d06-db7c-4286-9282-5fd18a619541 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d05c52570474820b4ba0e2cdad5c13f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:36:25.317407 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f9d06-db7c-4286-9282-5fd18a619541 service nova] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:36:25.317684 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f9d06-db7c-4286-9282-5fd18a619541 service nova] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:36:25.318445 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f9d06-db7c-4286-9282-5fd18a619541 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:36:25.326519 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849f9d06-db7c-4286-9282-5fd18a619541 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:36:25.328149 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849f9d06-db7c-4286-9282-5fd18a619541 service nova] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:36:25.338072 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1451/2907] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:36:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:36:28.358422 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a762510f-268d-4db0-8b60-f7d54ae5f1eb None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:36:28.358970 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a762510f-268d-4db0-8b60-f7d54ae5f1eb None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:36:28.359078 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a762510f-268d-4db0-8b60-f7d54ae5f1eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:36:28.379003 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-a762510f-268d-4db0-8b60-f7d54ae5f1eb None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:36:28.380195 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-a762510f-268d-4db0-8b60-f7d54ae5f1eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:36:28.387879 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1457/2908] 10.222.0.50 () {58 vars in 1016 bytes} [Thu Sep 15 12:36:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:36:28.409098 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849f9d06-db7c-4286-9282-5fd18a619541 service nova] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:36:28.420686 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849f9d06-db7c-4286-9282-5fd18a619541 service nova] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:36:28.425989 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639e41cd-e57d-44d0-a980-a11256077fc5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d05c52570474820b4ba0e2cdad5c13f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:36:28.426563 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639e41cd-e57d-44d0-a980-a11256077fc5 service nova] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:36:28.426878 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639e41cd-e57d-44d0-a980-a11256077fc5 service nova] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:36:28.427256 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639e41cd-e57d-44d0-a980-a11256077fc5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:36:28.435119 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639e41cd-e57d-44d0-a980-a11256077fc5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:36:28.436652 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639e41cd-e57d-44d0-a980-a11256077fc5 service nova] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:36:28.445754 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1452/2909] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:36:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:36:31.501870 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95573a0-272e-40b8-b3ec-a55ba3520fe7 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:36:31.502356 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95573a0-272e-40b8-b3ec-a55ba3520fe7 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:36:31.502468 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95573a0-272e-40b8-b3ec-a55ba3520fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:36:31.523318 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-d95573a0-272e-40b8-b3ec-a55ba3520fe7 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:36:31.524517 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-d95573a0-272e-40b8-b3ec-a55ba3520fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:36:31.534714 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1458/2910] 10.222.0.50 () {58 vars in 1016 bytes} [Thu Sep 15 12:36:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:36:31.557031 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639e41cd-e57d-44d0-a980-a11256077fc5 service nova] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:36:31.568780 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639e41cd-e57d-44d0-a980-a11256077fc5 service nova] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:36:31.574120 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6e42f7-548a-4f69-a699-6b19617644f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d05c52570474820b4ba0e2cdad5c13f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:36:31.574721 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e42f7-548a-4f69-a699-6b19617644f2 service nova] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:36:31.575006 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e42f7-548a-4f69-a699-6b19617644f2 service nova] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:36:31.575278 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e42f7-548a-4f69-a699-6b19617644f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:36:31.583207 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6e42f7-548a-4f69-a699-6b19617644f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:36:31.584759 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6e42f7-548a-4f69-a699-6b19617644f2 service nova] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:36:31.593904 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1453/2911] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:36:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:36:35.689834 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5039d-27f5-4448-aac9-bc4ab2b47533 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:36:35.690317 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5039d-27f5-4448-aac9-bc4ab2b47533 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:36:35.690433 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5039d-27f5-4448-aac9-bc4ab2b47533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:36:35.709676 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-f2d5039d-27f5-4448-aac9-bc4ab2b47533 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:36:35.710899 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-f2d5039d-27f5-4448-aac9-bc4ab2b47533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:36:35.718611 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1459/2912] 10.222.0.50 () {58 vars in 1016 bytes} [Thu Sep 15 12:36:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:36:35.741994 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6e42f7-548a-4f69-a699-6b19617644f2 service nova] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:36:35.747798 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=37 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:36:35.754018 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6e42f7-548a-4f69-a699-6b19617644f2 service nova] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:36:35.759980 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14609ad8-c821-46f6-8769-856e1e91b7f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d05c52570474820b4ba0e2cdad5c13f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:36:35.760599 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14609ad8-c821-46f6-8769-856e1e91b7f6 service nova] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:36:35.760879 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14609ad8-c821-46f6-8769-856e1e91b7f6 service nova] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:36:35.761150 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14609ad8-c821-46f6-8769-856e1e91b7f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:36:35.769101 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14609ad8-c821-46f6-8769-856e1e91b7f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:36:35.770660 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14609ad8-c821-46f6-8769-856e1e91b7f6 service nova] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:36:35.780890 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1454/2913] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:36:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:36:45.704931 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=15 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:36:45.776673 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=5 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:37:04.711098 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d5039d-27f5-4448-aac9-bc4ab2b47533 None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:37:04.721157 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d5039d-27f5-4448-aac9-bc4ab2b47533 None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:37:04.726493 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9b4fb1-a315-40db-9231-f287f3d3ed37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:37:04.727151 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9b4fb1-a315-40db-9231-f287f3d3ed37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:37:04.727432 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9b4fb1-a315-40db-9231-f287f3d3ed37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:37:04.727706 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9b4fb1-a315-40db-9231-f287f3d3ed37 admin admin] PATH_INFO: `/v3/users/75bf0cd077294f6e9b390e9e3c853421` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:37:04.728816 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9b4fb1-a315-40db-9231-f287f3d3ed37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75bf0cd077294f6e9b390e9e3c853421)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:37:04.730756 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9b4fb1-a315-40db-9231-f287f3d3ed37 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:37:04.776636 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-fc9b4fb1-a315-40db-9231-f287f3d3ed37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75bf0cd077294f6e9b390e9e3c853421'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:37:04.783947 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-fc9b4fb1-a315-40db-9231-f287f3d3ed37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75bf0cd077294f6e9b390e9e3c853421'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:37:04.784683 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-fc9b4fb1-a315-40db-9231-f287f3d3ed37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75bf0cd077294f6e9b390e9e3c853421'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:37:04.785477 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-fc9b4fb1-a315-40db-9231-f287f3d3ed37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75bf0cd077294f6e9b390e9e3c853421'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:37:04.793395 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-fc9b4fb1-a315-40db-9231-f287f3d3ed37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75bf0cd077294f6e9b390e9e3c853421'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:37:04.810634 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1460/2914] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:37:04 2022] DELETE /identity/v3/users/75bf0cd077294f6e9b390e9e3c853421 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:37:04.981496 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14609ad8-c821-46f6-8769-856e1e91b7f6 service nova] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:37:04.995055 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14609ad8-c821-46f6-8769-856e1e91b7f6 service nova] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:37:05.055504 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c7807b-22c3-4b0c-aca1-748f00ba40a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:37:05.056165 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7807b-22c3-4b0c-aca1-748f00ba40a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:37:05.056454 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7807b-22c3-4b0c-aca1-748f00ba40a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:37:05.056727 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7807b-22c3-4b0c-aca1-748f00ba40a5 admin admin] PATH_INFO: `/v3/projects/504f711eb70443a8ae76f959ca58b0a2` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:37:05.057880 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c7807b-22c3-4b0c-aca1-748f00ba40a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=504f711eb70443a8ae76f959ca58b0a2)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:37:05.059810 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c7807b-22c3-4b0c-aca1-748f00ba40a5 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:37:05.105328 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-63c7807b-22c3-4b0c-aca1-748f00ba40a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '504f711eb70443a8ae76f959ca58b0a2', 'request_id': 'req-63c7807b-22c3-4b0c-aca1-748f00ba40a5'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:37:05.111741 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-63c7807b-22c3-4b0c-aca1-748f00ba40a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '504f711eb70443a8ae76f959ca58b0a2', 'request_id': 'req-63c7807b-22c3-4b0c-aca1-748f00ba40a5'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:37:05.117315 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-63c7807b-22c3-4b0c-aca1-748f00ba40a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '504f711eb70443a8ae76f959ca58b0a2', 'request_id': 'req-63c7807b-22c3-4b0c-aca1-748f00ba40a5'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:37:05.129884 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-63c7807b-22c3-4b0c-aca1-748f00ba40a5 admin admin] The token cache is being invalidate because project 504f711eb70443a8ae76f959ca58b0a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:37:05.130167 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-63c7807b-22c3-4b0c-aca1-748f00ba40a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:37:05.130816 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-63c7807b-22c3-4b0c-aca1-748f00ba40a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:37:05.132300 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1455/2915] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:37:04 2022] DELETE /identity/v3/projects/504f711eb70443a8ae76f959ca58b0a2 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:37:05.137876 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95506a6-39a4-45e1-a8a2-7fc846b193da None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:37:05.138168 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95506a6-39a4-45e1-a8a2-7fc846b193da None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:37:05.138447 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95506a6-39a4-45e1-a8a2-7fc846b193da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:37:05.158450 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-b95506a6-39a4-45e1-a8a2-7fc846b193da None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:37:05.159691 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-b95506a6-39a4-45e1-a8a2-7fc846b193da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:37:05.219751 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1461/2916] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:37:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:37:05.227431 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d98280-d49b-43b2-b994-5a95e61f7657 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:37:05.227714 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d98280-d49b-43b2-b994-5a95e61f7657 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:37:05.227983 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d98280-d49b-43b2-b994-5a95e61f7657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:37:05.247543 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-f2d98280-d49b-43b2-b994-5a95e61f7657 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:37:05.248726 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-f2d98280-d49b-43b2-b994-5a95e61f7657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:37:05.257243 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1456/2917] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:37:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:37:05.261415 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95506a6-39a4-45e1-a8a2-7fc846b193da None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:37:05.271027 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95506a6-39a4-45e1-a8a2-7fc846b193da None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:37:05.275610 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8a79cc-b537-4304-88f5-434121d3b9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:37:05.276225 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a79cc-b537-4304-88f5-434121d3b9e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:37:05.276499 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a79cc-b537-4304-88f5-434121d3b9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:37:05.276763 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a79cc-b537-4304-88f5-434121d3b9e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:37:05.277400 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8a79cc-b537-4304-88f5-434121d3b9e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81375) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 12:37:05.277702 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8a79cc-b537-4304-88f5-434121d3b9e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:37:05.279308 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8a79cc-b537-4304-88f5-434121d3b9e1 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:37:05.290486 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1462/2918] 10.222.0.16 () {58 vars in 1153 bytes} [Thu Sep 15 12:37:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 12:37:05.294543 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d98280-d49b-43b2-b994-5a95e61f7657 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:37:05.304036 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d98280-d49b-43b2-b994-5a95e61f7657 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:37:05.308563 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f367a3-57ef-4ee4-ae37-201e11275001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:37:05.309141 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f367a3-57ef-4ee4-ae37-201e11275001 admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:37:05.309418 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f367a3-57ef-4ee4-ae37-201e11275001 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:37:05.309686 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f367a3-57ef-4ee4-ae37-201e11275001 admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:37:05.310305 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f367a3-57ef-4ee4-ae37-201e11275001 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:37:05.312204 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f367a3-57ef-4ee4-ae37-201e11275001 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:37:05.339293 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1457/2919] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:37:05 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:37:05.343237 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8a79cc-b537-4304-88f5-434121d3b9e1 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:37:05.353502 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8a79cc-b537-4304-88f5-434121d3b9e1 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:37:05.414189 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb862a60-c333-46a9-920f-5c8ae0670921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:37:05.414861 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb862a60-c333-46a9-920f-5c8ae0670921 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:37:05.415140 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb862a60-c333-46a9-920f-5c8ae0670921 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:37:05.415407 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb862a60-c333-46a9-920f-5c8ae0670921 admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:37:05.416059 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb862a60-c333-46a9-920f-5c8ae0670921 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:37:05.417981 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb862a60-c333-46a9-920f-5c8ae0670921 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:37:05.425803 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:37:05.441365 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1463/2920] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:37:05 2022] POST /identity/v3/users => generated 286 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:37:05.445959 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f367a3-57ef-4ee4-ae37-201e11275001 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:37:05.456281 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f367a3-57ef-4ee4-ae37-201e11275001 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:37:05.461008 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f17ab17-9dd6-44b3-8be4-f185b17cc213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:37:05.461603 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f17ab17-9dd6-44b3-8be4-f185b17cc213 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:37:05.461878 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f17ab17-9dd6-44b3-8be4-f185b17cc213 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:37:05.462144 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f17ab17-9dd6-44b3-8be4-f185b17cc213 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:37:05.462845 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f17ab17-9dd6-44b3-8be4-f185b17cc213 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:37:05.464418 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f17ab17-9dd6-44b3-8be4-f185b17cc213 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:37:05.474216 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1458/2921] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:37:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 12:37:05.477939 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb862a60-c333-46a9-920f-5c8ae0670921 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:37:05.487479 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb862a60-c333-46a9-920f-5c8ae0670921 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:37:05.492666 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c77e4ff-880f-4ecb-95f7-16a466512260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:37:05.493245 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c77e4ff-880f-4ecb-95f7-16a466512260 admin admin] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:37:05.493517 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c77e4ff-880f-4ecb-95f7-16a466512260 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:37:05.493783 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c77e4ff-880f-4ecb-95f7-16a466512260 admin admin] PATH_INFO: `/v3/roles` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:37:05.494408 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c77e4ff-880f-4ecb-95f7-16a466512260 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:37:05.496017 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c77e4ff-880f-4ecb-95f7-16a466512260 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:37:05.506755 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1464/2922] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:37:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:37:05.510666 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f17ab17-9dd6-44b3-8be4-f185b17cc213 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:37:05.520477 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f17ab17-9dd6-44b3-8be4-f185b17cc213 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:37:05.525061 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7445d0a-9171-4114-bb47-b8f0dd271d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:37:05.525698 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7445d0a-9171-4114-bb47-b8f0dd271d8a admin admin] REQUEST_METHOD: `PUT` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:37:05.525977 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7445d0a-9171-4114-bb47-b8f0dd271d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:37:05.526253 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7445d0a-9171-4114-bb47-b8f0dd271d8a admin admin] PATH_INFO: `/v3/projects/33b11d92f8fd488c91ecafefd8a2878d/users/03b0980464ce4c6dbc095939e1599589/roles/9371e5bbc55848949eb951a815f817f2` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:37:05.541170 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7445d0a-9171-4114-bb47-b8f0dd271d8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=33b11d92f8fd488c91ecafefd8a2878d, user_id=03b0980464ce4c6dbc095939e1599589, role_id=9371e5bbc55848949eb951a815f817f2)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:37:05.543867 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7445d0a-9171-4114-bb47-b8f0dd271d8a admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:37:05.557244 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1459/2923] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:37:05 2022] PUT /identity/v3/projects/33b11d92f8fd488c91ecafefd8a2878d/users/03b0980464ce4c6dbc095939e1599589/roles/9371e5bbc55848949eb951a815f817f2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:37:05.562136 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e4594-aea3-4c92-8a7e-469965946b69 None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:37:05.562419 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e4594-aea3-4c92-8a7e-469965946b69 None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:37:05.562713 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e4594-aea3-4c92-8a7e-469965946b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:37:05.581139 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-3a1e4594-aea3-4c92-8a7e-469965946b69 None None] MFA Rules not processed for user `0385d82554b5461ca05c9bdb07b4a451`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:37:05.582329 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-3a1e4594-aea3-4c92-8a7e-469965946b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:37:05.640078 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1465/2924] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:37:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:37:05.649613 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7445d0a-9171-4114-bb47-b8f0dd271d8a admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:37:05.651306 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-d7445d0a-9171-4114-bb47-b8f0dd271d8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:37:05.683068 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:37:05.710764 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7445d0a-9171-4114-bb47-b8f0dd271d8a admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:37:05.714310 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c5a1e0-1fb4-4c77-a670-330f1518e0b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:37:05.714926 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c5a1e0-1fb4-4c77-a670-330f1518e0b1 service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:37:05.715204 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c5a1e0-1fb4-4c77-a670-330f1518e0b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:37:05.715471 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c5a1e0-1fb4-4c77-a670-330f1518e0b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:37:05.724630 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c5a1e0-1fb4-4c77-a670-330f1518e0b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:37:05.726028 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c5a1e0-1fb4-4c77-a670-330f1518e0b1 service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:37:05.735093 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1460/2925] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:37:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:37:09.463860 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d379d14-f82f-46d6-a87e-6a624a7d39fa None None] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:37:09.464303 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d379d14-f82f-46d6-a87e-6a624a7d39fa None None] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:37:09.464386 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d379d14-f82f-46d6-a87e-6a624a7d39fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:37:09.496104 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.auth.core [None req-9d379d14-f82f-46d6-a87e-6a624a7d39fa None None] MFA Rules not processed for user `03b0980464ce4c6dbc095939e1599589`. Rule list: `[]` (Enabled: `True`). {{(pid=81375) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:37:09.497969 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-9d379d14-f82f-46d6-a87e-6a624a7d39fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:37:09.581940 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1466/2926] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:37:09 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:37:09.583222 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c5a1e0-1fb4-4c77-a670-330f1518e0b1 service neutron] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:37:09.593106 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c5a1e0-1fb4-4c77-a670-330f1518e0b1 service neutron] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:37:09.599137 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d143a97-fd23-408e-8fc6-2d937a4ced1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:37:09.599742 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d143a97-fd23-408e-8fc6-2d937a4ced1d admin admin] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:37:09.600020 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d143a97-fd23-408e-8fc6-2d937a4ced1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:37:09.600295 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d143a97-fd23-408e-8fc6-2d937a4ced1d admin admin] PATH_INFO: `/v3/projects` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:37:09.600979 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d143a97-fd23-408e-8fc6-2d937a4ced1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:37:09.603154 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d143a97-fd23-408e-8fc6-2d937a4ced1d admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:37:09.636678 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1461/2927] 10.222.0.16 () {60 vars in 1153 bytes} [Thu Sep 15 12:37:09 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:37:09.637982 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d379d14-f82f-46d6-a87e-6a624a7d39fa None None] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:37:09.649954 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d379d14-f82f-46d6-a87e-6a624a7d39fa None None] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:37:09.714952 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e530f5-cd8c-4494-8c53-6c028962f664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:37:09.715659 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e530f5-cd8c-4494-8c53-6c028962f664 admin admin] REQUEST_METHOD: `POST` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:37:09.716008 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e530f5-cd8c-4494-8c53-6c028962f664 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:37:09.716358 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e530f5-cd8c-4494-8c53-6c028962f664 admin admin] PATH_INFO: `/v3/users` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:37:09.717083 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e530f5-cd8c-4494-8c53-6c028962f664 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:37:09.719379 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e530f5-cd8c-4494-8c53-6c028962f664 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:37:09.738813 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:37:09.747070 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1467/2928] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Sep 15 12:37:09 2022] POST /identity/v3/users => generated 292 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 12:37:09.750853 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d143a97-fd23-408e-8fc6-2d937a4ced1d admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:37:09.762180 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d143a97-fd23-408e-8fc6-2d937a4ced1d admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:37:09.766918 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5370510-b228-49d9-84f6-a15d000e01c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:37:09.767536 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5370510-b228-49d9-84f6-a15d000e01c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:37:09.767818 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5370510-b228-49d9-84f6-a15d000e01c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:37:09.768093 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5370510-b228-49d9-84f6-a15d000e01c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:37:09.768749 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5370510-b228-49d9-84f6-a15d000e01c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:37:09.770907 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5370510-b228-49d9-84f6-a15d000e01c1 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:37:09.784520 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1462/2929] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:37:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 12:37:09.789428 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e530f5-cd8c-4494-8c53-6c028962f664 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:37:09.800698 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e530f5-cd8c-4494-8c53-6c028962f664 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:37:09.805647 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd8656e-f5eb-4131-8194-e9813cf65bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:37:09.806416 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd8656e-f5eb-4131-8194-e9813cf65bda admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:37:09.807356 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd8656e-f5eb-4131-8194-e9813cf65bda admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:37:09.807480 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd8656e-f5eb-4131-8194-e9813cf65bda admin admin] PATH_INFO: `/v3/projects/91cc1d127c1e458ab065b540f8f1b0c7/users/4439800dced34b5caf2ea268b7aa48b4/roles/7f53f1c823b746529ba5057bf21b2477` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:37:09.824596 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd8656e-f5eb-4131-8194-e9813cf65bda admin admin] RBAC: Authorizing `identity:create_grant(project_id=91cc1d127c1e458ab065b540f8f1b0c7, user_id=4439800dced34b5caf2ea268b7aa48b4, role_id=7f53f1c823b746529ba5057bf21b2477)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:37:09.827464 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd8656e-f5eb-4131-8194-e9813cf65bda admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:37:09.843571 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1468/2930] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:37:09 2022] PUT /identity/v3/projects/91cc1d127c1e458ab065b540f8f1b0c7/users/4439800dced34b5caf2ea268b7aa48b4/roles/7f53f1c823b746529ba5057bf21b2477 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:37:09.847353 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5370510-b228-49d9-84f6-a15d000e01c1 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:37:09.859223 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5370510-b228-49d9-84f6-a15d000e01c1 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:37:09.940781 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4cbce7-6b3b-4758-bcb4-408e3875229a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:37:09.941427 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4cbce7-6b3b-4758-bcb4-408e3875229a admin admin] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:37:09.941704 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4cbce7-6b3b-4758-bcb4-408e3875229a admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:37:09.941974 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4cbce7-6b3b-4758-bcb4-408e3875229a admin admin] PATH_INFO: `/v3/roles` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:37:09.942614 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4cbce7-6b3b-4758-bcb4-408e3875229a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:37:09.944327 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4cbce7-6b3b-4758-bcb4-408e3875229a admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:37:09.954480 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1463/2931] 10.222.0.16 () {58 vars in 1122 bytes} [Thu Sep 15 12:37:09 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 12:37:09.959548 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd8656e-f5eb-4131-8194-e9813cf65bda admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:37:09.970144 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd8656e-f5eb-4131-8194-e9813cf65bda admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:37:09.975420 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2114620d-79ee-4caf-8f9a-1d6479ff6067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:37:09.976091 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114620d-79ee-4caf-8f9a-1d6479ff6067 admin admin] REQUEST_METHOD: `PUT` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:37:09.976361 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114620d-79ee-4caf-8f9a-1d6479ff6067 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:37:09.979097 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114620d-79ee-4caf-8f9a-1d6479ff6067 admin admin] PATH_INFO: `/v3/projects/91cc1d127c1e458ab065b540f8f1b0c7/users/4439800dced34b5caf2ea268b7aa48b4/roles/7f53f1c823b746529ba5057bf21b2477` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:37:09.981326 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2114620d-79ee-4caf-8f9a-1d6479ff6067 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91cc1d127c1e458ab065b540f8f1b0c7, user_id=4439800dced34b5caf2ea268b7aa48b4, role_id=7f53f1c823b746529ba5057bf21b2477)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:37:09.984179 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2114620d-79ee-4caf-8f9a-1d6479ff6067 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:37:09.995026 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1469/2932] 10.222.0.16 () {60 vars in 1483 bytes} [Thu Sep 15 12:37:09 2022] PUT /identity/v3/projects/91cc1d127c1e458ab065b540f8f1b0c7/users/4439800dced34b5caf2ea268b7aa48b4/roles/7f53f1c823b746529ba5057bf21b2477 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:37:14.730954 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f555e87-88ef-4734-b5ee-a7b98ba9bd3a None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:37:14.731476 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f555e87-88ef-4734-b5ee-a7b98ba9bd3a None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:37:14.731568 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f555e87-88ef-4734-b5ee-a7b98ba9bd3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:37:14.762052 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-1f555e87-88ef-4734-b5ee-a7b98ba9bd3a None None] MFA Rules not processed for user `4439800dced34b5caf2ea268b7aa48b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:37:14.763306 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-1f555e87-88ef-4734-b5ee-a7b98ba9bd3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:37:14.837143 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1464/2933] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:37:14 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 12:37:14.858437 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2114620d-79ee-4caf-8f9a-1d6479ff6067 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:37:14.860044 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-2114620d-79ee-4caf-8f9a-1d6479ff6067 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:37:14.940022 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2114620d-79ee-4caf-8f9a-1d6479ff6067 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:37:14.946455 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247ce512-38d9-4f7e-abee-28898df68482 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d05c52570474820b4ba0e2cdad5c13f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:37:14.947140 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ce512-38d9-4f7e-abee-28898df68482 service nova] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:37:14.947428 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ce512-38d9-4f7e-abee-28898df68482 service nova] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:37:14.947702 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ce512-38d9-4f7e-abee-28898df68482 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:37:15.012272 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247ce512-38d9-4f7e-abee-28898df68482 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:37:15.013912 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247ce512-38d9-4f7e-abee-28898df68482 service nova] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:37:15.023752 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1470/2934] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:37:14 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:37:16.009606 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cce455-a5e0-4909-94f9-ca5b5e24c4a7 None None] REQUEST_METHOD: `POST` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:37:16.010109 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cce455-a5e0-4909-94f9-ca5b5e24c4a7 None None] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:37:16.010219 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cce455-a5e0-4909-94f9-ca5b5e24c4a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:37:16.029115 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.auth.core [None req-66cce455-a5e0-4909-94f9-ca5b5e24c4a7 None None] MFA Rules not processed for user `03b0980464ce4c6dbc095939e1599589`. Rule list: `[]` (Enabled: `True`). {{(pid=81374) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 12:37:16.030297 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-66cce455-a5e0-4909-94f9-ca5b5e24c4a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:37:16.038206 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1465/2935] 10.222.0.16 () {58 vars in 958 bytes} [Thu Sep 15 12:37:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 12:37:25.019656 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=72,keystone:INSERT=2 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:37:26.023696 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=94,keystone:INSERT=1 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:37:35.445722 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247ce512-38d9-4f7e-abee-28898df68482 service nova] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:37:35.447209 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-247ce512-38d9-4f7e-abee-28898df68482 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:37:35.528825 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247ce512-38d9-4f7e-abee-28898df68482 service nova] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:37:35.533901 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001f8b5f-dcc2-42ea-8301-f70a811e7e99 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ff8a5ddf1e422ca97f92bd9d4e5fb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:37:35.534543 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f8b5f-dcc2-42ea-8301-f70a811e7e99 service placement] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:37:35.534864 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f8b5f-dcc2-42ea-8301-f70a811e7e99 service placement] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:37:35.535136 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f8b5f-dcc2-42ea-8301-f70a811e7e99 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:37:35.536935 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-001f8b5f-dcc2-42ea-8301-f70a811e7e99 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:37:35.549265 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001f8b5f-dcc2-42ea-8301-f70a811e7e99 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:37:35.550872 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001f8b5f-dcc2-42ea-8301-f70a811e7e99 service placement] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:37:35.561833 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1471/2936] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:37:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:37:45.556703 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=32 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:37:46.229726 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cce455-a5e0-4909-94f9-ca5b5e24c4a7 None None] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:37:46.284862 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cce455-a5e0-4909-94f9-ca5b5e24c4a7 None None] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:37:46.288460 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e562934d-9de4-4bcb-ac38-0a7fe55bc57e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:37:46.289058 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e562934d-9de4-4bcb-ac38-0a7fe55bc57e service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:37:46.289337 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e562934d-9de4-4bcb-ac38-0a7fe55bc57e service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:37:46.289609 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e562934d-9de4-4bcb-ac38-0a7fe55bc57e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:37:46.298384 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e562934d-9de4-4bcb-ac38-0a7fe55bc57e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:37:46.299840 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e562934d-9de4-4bcb-ac38-0a7fe55bc57e service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:37:46.309248 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1466/2937] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:37:46 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:37:56.305160 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=26 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:40:12.246040 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001f8b5f-dcc2-42ea-8301-f70a811e7e99 service placement] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:40:12.256372 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001f8b5f-dcc2-42ea-8301-f70a811e7e99 service placement] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:40:12.259887 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb354cc-5d24-4b5d-aa8a-db09aeeb3217 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:40:12.260473 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb354cc-5d24-4b5d-aa8a-db09aeeb3217 service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:40:12.260748 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb354cc-5d24-4b5d-aa8a-db09aeeb3217 service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:40:12.261016 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb354cc-5d24-4b5d-aa8a-db09aeeb3217 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:40:12.262767 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-dcb354cc-5d24-4b5d-aa8a-db09aeeb3217 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:40:12.276504 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb354cc-5d24-4b5d-aa8a-db09aeeb3217 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:40:12.277906 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb354cc-5d24-4b5d-aa8a-db09aeeb3217 service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:40:12.288886 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1472/2938] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:40:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:40:13.470510 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e562934d-9de4-4bcb-ac38-0a7fe55bc57e service neutron] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:40:13.479709 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e562934d-9de4-4bcb-ac38-0a7fe55bc57e service neutron] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:40:13.483200 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505c40eb-5dfa-4a46-8f0a-7b7f13e860af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:40:13.483779 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505c40eb-5dfa-4a46-8f0a-7b7f13e860af service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:40:13.484053 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505c40eb-5dfa-4a46-8f0a-7b7f13e860af service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:40:13.484322 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505c40eb-5dfa-4a46-8f0a-7b7f13e860af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:40:13.485988 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-505c40eb-5dfa-4a46-8f0a-7b7f13e860af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:40:13.498773 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505c40eb-5dfa-4a46-8f0a-7b7f13e860af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:40:13.500175 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505c40eb-5dfa-4a46-8f0a-7b7f13e860af service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:40:13.511062 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1467/2939] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:40:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:40:22.283894 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=6 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:40:23.506824 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=6 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:40:25.533443 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb354cc-5d24-4b5d-aa8a-db09aeeb3217 service neutron] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:40:25.542394 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb354cc-5d24-4b5d-aa8a-db09aeeb3217 service neutron] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:40:25.546117 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9a45be-2fc4-42dc-be8e-ddde33708c41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:40:25.546737 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a45be-2fc4-42dc-be8e-ddde33708c41 service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:40:25.547014 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a45be-2fc4-42dc-be8e-ddde33708c41 service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:40:25.547281 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a45be-2fc4-42dc-be8e-ddde33708c41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:40:25.549529 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-7a9a45be-2fc4-42dc-be8e-ddde33708c41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:40:25.559632 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9a45be-2fc4-42dc-be8e-ddde33708c41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:40:25.561081 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9a45be-2fc4-42dc-be8e-ddde33708c41 service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:40:25.570419 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1473/2940] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:40:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:40:25.680172 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505c40eb-5dfa-4a46-8f0a-7b7f13e860af service neutron] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:40:25.689405 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505c40eb-5dfa-4a46-8f0a-7b7f13e860af service neutron] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:40:25.693410 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8cc60d-ab38-4e51-afd3-6dc53e77b0e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:40:25.694082 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8cc60d-ab38-4e51-afd3-6dc53e77b0e4 service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:40:25.694494 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8cc60d-ab38-4e51-afd3-6dc53e77b0e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:40:25.694924 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8cc60d-ab38-4e51-afd3-6dc53e77b0e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:40:25.696724 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-5a8cc60d-ab38-4e51-afd3-6dc53e77b0e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:40:25.710415 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8cc60d-ab38-4e51-afd3-6dc53e77b0e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:40:25.712362 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8cc60d-ab38-4e51-afd3-6dc53e77b0e4 service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:40:25.723121 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1468/2941] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:40:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:40:27.438896 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9a45be-2fc4-42dc-be8e-ddde33708c41 service neutron] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:40:27.448017 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9a45be-2fc4-42dc-be8e-ddde33708c41 service neutron] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:40:27.451560 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb81ecd-a790-4887-ae22-fd00ce2b5680 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:40:27.452149 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb81ecd-a790-4887-ae22-fd00ce2b5680 service neutron] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:40:27.452427 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb81ecd-a790-4887-ae22-fd00ce2b5680 service neutron] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:40:27.452700 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb81ecd-a790-4887-ae22-fd00ce2b5680 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:40:27.454406 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-ecb81ecd-a790-4887-ae22-fd00ce2b5680 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:40:27.464397 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb81ecd-a790-4887-ae22-fd00ce2b5680 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:40:27.465806 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb81ecd-a790-4887-ae22-fd00ce2b5680 service neutron] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:40:27.473677 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1474/2942] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:40:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:40:35.717760 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=6 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:40:37.470084 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=12 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:42:16.357959 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8cc60d-ab38-4e51-afd3-6dc53e77b0e4 service neutron] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:42:16.367293 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8cc60d-ab38-4e51-afd3-6dc53e77b0e4 service neutron] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:42:16.370906 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edd977a-0cb0-4099-b783-64e83cbf0635 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:42:16.371502 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd977a-0cb0-4099-b783-64e83cbf0635 service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:42:16.371783 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd977a-0cb0-4099-b783-64e83cbf0635 service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:42:16.372056 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd977a-0cb0-4099-b783-64e83cbf0635 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:42:16.381357 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edd977a-0cb0-4099-b783-64e83cbf0635 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:42:16.382824 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edd977a-0cb0-4099-b783-64e83cbf0635 service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:42:16.391492 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1469/2943] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:42:16 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:42:17.243689 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb81ecd-a790-4887-ae22-fd00ce2b5680 service neutron] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:42:17.246291 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-ecb81ecd-a790-4887-ae22-fd00ce2b5680 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:42:17.264853 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb81ecd-a790-4887-ae22-fd00ce2b5680 service neutron] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:42:17.270668 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c623f50-f461-44d0-9c96-7a3710d146e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d05c52570474820b4ba0e2cdad5c13f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:42:17.271713 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c623f50-f461-44d0-9c96-7a3710d146e5 service nova] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:42:17.272088 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c623f50-f461-44d0-9c96-7a3710d146e5 service nova] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:42:17.272456 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c623f50-f461-44d0-9c96-7a3710d146e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:42:17.274405 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-0c623f50-f461-44d0-9c96-7a3710d146e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:42:17.288561 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c623f50-f461-44d0-9c96-7a3710d146e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:42:17.290235 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c623f50-f461-44d0-9c96-7a3710d146e5 service nova] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:42:17.303011 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1475/2944] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:42:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:42:21.412360 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edd977a-0cb0-4099-b783-64e83cbf0635 service neutron] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:42:21.413769 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-6edd977a-0cb0-4099-b783-64e83cbf0635 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:42:21.453963 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edd977a-0cb0-4099-b783-64e83cbf0635 service neutron] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:42:21.457569 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f1443f-7dbf-430e-9415-ad3ac62443eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4003dbcee8104aa4a7ce90251bab88a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:42:21.458159 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1443f-7dbf-430e-9415-ad3ac62443eb service neutron] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:42:21.458465 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1443f-7dbf-430e-9415-ad3ac62443eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:42:21.458761 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1443f-7dbf-430e-9415-ad3ac62443eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:42:21.537127 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f1443f-7dbf-430e-9415-ad3ac62443eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:42:21.538476 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f1443f-7dbf-430e-9415-ad3ac62443eb service neutron] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:42:21.547713 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1470/2945] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:42:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:42:24.312385 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c623f50-f461-44d0-9c96-7a3710d146e5 service nova] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:42:24.364427 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c623f50-f461-44d0-9c96-7a3710d146e5 service nova] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:42:24.369554 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e64fe9b-9a79-422e-b9f5-c837d753ebb6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ff8a5ddf1e422ca97f92bd9d4e5fb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:42:24.370391 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e64fe9b-9a79-422e-b9f5-c837d753ebb6 service placement] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:42:24.371042 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e64fe9b-9a79-422e-b9f5-c837d753ebb6 service placement] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:42:24.371468 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e64fe9b-9a79-422e-b9f5-c837d753ebb6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:42:24.373647 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-5e64fe9b-9a79-422e-b9f5-c837d753ebb6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:42:24.387288 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e64fe9b-9a79-422e-b9f5-c837d753ebb6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:42:24.388888 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e64fe9b-9a79-422e-b9f5-c837d753ebb6 service placement] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:42:24.404934 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1476/2946] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:42:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:42:27.442518 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f1443f-7dbf-430e-9415-ad3ac62443eb service neutron] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:42:27.455453 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f1443f-7dbf-430e-9415-ad3ac62443eb service neutron] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:42:27.461974 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae8ca4b-c943-4854-ade1-89a6027b91d0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ff8a5ddf1e422ca97f92bd9d4e5fb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:42:27.462589 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae8ca4b-c943-4854-ade1-89a6027b91d0 service placement] REQUEST_METHOD: `GET` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:42:27.462923 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae8ca4b-c943-4854-ade1-89a6027b91d0 service placement] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:42:27.463201 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae8ca4b-c943-4854-ade1-89a6027b91d0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:42:27.464978 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-9ae8ca4b-c943-4854-ade1-89a6027b91d0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:42:27.477285 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae8ca4b-c943-4854-ade1-89a6027b91d0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:42:27.478998 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae8ca4b-c943-4854-ade1-89a6027b91d0 service placement] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:42:27.495049 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1471/2947] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:42:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:42:27.504232 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e64fe9b-9a79-422e-b9f5-c837d753ebb6 service placement] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:42:27.515762 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e64fe9b-9a79-422e-b9f5-c837d753ebb6 service placement] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:42:27.522115 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e9648f-d5cb-4326-8fdf-dfbbdb88b442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:42:27.522115 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e9648f-d5cb-4326-8fdf-dfbbdb88b442 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:42:27.522378 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e9648f-d5cb-4326-8fdf-dfbbdb88b442 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:42:27.522648 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e9648f-d5cb-4326-8fdf-dfbbdb88b442 admin admin] PATH_INFO: `/v3/users/03b0980464ce4c6dbc095939e1599589` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:42:27.523822 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e9648f-d5cb-4326-8fdf-dfbbdb88b442 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03b0980464ce4c6dbc095939e1599589)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:42:27.525718 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e9648f-d5cb-4326-8fdf-dfbbdb88b442 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:42:27.574865 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-59e9648f-d5cb-4326-8fdf-dfbbdb88b442 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03b0980464ce4c6dbc095939e1599589'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:42:27.583287 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-59e9648f-d5cb-4326-8fdf-dfbbdb88b442 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03b0980464ce4c6dbc095939e1599589'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:42:27.583895 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-59e9648f-d5cb-4326-8fdf-dfbbdb88b442 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03b0980464ce4c6dbc095939e1599589'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:42:27.584521 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-59e9648f-d5cb-4326-8fdf-dfbbdb88b442 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03b0980464ce4c6dbc095939e1599589'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:42:27.591758 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-59e9648f-d5cb-4326-8fdf-dfbbdb88b442 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03b0980464ce4c6dbc095939e1599589'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:42:27.608751 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1477/2948] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:42:27 2022] DELETE /identity/v3/users/03b0980464ce4c6dbc095939e1599589 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:42:27.788413 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae8ca4b-c943-4854-ade1-89a6027b91d0 service placement] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:42:27.805018 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae8ca4b-c943-4854-ade1-89a6027b91d0 service placement] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:42:27.868397 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19f3049-ec2b-4238-99e7-6bc433f4ef91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:42:27.869023 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f3049-ec2b-4238-99e7-6bc433f4ef91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:42:27.869301 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f3049-ec2b-4238-99e7-6bc433f4ef91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:42:27.869567 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f3049-ec2b-4238-99e7-6bc433f4ef91 admin admin] PATH_INFO: `/v3/projects/33b11d92f8fd488c91ecafefd8a2878d` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:42:27.870748 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19f3049-ec2b-4238-99e7-6bc433f4ef91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33b11d92f8fd488c91ecafefd8a2878d)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:42:27.872626 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19f3049-ec2b-4238-99e7-6bc433f4ef91 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:42:27.895037 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:SELECT=100 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:42:27.918256 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-c19f3049-ec2b-4238-99e7-6bc433f4ef91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33b11d92f8fd488c91ecafefd8a2878d', 'request_id': 'req-c19f3049-ec2b-4238-99e7-6bc433f4ef91'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:42:27.924868 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-c19f3049-ec2b-4238-99e7-6bc433f4ef91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33b11d92f8fd488c91ecafefd8a2878d', 'request_id': 'req-c19f3049-ec2b-4238-99e7-6bc433f4ef91'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:42:27.930369 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-c19f3049-ec2b-4238-99e7-6bc433f4ef91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33b11d92f8fd488c91ecafefd8a2878d', 'request_id': 'req-c19f3049-ec2b-4238-99e7-6bc433f4ef91'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:42:27.942754 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-c19f3049-ec2b-4238-99e7-6bc433f4ef91 admin admin] The token cache is being invalidate because project 33b11d92f8fd488c91ecafefd8a2878d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:42:27.943044 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-c19f3049-ec2b-4238-99e7-6bc433f4ef91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:42:27.943698 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-c19f3049-ec2b-4238-99e7-6bc433f4ef91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:42:27.945186 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1472/2949] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:42:27 2022] DELETE /identity/v3/projects/33b11d92f8fd488c91ecafefd8a2878d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:42:27.949131 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e9648f-d5cb-4326-8fdf-dfbbdb88b442 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:42:27.950517 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-59e9648f-d5cb-4326-8fdf-dfbbdb88b442 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:42:27.963515 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e9648f-d5cb-4326-8fdf-dfbbdb88b442 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:42:28.020416 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36692f4e-8dd9-4bb0-912b-fc395f1407b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:42:28.020961 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36692f4e-8dd9-4bb0-912b-fc395f1407b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:42:28.021235 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36692f4e-8dd9-4bb0-912b-fc395f1407b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:42:28.021503 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36692f4e-8dd9-4bb0-912b-fc395f1407b9 admin admin] PATH_INFO: `/v3/users/4439800dced34b5caf2ea268b7aa48b4` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:42:28.022614 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36692f4e-8dd9-4bb0-912b-fc395f1407b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4439800dced34b5caf2ea268b7aa48b4)` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:42:28.024543 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36692f4e-8dd9-4bb0-912b-fc395f1407b9 admin admin] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:42:28.040269 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:42:28.071331 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-36692f4e-8dd9-4bb0-912b-fc395f1407b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4439800dced34b5caf2ea268b7aa48b4'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:42:28.078849 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-36692f4e-8dd9-4bb0-912b-fc395f1407b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4439800dced34b5caf2ea268b7aa48b4'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:42:28.079463 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-36692f4e-8dd9-4bb0-912b-fc395f1407b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4439800dced34b5caf2ea268b7aa48b4'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:42:28.080089 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-36692f4e-8dd9-4bb0-912b-fc395f1407b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4439800dced34b5caf2ea268b7aa48b4'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:42:28.087112 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.notifications [None req-36692f4e-8dd9-4bb0-912b-fc395f1407b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4439800dced34b5caf2ea268b7aa48b4'} {{(pid=81375) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:42:28.104537 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1478/2950] 10.222.0.16 () {58 vars in 1224 bytes} [Thu Sep 15 12:42:27 2022] DELETE /identity/v3/users/4439800dced34b5caf2ea268b7aa48b4 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:42:28.283832 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19f3049-ec2b-4238-99e7-6bc433f4ef91 admin admin] Authenticating user token {{(pid=81374) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:42:28.285291 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.fernet_utils [None req-c19f3049-ec2b-4238-99e7-6bc433f4ef91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81374) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:42:28.299353 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19f3049-ec2b-4238-99e7-6bc433f4ef91 admin admin] Validating token access rules against request {{(pid=81374) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:42:28.357044 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae214fa-9325-497f-8817-310b9cab6800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0385d82554b5461ca05c9bdb07b4a451', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd145f986559340aaa64b155220d60d8c', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81374) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:42:28.357667 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae214fa-9325-497f-8817-310b9cab6800 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:42:28.357943 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae214fa-9325-497f-8817-310b9cab6800 admin admin] SCRIPT_NAME: `/identity` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:42:28.358214 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae214fa-9325-497f-8817-310b9cab6800 admin admin] PATH_INFO: `/v3/projects/91cc1d127c1e458ab065b540f8f1b0c7` {{(pid=81374) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:42:28.359346 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae214fa-9325-497f-8817-310b9cab6800 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91cc1d127c1e458ab065b540f8f1b0c7)` {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:42:28.361225 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae214fa-9325-497f-8817-310b9cab6800 admin admin] RBAC: Authorization granted {{(pid=81374) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:42:28.406351 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-6ae214fa-9325-497f-8817-310b9cab6800 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91cc1d127c1e458ab065b540f8f1b0c7', 'request_id': 'req-6ae214fa-9325-497f-8817-310b9cab6800'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:42:28.412993 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-6ae214fa-9325-497f-8817-310b9cab6800 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91cc1d127c1e458ab065b540f8f1b0c7', 'request_id': 'req-6ae214fa-9325-497f-8817-310b9cab6800'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:42:28.418966 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-6ae214fa-9325-497f-8817-310b9cab6800 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91cc1d127c1e458ab065b540f8f1b0c7', 'request_id': 'req-6ae214fa-9325-497f-8817-310b9cab6800'} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:42:28.433174 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-6ae214fa-9325-497f-8817-310b9cab6800 admin admin] The token cache is being invalidate because project 91cc1d127c1e458ab065b540f8f1b0c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81374) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 12:42:28.433463 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-6ae214fa-9325-497f-8817-310b9cab6800 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:42:28.434081 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG keystone.notifications [None req-6ae214fa-9325-497f-8817-310b9cab6800 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81374) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 12:42:28.435661 dv-cinder-850836-7-smb devstack@keystone.service[81374]: [pid: 81374|app: 0|req: 1473/2951] 10.222.0.16 () {58 vars in 1233 bytes} [Thu Sep 15 12:42:28 2022] DELETE /identity/v3/projects/91cc1d127c1e458ab065b540f8f1b0c7 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 12:42:38.101075 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:DELETE=9,keystone:SELECT=20,keystone:INSERT=1 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:42:38.429934 dv-cinder-850836-7-smb devstack@keystone.service[81374]: DEBUG dbcounter [-] [81374] Writing DB stats keystone:DELETE=14,keystone:SELECT=66,keystone:INSERT=2 {{(pid=81374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 12:42:40.461172 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36692f4e-8dd9-4bb0-912b-fc395f1407b9 admin admin] Authenticating user token {{(pid=81375) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 12:42:40.463087 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-36692f4e-8dd9-4bb0-912b-fc395f1407b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:42:40.552860 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36692f4e-8dd9-4bb0-912b-fc395f1407b9 admin admin] Validating token access rules against request {{(pid=81375) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 12:42:40.610054 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f613f074-2350-4dcb-bbef-ae762d369704 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7ff8a5ddf1e422ca97f92bd9d4e5fb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cab958c081ad4a92939d4469cf4ce1c6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81375) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 12:42:40.610655 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f613f074-2350-4dcb-bbef-ae762d369704 service placement] REQUEST_METHOD: `GET` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 12:42:40.611169 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f613f074-2350-4dcb-bbef-ae762d369704 service placement] SCRIPT_NAME: `/identity` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 12:42:40.611656 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f613f074-2350-4dcb-bbef-ae762d369704 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81375) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 12:42:40.613349 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.fernet_utils [None req-f613f074-2350-4dcb-bbef-ae762d369704 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81375) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 12:42:40.624227 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f613f074-2350-4dcb-bbef-ae762d369704 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 12:42:40.625781 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f613f074-2350-4dcb-bbef-ae762d369704 service placement] RBAC: Authorization granted {{(pid=81375) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 12:42:40.636161 dv-cinder-850836-7-smb devstack@keystone.service[81375]: [pid: 81375|app: 0|req: 1479/2952] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Sep 15 12:42:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 12:42:50.632073 dv-cinder-850836-7-smb devstack@keystone.service[81375]: DEBUG dbcounter [-] [81375] Writing DB stats keystone:SELECT=67 {{(pid=81375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}